AMD has begun releasing Desktop Processors with built in hardware for AI i.e a dedicated NPU (neural processing unit) and are branded with RYZEN AI. Much of the effort is on the Laptop side so the desktop segment can get confusing as to which AMD desktop processors come with NPUs. Following are the AMD desktops processors that has NPUs and can support AI enabled apps that are coming in the future.
AMD Desktop Processors with bundled NPU/Ryzen AI
| Model | Cores/Threads | Boost / Base | Total Cache | TDP | Graphics | NPU | SEP |
| AMD Ryzen 7 8700G | 8C/16T | 5.1GHz / 4.2GHz | 24MB | 65W | Radeon 780M graphics | Yes | $329 |
| AMD Ryzen 5 8600G | 6C/12T | 5.0GHz / 4.3GHz | 22MB | 65W | Radeon 760M AMD graphics | Yes | $229 |
Other 8000F series processor that has flown under the radar but also come with NPU
| AMD Ryzen 7 8700F | 8C/16T | 5GHz / 4.1GHz | 24MB | 65W | AMD Radeon 780M graphics | Yes | $329 |
The following 6 core and 4 core part do not have built it NPU.
| AMD Ryzen 5 8400F | 6C/12T | 4.7GHz / 4.2GHz | 22MB | 65W | AMD Radeon 760M AMD graphics | N/A | $169 |
| AMD Ryzen 5 8500G | 6C/12T | 5.0GHz / 3.5GHz | 22MB | 65W | Radeon 740M graphics | N/A | $179 |
| AMD Ryzen3 8300G | 4C/8T | 4.9GHz / 3.4GHz | 12MB | 65W | Radeon 740M graphics | N/A | N/A |
By utilizing the embedded NPU, Ryzen AI-powered desktops can efficiently execute AI models and concurrent applications, freeing up CPU and GPU resources for other tasks. This results in seamless performance, enabling developers to run private, on-device large language model (LLM) workloads without compromising system performance.
Our Take:
Currently the real world applications are a bit distant, as the TOPS( trillions of operations per second ) provided by the NPUs is low tier 16 TOPS. Most of the Huggingface AMD repo is filled with basic AI apps. LLMs are not currently supported but the first supporting LLMs are being worked upon. If you wish to read about the NPU performance calculation, Qualcomm has a great article.
Should you a take decision of purchasing a desktop processor based on NPUs?
Answer is No! Please go with Raw CPU performance as per the current state of NPU affairs in the desktop segment.