CPU
A CPU is a computer's general-purpose processor, also used to run and perform inference with local AI models.
The CPU, or central processing unit, executes a computer's general-purpose program instructions. When running a local large language model, it handles input processing and program control and can also perform inference calculations. A GPU, by contrast, specializes in carrying out many calculations in parallel.
This entry is based on AIPOST articles and widely known facts. If something is wrong, please send us a correction request.
Articles covering this entry
The model ran under llama.cpp on Ubuntu Server 24.04.4 with an AMD Ryzen 5700X CPU and 32GB of DDR4 memory.
On phones with neural processing units and GPUs, such as the Google Pixel 10, Gemma models run smoothly without draining the CPU.
…ization for growing code blocks into a web worker cut main-thread blocking during long replies from over 750 ms to about 200 ms, and CPU use fell by two-thirds.
The observability agent queried Prometheus metrics, including CPU use and available filesystem space, and displayed the resulting trends.
It also had 36 CPU cores, compared with 32 on the M3 Ultra.