What computer do you need to run LLMs locally?
A GPU is best; ordinary computers work too. Once installed, the node tells you exactly what this computer can do.
Recommended setups
| Device | Recommendation | Can do | |
|---|---|---|---|
| NVIDIA GPU (8 GB VRAM or more) | Best | Chat · images · image edits · speech · video | Tested |
| AI workstations such as DGX Spark | Best | Images · video · chat | Tested |
| Apple M-series Mac | Best | Chat · images · speech | Tested |
| AMD GPU (Linux) | Recommended | Chat · images | Tested |
| Ordinary computer / laptop | Works | Lighter tasks like chat and speech | |
| Phone / tablet | Use your home computer or compute reserve |
Not enough power?
When your computer can’t handle a kind of task, it switches to the network’s compute reserve automatically.
FAQ
Yes. Ordinary computers can handle lighter tasks like chat and speech; for images and video a GPU is recommended.
Yes. Apple M-series Macs can handle chat, images and speech.
Phones can’t run the node, but they can use compute from your home computer or your compute reserve.
Once installed, the node lists the tasks it can handle based on its GPU and memory.
Related
What computer do you need to run LLMs locally?