What GPU do you need to run GLM 5.3?
753.33B params 1M max context Tool useReasoning
GLM 5.3 doesn't fit on any single GPU in our database. Try multiple GPUs or system RAM offloading in the full tool. It's a mixture-of-experts model, so all weights must fit in memory but speed depends only on the active experts.
VRAM needed per quantization
| Quantization | Weights | 16K context | 32K context | Full 1M |
|---|---|---|---|---|
| Q8_0 | 746.3 GB | 747.7 GB | 749.0 GB | 832.3 GB |
Weights plus fp16 KV cache. Leave ~1 GB headroom for the inference engine.
GPUs that can run GLM 5.3
None on its own — open the tool to try multiple GPUs or system RAM offloading.