Memory
As an Amazon Associate, I earn from qualifying purchases.
Best for general use
Highest MMLU score among models that run well
- Qwen3 Next 80B-A3B Q8_0 256K context · ~107 tok/s · MMLU 90
- Mistral Small 4 Q8_0 18K context · ~65 tok/s · MMLU 88.5
- Qwen3.6 27B Q8_0 256K context · ~20 tok/s · MMLU 86.2
Best for coding
Highest SWE-bench Verified score among models that run well
- Qwen3.8 27B Q8_0 256K context · ~20 tok/s · SWE-bench 86
- Ornith 1.5 122B Q8_0 197K context · ~47 tok/s · SWE-bench 84.5
- Ornith 1.5 35B A3B Q8_0 256K context · ~108 tok/s · SWE-bench 79
Every model on the M5 Max (128 GB)
172 of 214 model configurations can run on 128 GB — sorted by quality
107 models, each counted once by the best way it runs on your hardware.
Largest that runs well Step 3.7 Flash 198B params · Q4_K_S · 140K context Fastest good-quality model Phi-3 Mini 3.8B ~181 tok/s · Q4_K_M · 128K context Runs well 85
-
Q4_K_M Context 256K Speed ~141 tok/s
MoE — speed based on ~1.69 GB active experts plus per-token routing overhead (full 45.09 GB loaded in VRAM)
Q8_0 Context 256K Speed ~107 tok/s
MoE — speed based on ~2.96 GB active experts plus per-token routing overhead (full 78.99 GB loaded in VRAM)
-
Q4_K_M Context 109K Speed ~94 tok/s
MoE — speed based on ~3.7 GB active experts plus per-token routing overhead (full 67.65 GB loaded in VRAM)
Q8_0 Context 18K Speed ~65 tok/s
MoE — speed based on ~6.43 GB active experts plus per-token routing overhead (full 117.79 GB loaded in VRAM)
-
Q4_K_M Context 256K Speed ~35 tok/s
Q8_0 Context 256K Speed ~20 tok/s
Tight fit 2
-
Q4_K_M Context 8K Speed ~35 tok/s
Only 8K context — under the 16K needed to be practical
Q8_0 Context 8K Speed ~21 tok/s
Only 8K context — under the 16K needed to be practical
-
Q4_K_M Context 8K Speed ~91 tok/s
Only 8K context — under the 16K needed to be practical
Q8_0 Context 8K Speed ~57 tok/s
Only 8K context — under the 16K needed to be practical
Notify me when new models fit my GPU
An email when a new model fits your M5 Max — no spam, unsubscribe anytime.
Doesn't fit 20
-
Q4_K_M Needs 381.2 GB — 253.2 GB over
Q8_0 Needs 664.4 GB — 536.4 GB over
-
Q4_K_M Needs 586.5 GB — 458.5 GB over
Q8_0 Needs 1013.0 GB — 885.0 GB over
-
Q4_K_M Needs 128.9 GB — 0.9 GB over
Q8_0 Needs 226.5 GB — 98.5 GB over