Memory
As an Amazon Associate, I earn from qualifying purchases.
Best for general use
Highest MMLU score among models that run well
- Qwen3.6 27B Q8_0 62K context · ~5 tok/s · MMLU 86.2
- Qwen3.5 27B Q8_0 88K context · ~5 tok/s · MMLU 86.1
- Qwen3.5 35B A3B Q4_K_M 256K context · ~47 tok/s · MMLU 85.3
Best for coding
Highest SWE-bench Verified score among models that run well
- Qwen3.8 27B Q8_0 81K context · ~5 tok/s · SWE-bench 86
- Ornith 1.5 35B A3B Q4_K_M 256K context · ~48 tok/s · SWE-bench 79
- Qwen3.6 27B Q8_0 62K context · ~5 tok/s · SWE-bench 77.2
Upgrade options
The cheapest GPUs with more VRAM than the M5, by launch MSRP.
As an Amazon Associate, I earn from qualifying purchases.
Every model on the M5 (32 GB)
135 of 214 model configurations can run on 32 GB — sorted by quality
107 models, each counted once by the best way it runs on your hardware.
Largest that runs well Flint 40B A2.5B 39.79B params · Q4_K_M · 256K context Fastest good-quality model GLM-4.7 Flash ~49 tok/s · Q4_K_M · 128K context Runs well 71
Tight fit 2
-
Q4_K_M Context 8K Speed ~9 tok/s
Only 8K context — under the 16K needed to be practical
Q8_0 Context 8K Speed ~5 tok/s
Only 8K context — under the 16K needed to be practical
-
Q4_K_M Context 8K Speed ~23 tok/s
Only 8K context — under the 16K needed to be practical
Q8_0 Context 8K Speed ~14 tok/s
Only 8K context — under the 16K needed to be practical
Notify me when new models fit my GPU
An email when a new model fits your M5 — no spam, unsubscribe anytime.
Doesn't fit 34
-
Q4_K_M Needs 381.2 GB — 349.2 GB over
Q8_0 Needs 664.4 GB — 632.4 GB over
-
Q4_K_M Needs 45.1 GB — 13.1 GB over
Q8_0 Needs 79.0 GB — 47.0 GB over
GPUs that can run this
As an Amazon Associate, I earn from qualifying purchases.
-
Q4_K_M Needs 586.5 GB — 554.5 GB over
Q8_0 Needs 1013.0 GB — 981.0 GB over