GPUs / By VRAM Best local LLMs for 8 GB VRAM (November 2026): what fits, context and speed With 8 GB of VRAM or unified memory, 33 models run well and 4 more are a tight fit. 70 don't fit.
Speeds assume 320 GB/s , the median memory bandwidth of the 33 GPUs and memory
configurations with exactly 8 GB. Yours may be faster or slower: pick your GPU for exact numbers.
Best overall Highest MMLU-Pro score among models that run well
Qwen3.5 9B Q4_K_M 87K context · ~48 tok/s · MMLU 82.5 Qwen3.5 4B Q8_0 123K context · ~58 tok/s · MMLU 79.1 Qwen3 8B Q4_K_M 24K context · ~53 tok/s · MMLU 79 Gemma 4 12B Q4_K_M 91K context · ~39 tok/s · MMLU 77.2 Nemotron Nano 12B Q4_K_M 44K context · ~38 tok/s · MMLU 76 GPUs with 8 GB of memory Unified memory (Apple Silicon, Ryzen AI Max, RTX Spark) M2 100 GB/s M3 100 GB/s M1 68 GB/s Upgrade options 12 GB runs 9 more
models well, including Phi-4 14B , Qwen 2.5 14B and GPT-OSS 20B .
The cheapest GPUs with more than 8 GB, by launch MSRP.
As an Amazon Associate, I earn from qualifying purchases.
Every model in 8 GB 61 of 214 model configurations can run on 8 GB — sorted by quality
107 models, each counted once by the best way it runs on your hardware.
Fastest good-quality model Phi-4 Mini 3.8B ~92 tok/s · Q4_K_M · 46K context Runs well 33 View all 33 →
Runs well 33 ✕ Q4_K_M Context 87K Speed ~48 tok/s
Q8_0 Doesn't fit · needs 8.9 GB
Q4_K_M Context 175K Speed ~86 tok/s
Q8_0 Context 123K Speed ~58 tok/s
Q4_K_M Context 24K Speed ~53 tok/s
Q8_0 Doesn't fit · needs 8.2 GB
Q4_K_M Context 91K Speed ~39 tok/s
Q8_0 Doesn't fit · needs 11.8 GB
Q4_K_M Context 44K Speed ~38 tok/s
Q8_0 Doesn't fit · needs 12.2 GB
Q4_K_M Context 68K Speed ~56 tok/s
Q8_0 Tight fit · 8K context
Q4_K_M Context 68K Speed ~56 tok/s
Q8_0 Tight fit · 8K context
Q4_K_M Context 19K Speed ~39 tok/s
Q8_0 Doesn't fit · needs 11.7 GB
Q4_K_M Context 16K Speed ~43 tok/s
Q8_0 Doesn't fit · needs 10.5 GB
Q4_K_M Context 46K Speed ~92 tok/s
Q8_0 Context 34K Speed ~63 tok/s
Q4_K_M Context 128K Speed ~50 tok/s
Q8_0 Context 34K Speed ~35 tok/s
Q4_K_M Context 28K Speed ~54 tok/s
Q8_0 Doesn't fit · needs 8.1 GB
fp16 Doesn't fit · needs 15.1 GB
Q4_K_M Context 68K Speed ~56 tok/s
Q8_0 Tight fit · 8K context
Q4_K_M Context 128K Speed ~109 tok/s
Q8_0 Context 128K Speed ~75 tok/s
Q4_K_M Context 32K Speed ~109 tok/s
Q8_0 Context 32K Speed ~75 tok/s
Q4_K_M Context 32K Speed ~103 tok/s
Q8_0 Context 32K Speed ~71 tok/s
Q4_K_M Context 21K Speed ~50 tok/s
Q8_0 Doesn't fit · needs 8.1 GB
Q4_K_M Context 57K Speed ~106 tok/s
Q8_0 Context 44K Speed ~72 tok/s
fp16 Context 18K Speed ~43 tok/s
Q4_K_M Context 128K Speed ~92 tok/s
Q8_0 Context 128K Speed ~62 tok/s
Q4_K_M Context 128K Speed ~72 tok/s
Q8_0 Context 128K Speed ~54 tok/s
Q4_K_M Context 68K Speed ~56 tok/s
Q8_0 Tight fit · 8K context
Q4_K_M Context 256K Speed ~140 tok/s
Q8_0 Context 256K Speed ~106 tok/s
Q4_K_M Context 128K Speed ~177 tok/s
Q8_0 Context 128K Speed ~138 tok/s
Q4_K_M Context 256K Speed ~208 tok/s
Q8_0 Context 256K Speed ~176 tok/s
Q4_K_M Context 256K Speed ~81 tok/s
Q8_0 Context 256K Speed ~61 tok/s
Q4_K_M Context 256K Speed ~153 tok/s
Q8_0 Context 256K Speed ~112 tok/s
Q4_K_M Context 128K Speed ~120 tok/s
Q8_0 Context 128K Speed ~83 tok/s
Q4_K_M Context 128K Speed ~153 tok/s
Q8_0 Context 128K Speed ~112 tok/s
Q4_K_M Context 84K Speed ~47 tok/s
Q8_0 Doesn't fit · needs 9.1 GB
Q4_K_M Context 82K Speed ~47 tok/s
Q8_0 Doesn't fit · needs 8.9 GB
Q4_K_M Context 64K Speed ~45 tok/s
Q8_0 Context 34K Speed ~35 tok/s
Q4_K_M Context 36K Speed ~92 tok/s
MoE — speed based on ~1.55 GB active experts plus per-token routing overhead (full 7.52 GB loaded in VRAM)
Q8_0 Doesn't fit · needs 12.1 GB
Q4_K_M Context 20K Speed ~49 tok/s
Q8_0 Doesn't fit · needs 9.1 GB
Notify me when new models fit my GPU An email when a new model fits your 8 GB setup — no spam, unsubscribe anytime.
Doesn't fit 70 Q4_K_M Needs 381.2 GB — 373.2 GB over
Q8_0 Needs 664.4 GB — 656.4 GB over
Q4_K_M Needs 45.1 GB — 37.1 GB over
Q8_0 Needs 79.0 GB — 71.0 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 586.5 GB — 578.5 GB over
Q8_0 Needs 1013.0 GB — 1005.0 GB over
View all 70 →
Doesn't fit 70 ✕ Q4_K_M Needs 381.2 GB — 373.2 GB over
Q8_0 Needs 664.4 GB — 656.4 GB over
Q4_K_M Needs 45.1 GB — 37.1 GB over
Q8_0 Needs 79.0 GB — 71.0 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 586.5 GB — 578.5 GB over
Q8_0 Needs 1013.0 GB — 1005.0 GB over
Q4_K_M Needs 68.2 GB — 60.2 GB over
Q8_0 Needs 118.3 GB — 110.3 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 128.9 GB — 120.9 GB over
Q8_0 Needs 226.5 GB — 218.5 GB over
Q4_K_M Needs 900.1 GB — 892.1 GB over
Q8_0 Needs 1670.1 GB — 1662.1 GB over
Q4_K_M Needs 227.4 GB — 219.4 GB over
Q8_0 Needs 392.6 GB — 384.6 GB over
GLM-4.6 357B Excellent Reasoning Tool use MMLU 87
Q4_K_M Needs 200.8 GB — 192.8 GB over
Q8_0 Needs 353.3 GB — 345.3 GB over
Q4_K_M Needs 428.2 GB — 420.2 GB over
Q8_0 Needs 746.4 GB — 738.4 GB over
GLM 5.3 753.33B Excellent Tool use Reasoning MMLU 86.8
Q8_0 Needs 746.4 GB — 738.4 GB over
Q4_K_M Needs 161.1 GB — 153.1 GB over
Q8_0 Needs 282.1 GB — 274.1 GB over
Q4_K_M Needs 15.5 GB — 7.5 GB over
Q8_0 Needs 28.1 GB — 20.1 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 176.0 GB — 168.0 GB over
Q8_0 Needs 310.4 GB — 302.4 GB over
Q4_K_M Needs 44.5 GB — 36.5 GB over
Q8_0 Needs 72.3 GB — 64.3 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 44.5 GB — 36.5 GB over
Q8_0 Needs 72.3 GB — 64.3 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 15.7 GB — 7.7 GB over
Q8_0 Needs 26.7 GB — 18.7 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 39.9 GB — 31.9 GB over
Q8_0 Needs 70.1 GB — 62.1 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 226.3 GB — 218.3 GB over
Q8_0 Needs 396.8 GB — 388.8 GB over
Q4_K_M Needs 20.5 GB — 12.5 GB over
Q8_0 Needs 34.4 GB — 26.4 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 20.6 GB — 12.6 GB over
Q8_0 Needs 34.4 GB — 26.4 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 17.1 GB — 9.1 GB over
Q8_0 Needs 30.5 GB — 22.5 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 71.3 GB — 63.3 GB over
Q8_0 Needs 121.0 GB — 113.0 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 18.6 GB — 10.6 GB over
Q8_0 Needs 32.7 GB — 24.7 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 8.6 GB — 0.6 GB over
Q8_0 Needs 14.7 GB — 6.7 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 15.4 GB — 7.4 GB over
Q8_0 Needs 27.1 GB — 19.1 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 111.9 GB — 103.9 GB over
Q8_0 Needs 195.2 GB — 187.2 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 39.9 GB — 31.9 GB over
Q8_0 Needs 70.1 GB — 62.1 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 18.7 GB — 10.7 GB over
Q8_0 Needs 32.7 GB — 24.7 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
GLM 5 753.86B Excellent Tool use MMLU 83
Q4_K_M Needs 424.7 GB — 416.7 GB over
Q8_0 Needs 746.4 GB — 738.4 GB over
QwQ 32B 32.5B Excellent Reasoning Tool use MMLU 83
Q4_K_M Needs 18.7 GB — 10.7 GB over
Q8_0 Needs 32.7 GB — 24.7 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 175.9 GB — 167.9 GB over
Q8_0 Needs 306.8 GB — 298.8 GB over
Q4_K_M Needs 15.9 GB — 7.9 GB over
Q8_0 Needs 25.0 GB — 17.0 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 129.1 GB — 121.1 GB over
Q8_0 Needs 226.7 GB — 218.7 GB over
Q4_K_M Needs 17.1 GB — 9.1 GB over
Q8_0 Needs 29.7 GB — 21.7 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 13.5 GB — 5.5 GB over
Q8_0 Needs 23.5 GB — 15.5 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 23.7 GB — 15.7 GB over
Q8_0 Needs 32.6 GB — 24.6 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 17.4 GB — 9.4 GB over
Q8_0 Needs 30.3 GB — 22.3 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 13.5 GB — 5.5 GB over
Q8_0 Needs 23.5 GB — 15.5 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 18.7 GB — 10.7 GB over
Q8_0 Needs 32.7 GB — 24.7 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 8.6 GB — 0.6 GB over
Q8_0 Needs 14.8 GB — 6.8 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 23.0 GB — 15.0 GB over
Q8_0 Needs 31.3 GB — 23.3 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 61.1 GB — 53.1 GB over
Q8_0 Needs 106.9 GB — 98.9 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 18.7 GB — 10.7 GB over
Q8_0 Needs 32.7 GB — 24.7 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 15.5 GB — 7.5 GB over
Q8_0 Needs 26.8 GB — 18.8 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 15.9 GB — 7.9 GB over
Q8_0 Needs 27.3 GB — 19.3 GB over
Q4_K_M Needs 10.9 GB — 2.9 GB over
Q8_0 Needs 11.3 GB — 3.3 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 8.6 GB — 0.6 GB over
Q8_0 Needs 14.8 GB — 6.8 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 111.4 GB — 103.4 GB over
Q8_0 Needs 175.4 GB — 167.4 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 379.1 GB — 371.1 GB over
Q8_0 Needs 666.6 GB — 658.6 GB over
Q4_K_M Needs 13.5 GB — 5.5 GB over
Q8_0 Needs 23.5 GB — 15.5 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 8.6 GB — 0.6 GB over
Q8_0 Needs 14.8 GB — 6.8 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 12.6 GB — 4.6 GB over
Q8_0 Needs 22.2 GB — 14.2 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 9.3 GB — 1.3 GB over
Q8_0 Needs 15.9 GB — 7.9 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 591.3 GB — 583.3 GB over
Q8_0 Needs 1038.6 GB — 1030.6 GB over
Q4_K_M Needs 465.3 GB — 457.3 GB over
Q8_0 Needs 811.9 GB — 803.9 GB over
Q4_K_M Needs 333.4 GB — 325.4 GB over
Q8_0 Needs 566.6 GB — 558.6 GB over
Q4_K_M Needs 293.0 GB — 285.0 GB over
Q8_0 Needs 496.2 GB — 488.2 GB over
Q4_K_M Needs 227.6 GB — 219.6 GB over
Q8_0 Needs 399.1 GB — 391.1 GB over
Q4_K_S Needs 104.0 GB — 96.0 GB over
Q8_0 Needs 195.2 GB — 187.2 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 70.7 GB — 62.7 GB over
Q8_0 Needs 123.5 GB — 115.5 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 65.3 GB — 57.3 GB over
Q8_0 Needs 119.7 GB — 111.7 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q8_0 Needs 73.4 GB — 65.4 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 23.6 GB — 15.6 GB over
Q8_0 Needs 39.5 GB — 31.5 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 20.2 GB — 12.2 GB over
Q8_0 Needs 35.2 GB — 27.2 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 19.7 GB — 11.7 GB over
Q8_0 Needs 34.4 GB — 26.4 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 19.2 GB — 11.2 GB over
Q8_0 Needs 33.2 GB — 25.2 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 19.6 GB — 11.6 GB over
Q8_0 Needs 33.0 GB — 25.0 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 15.6 GB — 7.6 GB over
Q8_0 Needs 27.6 GB — 19.6 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Arete 27B 27.36B Basic Vision Tool use Reasoning MMLU
Q4_K_M Needs 16.1 GB — 8.1 GB over
Q8_0 Needs 26.8 GB — 18.8 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.
Q4_K_M Needs 13.5 GB — 5.5 GB over
Q8_0 Needs 23.8 GB — 15.8 GB over
GPUs that can run this As an Amazon Associate, I earn from qualifying purchases.