What Models?

Pick the right model for your GPU — in seconds.

LFM3-VL 2B VRAM requirements: which GPUs can run it locally?

1.92B params 128K max context VisionTool useReasoning

The smallest GPU memory that runs LFM3-VL 2B well is 2 GB (Q8_0, e.g. T400). 132 of 132 GPUs run it well.

VRAM needed per quantization

QuantizationWeights16K context32K contextFull 128K
Q4_K_M1.0 GB1.2 GB1.4 GB2.4 GB
Q8_01.7 GB1.9 GB2.1 GB3.1 GB

Weights plus fp16 KV cache. Leave ~1 GB headroom for the inference engine.

Run it locally

Each command downloads the GGUF from Hugging Face, then Ollama starts a chat and llama.cpp starts an OpenAI-compatible server with a web UI on port 8080. Both fetch the vision projector (mmproj) automatically.

Ollama ollama run hf.co/LiquidAI/LFM3-VL-2B-GGUF:Q4_K_M
llama.cpp llama-server -hf LiquidAI/LFM3-VL-2B-GGUF:Q4_K_M
Ollama ollama run hf.co/LiquidAI/LFM3-VL-2B-GGUF:Q8_0
llama.cpp llama-server -hf LiquidAI/LFM3-VL-2B-GGUF:Q8_0

Cheapest GPUs that can run LFM3-VL 2B

Lowest launch MSRP among GPUs that run its smallest quantization (Q4_K_M) well, with at least 16K context.

As an Amazon Associate, I earn from qualifying purchases.

GPUs that can run LFM3-VL 2B

Best quantization that fits on each GPU, with the context and speed it gets. For chips with several memory sizes, the smallest that works is shown.

NVIDIA

AMD

Intel

Apple

  • M1 8 GB Q8_0 128K context · ~24 tok/s
  • M2 8 GB Q8_0 128K context · ~35 tok/s
  • M3 8 GB Q8_0 128K context · ~35 tok/s
  • M1 Pro 16 GB Q8_0 128K context · ~70 tok/s
  • M2 Pro 16 GB Q8_0 128K context · ~70 tok/s
  • M4 16 GB Q8_0 128K context · ~42 tok/s
  • M5 16 GB Q8_0 128K context · ~54 tok/s
  • M6 16 GB Q8_0 128K context · ~54 tok/s
  • M3 Pro 18 GB Q8_0 128K context · ~53 tok/s
  • M4 Pro 24 GB Q8_0 128K context · ~96 tok/s
  • M5 Pro 24 GB Q8_0 128K context · ~108 tok/s
  • M1 Max 32 GB Q8_0 128K context · ~141 tok/s
  • M2 Max 32 GB Q8_0 128K context · ~141 tok/s
  • M3 Max 36 GB Q8_0 128K context · ~105 tok/s
  • M4 Max 36 GB Q8_0 128K context · ~144 tok/s
  • M5 Max 36 GB Q8_0 128K context · ~162 tok/s
  • M1 Ultra 64 GB Q8_0 128K context · ~197 tok/s
  • M2 Ultra 64 GB Q8_0 128K context · ~197 tok/s
  • M3 Ultra 96 GB Q8_0 128K context · ~201 tok/s
  • M5 Ultra 96 GB Q8_0 128K context · ~295 tok/s
Check your exact setup in the full tool →