VRAM calculator

Pick a model or type a parameter count to see how much memory the weights need at different precisions, and what kind of machine that means.

VRAM calculator

Estimated memory (30.7B)

Precision Memory What can run it
BF16 (full quality) 71 GB Workstation
FP8 / INT8 (high quality) 35 GB Workstation
4-bit (Q4, best for local use) 21 GB Gaming GPU

What can run it

Hardware BF16FP84-bit
Laptop or phone up to 16 GB · Typical laptop, phone, 8 to 16 GB graphics card Does not fitDoes not fitDoes not fit
Gaming GPU 16 to 32 GB · RTX 3090, 4090 or 5090, 32 GB Mac Does not fitDoes not fitFits
Workstation 32 to 96 GB · RTX PRO 6000 (96 GB), several GPUs FitsFitsFits
Big-memory desktop 96 to 512 GB · Mac Studio, AMD Strix Halo, NVIDIA DGX Spark FitsFitsFits
GPU server 512 GB to 1.5 TB · 8x H100, H200 or B200 node FitsFitsFits
Multi-node cluster over 1.5 TB · Several GPU servers working together FitsFitsFits

These are estimates for planning, not guarantees. Always check the developer’s own guidance.

How the estimate works

Weights take parameters times bytes per parameter: 2 bytes at BF16, 1 at FP8 or INT8, about 0.6 at 4-bit (Q4). We add 15% for runtime buffers and a modest context cache. Long contexts need more, because the key-value cache grows with every token. For mixture-of-experts models all experts must be loaded, so use total parameters, not active ones.

Read the guide to memory and quantization

All open-source AI models

Model Parameters BF16 FP8 / INT8 4-bit
Nex-N2.6 Nex-N2.5-mini 35.1B 81 GB 40 GB 24 GB
Nex-N2.6 Nex-N2.6 (FP8) 321B 739 GB 370 GB 222 GB
Nex-N2.6 Nex-N2.5-Pro (FP8) 397B 913 GB 456 GB 274 GB
Nex-N2.6 Nex-N2.5-Max (FP8) 1.6T 3.68 TB 1.84 TB 1.1 TB
LongCat-2.5 LongCat-2.5 1.6T 3.68 TB 1.84 TB 1.1 TB
LongCat-2.5 LongCat-2.5-W4A4 1.6T 3.68 TB 1.84 TB 1.47 TB
Arete-27B 27B 27.4B 63 GB 31 GB 19 GB
Mirage Mirage (2-bit Cactus Quants, .cact file) 51M 0.118 GB 0.059 GB 0.0354 GB
Mirage Mirage (FP32 checkpoint) 51M 0.118 GB 0.059 GB 0.0354 GB
ERNIE 5.5 Flash Base ERNIE-5.5-Flash-Base (FP8) 280B 644 GB 322 GB 193 GB
ERNIE 5.5 Flash Base ERNIE-5.5-Flash-Base-BF16 280B 644 GB 322 GB 193 GB
PLaMo 3 Translate PLaMo 3 Translate 0.8B 890M 2.05 GB 1.02 GB 0.614 GB
PLaMo 3 Translate PLaMo 3 Translate 0.8B (GGUF Q4_K_M) 890M 2.05 GB 1.02 GB 0.627 GB
PLaMo 3 Translate PLaMo 3 Translate 2B 2.88B 6.62 GB 3.31 GB 1.99 GB
PLaMo 3 Translate PLaMo 3 Translate 2B (GGUF Q4_K_M) 2.88B 6.62 GB 3.31 GB 1.99 GB
PLaMo 3 Translate PLaMo 3 Translate 8B 8.53B 20 GB 9.81 GB 5.89 GB
PLaMo 3 Translate PLaMo 3 Translate 8B (GGUF Q4_K_M) 8.53B 20 GB 9.81 GB 5.81 GB
PLaMo 3 Translate PLaMo 3 Translate 31B 31.8B 73 GB 37 GB 22 GB
PLaMo 3 Translate PLaMo 3 Translate 31B (NVFP4) 31.8B 73 GB 37 GB 21 GB
Ripple-65B Preview Ripple-65B Preview 64.8B 149 GB 75 GB 45 GB
Ripple-65B Preview Ripple-65B Preview NVFP4 (experimental) 64.8B 149 GB 75 GB 63 GB
Ripple-65B Preview Ripple-65B Base Preview 64.8B 149 GB 75 GB 45 GB
Sarvam Prism Sarvam Prism (custom FP8) 105B 241 GB 121 GB 120 GB
Hydrogen-1.0 Hydrogen-1.0 (BF16) 753B 1.73 TB 866 GB 520 GB
Hydrogen-1.0 Hydrogen-1.0-NVFP4 753B 1.73 TB 866 GB 510 GB
Hydrogen-1.0 Hydrogen-1.0-MXFP4 753B 1.73 TB 866 GB 465 GB
Kimi K3.1 Pro K3.1 Pro 2.8T 6.44 TB 3.22 TB 1.72 TB
S5-nano S5-nano 4.66B 11 GB 5.36 GB 3.22 GB
S5-nano S5-nano FP8 4.66B 11 GB 5.36 GB 3.22 GB
S5-nano S5-nano Q4_K_M (GGUF) 4.66B 11 GB 5.36 GB 3.08 GB
Raon-1 nano Raon-1-nano (BF16) 3.1B 7.13 GB 3.56 GB 2.14 GB
Raon-1 nano GGUF Q8_0 3.1B 7.13 GB 3.56 GB 2.14 GB
Raon-1 nano GGUF Q4_K_M 3.1B 7.13 GB 3.56 GB 2.31 GB
Raon-1 nano MLX (4-bit GPTQ) 3.1B 7.13 GB 3.56 GB 1.98 GB
Raon-1 nano LiteRT-LM bundle (4-bit) 3.1B 7.13 GB 3.56 GB 1.98 GB
Mage-VL-Cowork Mage-VL-Cowork (4B) 4.74B 11 GB 5.45 GB 3.27 GB
SenseNova-Loop-9B-Preview SenseNova-Loop-9B-Preview 9.66B 22 GB 11 GB 22 GB
Mistral Large 4 Large 4 1.05T 2.42 TB 1.21 TB 725 GB
Mistral Large 4 Large 4 NVFP4 1.05T 2.42 TB 1.21 TB 671 GB
LFM3 LFM3-1.7B 1.73B 3.98 GB 1.99 GB 1.19 GB
LFM3 LFM3-1.7B-Base 1.73B 3.98 GB 1.99 GB 1.19 GB
LFM3 LFM3-VL-2B 1.92B 4.42 GB 2.21 GB 1.32 GB
LFM3 LFM3-Omni-2B 2.17B 4.99 GB 2.5 GB 1.5 GB
MiniCPM-OCR 1.0 MiniCPM-OCR 1.0 1.3B 2.99 GB 1.49 GB 0.897 GB
Smaug-Decisions Smaug-Audio-Decisions-0.7B 740M 1.7 GB 0.851 GB 0.511 GB
Smaug-Decisions Smaug-Decisions 8.61B 20 GB 9.9 GB 5.94 GB
Smaug-Decisions Smaug-Decisions-LiteRT 8.61B 20 GB 9.9 GB 5.94 GB
Nanbeige4.3-33B Nanbeige4.3-33B 33.1B 76 GB 38 GB 23 GB
Nanbeige4.3-33B Nanbeige4.3-33B-FP8 33.1B 76 GB 38 GB 23 GB
Nanbeige4.3-33B Nanbeige4.3-33B-INT8 33.1B 76 GB 38 GB 23 GB
Nanbeige4.3-33B Nanbeige4.3-33B-INT4 (quantization-aware training) 33.1B 76 GB 38 GB 25 GB
Nanbeige4.3-33B Nanbeige4.3-33B-Base 33.1B 76 GB 38 GB 23 GB
Raon-1 mini preview Raon-1-mini-preview (MXFP8) 28.8B 66 GB 33 GB 20 GB
Raon-1 mini preview Raon-1-mini-preview-NVFP4 28.8B 66 GB 33 GB 19 GB
Raon-1 mini preview GGUF IQ4_XS 28.8B 66 GB 33 GB 18 GB
Raon-1 mini preview GGUF Q4_K_M 28.8B 66 GB 33 GB 22 GB
Raon-1 mini preview GGUF Q8_0 28.8B 66 GB 33 GB 20 GB
Spark-X2.6 Spark-X2.6-1.7B 1.71B 3.93 GB 1.97 GB 1.18 GB
Spark-X2.6 Spark-X2.6-1.7B INT4 1.71B 3.93 GB 1.97 GB 1.88 GB
Spark-X2.6 Spark-X2.6-4B 4.11B 9.45 GB 4.73 GB 2.84 GB
Spark-X2.6 Spark-X2.6-4B INT4 4.11B 9.45 GB 4.73 GB 3.75 GB
Flint Flint (BF16) 39.8B 92 GB 46 GB 48 GB
Flint Flint INT4 (MLX, Apple silicon) 39.8B 92 GB 46 GB 48 GB
Flint Flint INT4 GGUF (Q4_1, Metal) 39.8B 92 GB 46 GB 48 GB
Flint Flint NVFP4 GGUF (NVIDIA CUDA) 39.8B 92 GB 46 GB 48 GB
MiniMax M3.1 Flash M3.1 Flash 428B 984 GB 492 GB 277 GB
Nemotron 3.5 Parse Nemotron 3.5 Parse 631M 1.45 GB 0.726 GB 0.435 GB
Dory 1.0 Dory1.0-4B (BF16) 4B 9.2 GB 4.6 GB 2.76 GB
Dory 1.0 Dory1.0-4B (MXFP8) 4B 9.2 GB 4.6 GB 2.76 GB
Dory 1.0 Dory1.0-4B (NVFP4) 4B 9.2 GB 4.6 GB 3.52 GB
Reflection Beam Beam 1.0 501B 1.15 TB 576 GB 346 GB
Reflection Beam Beam 1.0 FP8 501B 1.15 TB 576 GB 346 GB
Reflection Beam Beam 1.0 NVFP4 501B 1.15 TB 576 GB 323 GB
Hy-Memory Hy-Memory-30B-A3B 30.1B 69 GB 35 GB 21 GB
Hy-Memory Hy-Memory-30B-A3B-FP8 30.1B 69 GB 35 GB 21 GB
Hy-Memory Hy-Memory-30B-A3B (Q4_K_M GGUF) 30.1B 69 GB 35 GB 20 GB
Jais 3 0.9B (BF16) 1.08B 2.48 GB 1.24 GB 0.745 GB
Jais 3 3.7B (BF16) 5.06B 12 GB 5.82 GB 3.49 GB
Jais 3 7B (BF16) 9B 21 GB 10 GB 6.21 GB
Jais 3 7B GGUF Q4_K_M 9B 21 GB 10 GB 6.16 GB
Jais 3 32B (BF16) 34.8B 80 GB 40 GB 24 GB
Jais 3 MoVA-36B-A4B (BF16) 37.4B 86 GB 43 GB 26 GB
Jais 3 MoVA-36B-A4B GGUF Q4_K_M 37.4B 86 GB 43 GB 25 GB
Jais 3 375B-A23B (BF16) 379B 872 GB 436 GB 262 GB
Jais 3 375B-A23B (FP8) 379B 872 GB 436 GB 262 GB
MemT-1.0 MemT-1.0-Nano 35.1B 81 GB 40 GB 24 GB
MemT-1.0 MemT-1.0-Flash 288B 662 GB 331 GB 199 GB
Muse Spark Open Spark Open 816B 1.88 TB 938 GB 563 GB
Muse Spark Open Spark Open NVFP4 816B 1.88 TB 938 GB 586 GB
Nemotron 3.5 Bolt E4B 8B 18 GB 9.2 GB 5.52 GB
Nemotron 3.5 Bolt 74B-A9B 74B 170 GB 85 GB 51 GB
Nemotron 3.5 Bolt 74B-A9B 24GB 74B 170 GB 85 GB 24 GB
Nemotron 3.5 Super VL 120B 276 GB 138 GB 83 GB
Nemotron 3.5 Super VL NVFP4 120B 276 GB 138 GB 83 GB
Sage-A1.5 Agents-A1-4B 4.54B 10 GB 5.22 GB 3.13 GB
Sage-A1.5 Agents-A1-4B (Q4_K_M GGUF) 4.54B 10 GB 5.22 GB 2.98 GB
Sage-A1.5 Agents-A1 35.1B 81 GB 40 GB 24 GB
Sage-A1.5 Sage-A1.5 36B 83 GB 41 GB 25 GB
Sage-A1.5 Sage-A1.5 (Q8_0 GGUF) 36B 83 GB 41 GB 25 GB
Sage-A1.5 Sage-A1.5 (Q4_K_M GGUF) 36B 83 GB 41 GB 24 GB
Step 5 Preview Step-5-Preview (FP8) 604B 1.39 TB 695 GB 417 GB
Step 5 Preview Step-5-Preview-BF16 604B 1.39 TB 695 GB 417 GB
Step 5 Preview Step-5-Preview-NVFP4 604B 1.39 TB 695 GB 434 GB
TwIL TwIL-LM3 3.08B 7.08 GB 3.54 GB 2.13 GB
TwIL TwIL-LM3 (Q4_K_M GGUF) 3.08B 7.08 GB 3.54 GB 2.11 GB
TwIL TwIL-LM3-Pro 3.66B 8.42 GB 4.21 GB 2.53 GB
TwIL TwIL-LM3-Pro (Q4_K_M GGUF) 3.66B 8.42 GB 4.21 GB 2.46 GB
TwIL TwIL-8B (balanced) 8.79B 20 GB 10 GB 6.07 GB
TwIL TwIL-8B (balanced, Q4_K_M GGUF) 8.79B 20 GB 10 GB 5.88 GB
LFM2.5-24B-A2B LFM2.5-24B-A2B 24B 55 GB 28 GB 17 GB
LFM2.5-24B-A2B LFM2.5-24B-A2B FP8 24B 55 GB 28 GB 17 GB
Ling-3.1-flash Ling-3.1-flash-1019 560B 1.29 TB 644 GB 386 GB
Ling-3.1-flash Ling-3.1-flash 560B 1.29 TB 644 GB 386 GB
Ling-3.1-flash Ling-3.1-flash-base 560B 1.29 TB 644 GB 386 GB
MiniCPM-V 4.7 1B 1.55B 3.56 GB 1.78 GB 1.07 GB
MiniCPM-V 4.7 35B-A3B 35.2B 81 GB 40 GB 24 GB
MiniCPM-V 4.7 35B-A3B int4 35.2B 81 GB 40 GB 25 GB
LightOnOCR-3 LightOnOCR-3-0.8B 853M 1.96 GB 0.981 GB 0.589 GB
LightOnOCR-3 LightOnOCR-3-1B 1.01B 2.32 GB 1.16 GB 0.697 GB
LightOnOCR-3 LightOnOCR-3-4B 4.54B 10 GB 5.22 GB 3.13 GB
Mellum2.1 Mellum2.1 Thinking 12.2B 28 GB 14 GB 8.38 GB
Mellum2.1 Mellum2.1 Thinking GGUF Q4_K_M 12.2B 28 GB 14 GB 8.91 GB
Mellum2.1 Mellum2.1 Thinking GGUF MXFP4_MOE 12.2B 28 GB 14 GB 7.7 GB
Mellum2.1 Mellum2 Instruct (June 2026) 12.2B 28 GB 14 GB 8.38 GB
Mellum2.1 Mellum2 Base (June 2026) 12.2B 28 GB 14 GB 8.38 GB
Liquid d1 d1-omni-600M 587M 1.35 GB 0.675 GB 0.405 GB
Liquid d1 d1-2B 1.92B 4.42 GB 2.21 GB 1.32 GB
Liquid d1 d1-Omni-2B 2.17B 4.99 GB 2.5 GB 1.5 GB
Liquid d1 d1-3B 3.12B 7.18 GB 3.59 GB 2.15 GB
Kolibri 1 Kolibri 1 FP8 78B 179 GB 90 GB 54 GB
Kolibri 1 Kolibri 1 BF16 78B 179 GB 90 GB 54 GB
Clef Clef-flash (9B, lowest latency) 9.41B 22 GB 11 GB 6.49 GB
Clef Clef (27B, precision decisions) 27.4B 63 GB 31 GB 19 GB
pplx-decider pplx-decider flash v1.2 (4B) 4.54B 10 GB 5.22 GB 3.13 GB
pplx-decider pplx-decider flash v1.2 GGUF (Q8_0) 4.54B 10 GB 5.22 GB 3.13 GB
pplx-decider pplx-decider v1.2 (27B) 26.1B 60 GB 30 GB 18 GB
pplx-decider pplx-decider v1.1 (27B, one question per pass) 26.1B 60 GB 30 GB 18 GB
Xiaomi-OCR-0 Xiaomi-OCR-0 873M 2.01 GB 1 GB 0.602 GB
AREX-2 AREX-2 (27B) 27.4B 63 GB 32 GB 19 GB
AutoTrust Decider Decider Mini 9B (JEV-9B) 8.95B 21 GB 10 GB 6.18 GB
AutoTrust Decider GEV-26B-Decide (Gemma 4) 25.8B 59 GB 30 GB 80 GB
AutoTrust Decider GEV-26B-Decide NVFP4 25.8B 59 GB 30 GB 21 GB
AutoTrust Decider Decider Pro 27B (JEV-27B) 26.9B 62 GB 31 GB 19 GB
AutoTrust Decider Decider Pro Vision 27B v1.1 (text decisions) 27.4B 63 GB 31 GB 19 GB
AutoTrust Decider Decider Pro Vision 27B (JEV-27B-VL) 27.8B 64 GB 32 GB 80 GB
AutoTrust Decider Decider Pro 35B (JEV-35B) 36B 83 GB 41 GB 80 GB
AutoTrust Decider Decider Pro 35B NVFP4 36B 83 GB 41 GB 32 GB
MiMo-V2.6 V2.6 Distill Qwen 9B 9.4B 22 GB 11 GB 6.49 GB
MiMo-V2.6 V2.6 Flash 310B 713 GB 357 GB 196 GB
MiMo-V2.6 V2.6 Pro 1.02T 2.35 TB 1.17 TB 630 GB
Ternary Bonsai 2 Ternary Bonsai 2 2B 2.21B 5.08 GB 2.54 GB 0.473 GB
Ternary Bonsai 2 Ternary Bonsai 2 4B 4.54B 10 GB 5.22 GB 1.04 GB
Ternary Bonsai 2 Ternary Bonsai 2 9B 9.41B 22 GB 11 GB 2.2 GB
Ternary Bonsai 2 Ternary Bonsai 2 27B 27.4B 63 GB 31 GB 6.55 GB
DeepSeek V4.1 Flash V4.1-Flash-1017 552B 1.27 TB 635 GB 562 GB
DeepSeek V4.1 Flash V4.1-Flash 552B 1.27 TB 635 GB 561 GB
MiniCPM5-2B MiniCPM5-1B 1.08B 2.48 GB 1.24 GB 0.745 GB
MiniCPM5-2B MiniCPM5-2B 2.52B 5.8 GB 2.9 GB 1.74 GB
K2 Horizon 0.9B (BF16) 1.08B 2.48 GB 1.24 GB 0.745 GB
K2 Horizon 3.7B (BF16) 5.06B 12 GB 5.82 GB 3.49 GB
K2 Horizon 7B (BF16) 9B 21 GB 10 GB 6.21 GB
K2 Horizon 7B GGUF Q4_K_M 9B 21 GB 10 GB 6.16 GB
K2 Horizon 32B (BF16) 34.8B 80 GB 40 GB 24 GB
K2 Horizon MoVA-36B-A4B (BF16) 37.4B 86 GB 43 GB 26 GB
K2 Horizon MoVA-36B-A4B GGUF Q4_K_M 37.4B 86 GB 43 GB 25 GB
K2 Horizon 375B-A23B (BF16) 379B 872 GB 436 GB 262 GB
K2 Horizon 375B-A23B (FP8) 379B 872 GB 436 GB 262 GB
Index-Translate Index-Translate-2B 2.27B 5.22 GB 2.61 GB 1.57 GB
Index-Translate Index-Translate-2B (GGUF Q4_K_M) 2.27B 5.22 GB 2.61 GB 1.44 GB
Index-Translate Index-Translate-9B 9.65B 22 GB 11 GB 6.66 GB
Index-Translate Index-Translate-9B (GGUF Q4_K_M) 9.65B 22 GB 11 GB 6.36 GB
Index-Translate Index-Translate-35B-A3B (preview, MoE) 36B 83 GB 41 GB 25 GB
Needle 3 Needle 3 (20 layers, FP16 checkpoint) 121M 0.278 GB 0.139 GB 0.0835 GB
GLM-5.3 GLM-5.3 753B 1.73 TB 866 GB 520 GB
Hy4 preview Hy4 preview (BF16) 770B 1.77 TB 885 GB 531 GB
Hy4 preview Hy4 preview-FP8 770B 1.77 TB 885 GB 531 GB
GLM-5.3-Flash GLM-5.3-Flash 320B 736 GB 368 GB 221 GB
Qwen3.8-Flash-Next Flash-Next 180B 414 GB 207 GB 124 GB
Qwen3.8-Flash-Next Flash-Next FP8 180B 414 GB 207 GB 124 GB
Granite 4.2 3B 3.7B 8.51 GB 4.25 GB 2.55 GB
Granite 4.2 8B 8.8B 20 GB 10 GB 6.07 GB
Granite 4.2 30B 29.3B 67 GB 34 GB 20 GB
Granite 4.2 30B MXFP4 29.3B 67 GB 34 GB 19 GB
Ornith 1.5 Ornith-1.5-9B 9.65B 22 GB 11 GB 6.66 GB
Ornith 1.5 Ornith-1.5-9B (NVFP4) 9.65B 22 GB 11 GB 9.7 GB
Ornith 1.5 Ornith-1.5-35B-A3B 36B 83 GB 41 GB 25 GB
Ornith 1.5 Ornith-1.5-35B-A3B (FP8) 36B 83 GB 41 GB 25 GB
Ornith 1.5 Ornith-1.5-35B-A3B (NVFP4) 36B 83 GB 41 GB 26 GB
Ornith 1.5 Ornith-1.5-122B 125B 288 GB 144 GB 86 GB
Ornith 1.5 Ornith-1.5-122B (NVFP4) 125B 288 GB 144 GB 85 GB
Ornith 1.5 Ornith-1.5-397B 403B 928 GB 464 GB 278 GB
Ornith 1.5 Ornith-1.5-397B (FP8) 403B 928 GB 464 GB 278 GB
Qwen3.8-27B 27B 27.8B 64 GB 32 GB 19 GB
Qwen3.8-27B 27B FP8 27.8B 64 GB 32 GB 19 GB
Qwen3.8-Max 2.4T-A95B 2.45T 5.63 TB 2.81 TB 1.69 TB
Qwen3.8-Max 2.4T-A95B FP8 2.45T 5.63 TB 2.81 TB 1.69 TB
Nemotron 3.5 Lightning Lightning 30B-A3B (NVFP4) 31.6B 73 GB 36 GB 24 GB
Nemotron 3.5 Lightning Lightning 30B-A3B (BF16) 31.6B 73 GB 36 GB 22 GB
Muse Glimmer Glimmer 30B 29.6B 68 GB 34 GB 20 GB
Muse Glimmer Glimmer 30B GGUF (17 GB K-quant) 29.6B 68 GB 34 GB 24 GB
Motif 3 Motif 3 (BF16) 314B 722 GB 361 GB 217 GB
Motif 3 Motif 3 NVFP4 314B 722 GB 361 GB 206 GB
K-EXAONE 2.0 K-EXAONE-2.0 (BF16) 750B 1.72 TB 862 GB 518 GB
K-EXAONE 2.0 K-EXAONE-2.0-FP8 750B 1.72 TB 862 GB 518 GB
K-EXAONE 2.0 K-EXAONE-2.0-NVFP4 750B 1.72 TB 862 GB 579 GB
A.X K2 A.X K2 (FP8) 688B 1.58 TB 791 GB 475 GB
A.X K2 A.X K2 NVFP4 688B 1.58 TB 791 GB 438 GB
Kimi K3 K3 2.8T 6.44 TB 3.22 TB 1.72 TB
Mage-VL Mage-VL (4B) 4.74B 11 GB 5.45 GB 3.27 GB
Apertus 1.5 Apertus 1.5 8B 8B 18 GB 9.2 GB 5.52 GB
Apertus 1.5 Apertus 1.5 70B 70B 161 GB 81 GB 48 GB
Solar Open 2 Solar Open 2 (BF16) 250B 575 GB 288 GB 173 GB
Solar Open 2 Solar Open 2 Nota NVFP4 250B 575 GB 288 GB 168 GB
Solar Open 2 Solar Open 2 Nota INT4 250B 575 GB 288 GB 157 GB
Laguna S 2.1 Laguna-S-2.1 (BF16) 118B 270 GB 135 GB 81 GB
Laguna S 2.1 Laguna-S-2.1-FP8 118B 270 GB 135 GB 81 GB
Laguna S 2.1 Laguna-S-2.1-NVFP4 118B 270 GB 135 GB 110 GB
Laguna S 2.1 Laguna-S-2.1-INT4 118B 270 GB 135 GB 110 GB
Laguna S 2.1 GGUF Q4_K_M 118B 270 GB 135 GB 106 GB
Nanbeige4.2-3B Nanbeige4.2-3B 4.17B 9.59 GB 4.8 GB 2.88 GB
Nanbeige4.2-3B Nanbeige4.2-3B-FP8 4.17B 9.59 GB 4.8 GB 2.88 GB
Nanbeige4.2-3B Nanbeige4.2-3B-GPTQ-Int8 4.17B 9.59 GB 4.8 GB 2.88 GB
Nanbeige4.2-3B Nanbeige4.2-3B-Base 4.17B 9.59 GB 4.8 GB 2.88 GB
Inkling Inkling-Small 276B 635 GB 317 GB 190 GB
Inkling Inkling-Small NVFP4 276B 635 GB 317 GB 188 GB
Inkling Inkling 975B 2.24 TB 1.12 TB 673 GB
Inkling Inkling NVFP4 975B 2.24 TB 1.12 TB 653 GB
HunyuanOCR HunyuanOCR-1.5 1.12B 2.58 GB 1.29 GB 0.773 GB
GigaChat 3.5 Ultra Instruct FP8 434B 998 GB 499 GB 299 GB
GigaChat 3.5 Ultra Instruct BF16 434B 998 GB 499 GB 299 GB
GigaChat 3.5 Ultra Reasoning FP8 438B 1.01 TB 504 GB 302 GB
Hy3 Hy3 (BF16) 295B 679 GB 339 GB 204 GB
Hy3 Hy3-FP8 295B 679 GB 339 GB 204 GB
Laguna XS 2.1 Laguna-XS-2.1 (BF16) 33.4B 77 GB 38 GB 23 GB
Laguna XS 2.1 Laguna-XS-2.1-FP8 33.4B 77 GB 38 GB 23 GB
Laguna XS 2.1 Laguna-XS-2.1-NVFP4 33.4B 77 GB 38 GB 24 GB
Laguna XS 2.1 Laguna-XS-2.1-INT4 33.4B 77 GB 38 GB 26 GB
Laguna XS 2.1 GGUF Q4_K_M 33.4B 77 GB 38 GB 22 GB
Unlimited-OCR Unlimited-OCR-2 3.34B 7.68 GB 3.84 GB 2.3 GB
Unlimited-OCR Unlimited-OCR 3.34B 7.68 GB 3.84 GB 2.3 GB
Laguna M.1 Laguna-M.1 (BF16) 226B 519 GB 260 GB 156 GB
Laguna M.1 Laguna-M.1-FP8 226B 519 GB 260 GB 156 GB
Laguna M.1 Laguna-M.1-NVFP4 226B 519 GB 260 GB 153 GB
GLM-5.2 GLM-5.2 (BF16) 753B 1.73 TB 866 GB 520 GB
GLM-5.2 GLM-5.2-FP8 753B 1.73 TB 866 GB 520 GB
Kimi K2.7 Code K2.7 Code (INT4) 1.03T 2.36 TB 1.18 TB 655 GB
DiffusionGemma 26B A4B 25.2B 58 GB 29 GB 17 GB
Nemotron 3 Ultra Ultra 550B-A55B (BF16) 550B 1.26 TB 633 GB 379 GB
Nemotron 3 Ultra Ultra 550B-A55B (NVFP4) 550B 1.26 TB 633 GB 387 GB
MiniMax M3 M3 (BF16) 428B 984 GB 492 GB 295 GB
MiniMax M3 M3 MXFP8 428B 984 GB 492 GB 295 GB
Ornith 1.0 Ornith-1.0-9B 9.41B 22 GB 11 GB 6.49 GB
Ornith 1.0 Ornith-1.0-35B 35.1B 81 GB 40 GB 24 GB
Ornith 1.0 Ornith-1.0-35B (FP8) 35.1B 81 GB 40 GB 24 GB
Ornith 1.0 Ornith-1.0-397B 397B 913 GB 456 GB 274 GB
Ornith 1.0 Ornith-1.0-397B (FP8) 397B 913 GB 456 GB 274 GB
Step 3.7 Flash Step-3.7-Flash (BF16) 201B 463 GB 232 GB 139 GB
Step 3.7 Flash Step-3.7-Flash-FP8 201B 463 GB 232 GB 139 GB
Step 3.7 Flash Step-3.7-Flash-NVFP4 201B 463 GB 232 GB 142 GB
Step 3.7 Flash GGUF Q4_K_S 201B 463 GB 232 GB 120 GB
PaddleOCR-VL PaddleOCR-VL-1.6 960M 2.21 GB 1.1 GB 0.662 GB
Surya OCR 2 Surya OCR 2 690M 1.59 GB 0.793 GB 0.476 GB
LocateAnything-3B LocateAnything-3B 3.83B 8.81 GB 4.4 GB 2.64 GB
Hy-MT2 Hy-MT2-1.8B 2.04B 4.69 GB 2.35 GB 1.41 GB
Hy-MT2 Hy-MT2-7B 8.03B 18 GB 9.23 GB 5.54 GB
Hy-MT2 Hy-MT2-30B-A3B (MoE) 30.1B 69 GB 35 GB 21 GB
Hy-MT2 Hy-MT2-30B-A3B-FP8 30.1B 69 GB 35 GB 21 GB
Command A+ Command A+ BF16 218B 501 GB 251 GB 150 GB
Command A+ Command A+ FP8 218B 501 GB 251 GB 150 GB
Command A+ Command A+ W4A4 218B 501 GB 251 GB 145 GB
NuExtract3 NuExtract3 (BF16) 4.54B 10 GB 5.22 GB 3.13 GB
NuExtract3 NuExtract3-FP8 4.54B 10 GB 5.22 GB 3.13 GB
NuExtract3 NuExtract3-W4A16 4.54B 10 GB 5.22 GB 6.07 GB
NuExtract3 NuExtract3-Q4_K_M (GGUF) 4.54B 10 GB 5.22 GB 3.06 GB
Laguna XS.2 Laguna-XS.2 (BF16) 33.4B 77 GB 38 GB 23 GB
Laguna XS.2 Laguna-XS.2-FP8 33.4B 77 GB 38 GB 23 GB
Laguna XS.2 Laguna-XS.2-NVFP4 33.4B 77 GB 38 GB 24 GB
Laguna XS.2 Laguna-XS.2-INT4 33.4B 77 GB 38 GB 26 GB
Nemotron 3 Nano Omni Nano Omni 30B-A3B (BF16) 31B 71 GB 36 GB 80 GB
Nemotron 3 Nano Omni Nano Omni 30B-A3B (FP8) 31B 71 GB 36 GB 48 GB
Nemotron 3 Nano Omni Nano Omni 30B-A3B (NVFP4) 31B 71 GB 36 GB 32 GB
DeepSeek V4 V4-Flash-0731 284B 653 GB 327 GB 184 GB
DeepSeek V4 V4-Flash (preview) 284B 653 GB 327 GB 176 GB
DeepSeek V4 V4-Pro-0813 1.6T 3.68 TB 1.84 TB 982 GB
DeepSeek V4 V4-Pro (preview) 1.6T 3.68 TB 1.84 TB 952 GB
OpenAI Privacy Filter Privacy Filter (BF16) 1.4B 3.22 GB 1.61 GB 0.966 GB
OpenAI Privacy Filter ONNX q4 (Transformers.js with WebGPU) 1.4B 3.22 GB 1.61 GB 0.99 GB
Kimi K2.6 K2.6 (INT4) 1.03T 2.36 TB 1.18 TB 655 GB
Qwen3.6 27B 27.8B 64 GB 32 GB 19 GB
Qwen3.6 27B FP8 27.8B 64 GB 32 GB 19 GB
Qwen3.6 35B-A3B 36B 83 GB 41 GB 25 GB
Qwen3.6 35B-A3B FP8 36B 83 GB 41 GB 25 GB
MiniMax-M2.7 M2.7 (FP8) 229B 526 GB 263 GB 158 GB
GLM-5.1 GLM-5.1 (BF16) 754B 1.73 TB 867 GB 520 GB
GLM-5.1 GLM-5.1-FP8 754B 1.73 TB 867 GB 520 GB
Gemma 4 E2B 5.1B 12 GB 5.86 GB 3.52 GB
Gemma 4 E4B 8B 18 GB 9.2 GB 5.52 GB
Gemma 4 12B Unified 11.9B 27 GB 14 GB 8.25 GB
Gemma 4 26B A4B 25.2B 58 GB 29 GB 17 GB
Gemma 4 31B 30.7B 71 GB 35 GB 21 GB
GigaChat 3.1 Lightning 10B-A1.8B FP8 11.5B 26 GB 13 GB 7.92 GB
GigaChat 3.1 Lightning 10B-A1.8B BF16 11.5B 26 GB 13 GB 7.92 GB
GigaChat 3.1 Lightning 10B-A1.8B GGUF Q4_K_M 11.5B 26 GB 13 GB 7.15 GB
Chandra OCR 2 Chandra OCR 2 5.3B 12 GB 6.09 GB 3.66 GB
Nemotron 3 Nano 4B Nano 4B (BF16) 3.97B 9.13 GB 4.57 GB 2.74 GB
Nemotron 3 Nano 4B Nano 4B (FP8) 3.97B 9.13 GB 4.57 GB 2.74 GB
Nemotron 3 Nano 30B-A3B (BF16) 31.6B 73 GB 36 GB 22 GB
Nemotron 3 Nano 30B-A3B (NVFP4) 31.6B 73 GB 36 GB 21 GB
Nemotron 3 Super 120B-A12B (BF16) 120B 276 GB 138 GB 83 GB
Nemotron 3 Super 120B-A12B (NVFP4) 120B 276 GB 138 GB 88 GB
Sarvam 30B and 105B Sarvam-30B 32.1B 74 GB 37 GB 22 GB
Sarvam 30B and 105B Sarvam-30B FP8 32.1B 74 GB 37 GB 22 GB
Sarvam 30B and 105B Sarvam-30B Q4_K_M (GGUF) 32.1B 74 GB 37 GB 22 GB
Sarvam 30B and 105B Sarvam-105B 106B 244 GB 122 GB 73 GB
Sarvam 30B and 105B Sarvam-105B FP8 106B 244 GB 122 GB 73 GB
Sarvam 30B and 105B Sarvam-105B Q4_K_M (GGUF) 106B 244 GB 122 GB 71 GB
Qwen3.5 0.8B 873M 2.01 GB 1 GB 0.602 GB
Qwen3.5 2B 2.27B 5.23 GB 2.62 GB 1.57 GB
Qwen3.5 4B 4.66B 11 GB 5.36 GB 3.22 GB
Qwen3.5 9B 9.65B 22 GB 11 GB 6.66 GB
Qwen3.5 27B 27.8B 64 GB 32 GB 19 GB
Qwen3.5 35B-A3B 36B 83 GB 41 GB 25 GB
Qwen3.5 122B-A10B 125B 288 GB 144 GB 86 GB
Qwen3.5 397B-A17B 403B 928 GB 464 GB 278 GB
GLM-5 GLM-5 (BF16) 754B 1.73 TB 867 GB 520 GB
GLM-5 GLM-5-FP8 754B 1.73 TB 867 GB 520 GB
MiniMax-M2.5 M2.5 (FP8) 229B 526 GB 263 GB 158 GB
MiniCPM-o 4.5 9B (BF16) 9.37B 22 GB 11 GB 19 GB
MiniCPM-o 4.5 9B AWQ (int4) 9.37B 22 GB 11 GB 11 GB
GLM-OCR GLM-OCR 900M 2.07 GB 1.03 GB 0.621 GB
Step 3.5 Flash Step-3.5-Flash (BF16) 199B 459 GB 229 GB 138 GB
Step 3.5 Flash Step-3.5-Flash-FP8 199B 459 GB 229 GB 138 GB
Step 3.5 Flash GGUF Q4_K_S 199B 459 GB 229 GB 120 GB
DeepSeek-OCR 2 OCR 2 3.39B 7.8 GB 3.9 GB 2.34 GB
Kimi K2.5 K2.5 (INT4) 1.03T 2.36 TB 1.18 TB 655 GB
GLM-4.7-Flash GLM-4.7-Flash (BF16) 31.2B 72 GB 36 GB 22 GB
TranslateGemma TranslateGemma 4B 4.3B 9.89 GB 4.94 GB 2.97 GB
TranslateGemma TranslateGemma 12B 12.2B 28 GB 14 GB 8.41 GB
TranslateGemma TranslateGemma 27B 27.4B 63 GB 32 GB 19 GB
Olmo 3.1 7B Think 7.3B 17 GB 8.39 GB 5.04 GB
Olmo 3.1 7B Instruct 7.3B 17 GB 8.39 GB 5.04 GB
Olmo 3.1 32B Think 32.2B 74 GB 37 GB 22 GB
Olmo 3.1 32B Instruct 32.2B 74 GB 37 GB 22 GB
DeepSeek-V3.2 V3.2 685B 1.58 TB 788 GB 473 GB
DeepSeek-V3.2 V3.2-Speciale 685B 1.58 TB 788 GB 473 GB
DeepSeek-OCR OCR 3.34B 7.68 GB 3.84 GB 2.3 GB
Qwen3-VL 2B 2.13B 4.9 GB 2.45 GB 1.47 GB
Qwen3-VL 4B 4.44B 10 GB 5.11 GB 3.06 GB
Qwen3-VL 8B 8.77B 20 GB 10 GB 6.05 GB
Qwen3-VL 30B-A3B 31.1B 71 GB 36 GB 21 GB
Qwen3-VL 32B 33.4B 77 GB 38 GB 23 GB
Qwen3-VL 235B-A22B 236B 542 GB 271 GB 163 GB
Qwen3-Omni Thinking (thinker only) 31.7B 73 GB 36 GB 69 GB
Qwen3-Omni Captioner (audio descriptions) 31.7B 73 GB 36 GB 22 GB
Qwen3-Omni Instruct (thinker and talker) 35.3B 81 GB 41 GB 79 GB
gpt-oss gpt-oss-20b 21B 48 GB 24 GB 15 GB
gpt-oss gpt-oss-120b 117B 269 GB 135 GB 72 GB
Qwen3 0.6B 752M 1.73 GB 0.865 GB 0.519 GB
Qwen3 1.7B 2.03B 4.67 GB 2.34 GB 1.4 GB
Qwen3 4B 4.02B 9.25 GB 4.63 GB 2.78 GB
Qwen3 8B 8.19B 19 GB 9.42 GB 5.65 GB
Qwen3 14B 14.8B 34 GB 17 GB 10 GB
Qwen3 30B-A3B 30.5B 70 GB 35 GB 21 GB
Qwen3 32B 32.8B 75 GB 38 GB 23 GB
Qwen3 235B-A22B 235B 541 GB 270 GB 162 GB