VRAM calculator
Pick a model or type a parameter count to see how much memory the weights need at different precisions, and what kind of machine that means.
VRAM calculator
Estimated memory (30.7B)
| Precision | Memory | What can run it |
|---|---|---|
| BF16 (full quality) | 71 GB | Workstation |
| FP8 / INT8 (high quality) | 35 GB | Workstation |
| 4-bit (Q4, best for local use) | 21 GB | Gaming GPU |
What can run it
| Hardware | BF16 | FP8 | 4-bit |
|---|---|---|---|
| Laptop or phone up to 16 GB · Typical laptop, phone, 8 to 16 GB graphics card | Does not fit | Does not fit | Does not fit |
| Gaming GPU 16 to 32 GB · RTX 3090, 4090 or 5090, 32 GB Mac | Does not fit | Does not fit | Fits |
| Workstation 32 to 96 GB · RTX PRO 6000 (96 GB), several GPUs | Fits | Fits | Fits |
| Big-memory desktop 96 to 512 GB · Mac Studio, AMD Strix Halo, NVIDIA DGX Spark | Fits | Fits | Fits |
| GPU server 512 GB to 1.5 TB · 8x H100, H200 or B200 node | Fits | Fits | Fits |
| Multi-node cluster over 1.5 TB · Several GPU servers working together | Fits | Fits | Fits |
These are estimates for planning, not guarantees. Always check the developer’s own guidance.
How the estimate works
Weights take parameters times bytes per parameter: 2 bytes at BF16, 1 at FP8 or INT8, about 0.6 at 4-bit (Q4). We add 15% for runtime buffers and a modest context cache. Long contexts need more, because the key-value cache grows with every token. For mixture-of-experts models all experts must be loaded, so use total parameters, not active ones.
All open-source AI models
| Model | Parameters | BF16 | FP8 / INT8 | 4-bit |
|---|---|---|---|---|
| Nex-N2.6 Nex-N2.5-mini | 35.1B | 81 GB | 40 GB | 24 GB |
| Nex-N2.6 Nex-N2.6 (FP8) | 321B | 739 GB | 370 GB | 222 GB |
| Nex-N2.6 Nex-N2.5-Pro (FP8) | 397B | 913 GB | 456 GB | 274 GB |
| Nex-N2.6 Nex-N2.5-Max (FP8) | 1.6T | 3.68 TB | 1.84 TB | 1.1 TB |
| LongCat-2.5 LongCat-2.5 | 1.6T | 3.68 TB | 1.84 TB | 1.1 TB |
| LongCat-2.5 LongCat-2.5-W4A4 | 1.6T | 3.68 TB | 1.84 TB | 1.47 TB |
| Arete-27B 27B | 27.4B | 63 GB | 31 GB | 19 GB |
| Mirage Mirage (2-bit Cactus Quants, .cact file) | 51M | 0.118 GB | 0.059 GB | 0.0354 GB |
| Mirage Mirage (FP32 checkpoint) | 51M | 0.118 GB | 0.059 GB | 0.0354 GB |
| ERNIE 5.5 Flash Base ERNIE-5.5-Flash-Base (FP8) | 280B | 644 GB | 322 GB | 193 GB |
| ERNIE 5.5 Flash Base ERNIE-5.5-Flash-Base-BF16 | 280B | 644 GB | 322 GB | 193 GB |
| PLaMo 3 Translate PLaMo 3 Translate 0.8B | 890M | 2.05 GB | 1.02 GB | 0.614 GB |
| PLaMo 3 Translate PLaMo 3 Translate 0.8B (GGUF Q4_K_M) | 890M | 2.05 GB | 1.02 GB | 0.627 GB |
| PLaMo 3 Translate PLaMo 3 Translate 2B | 2.88B | 6.62 GB | 3.31 GB | 1.99 GB |
| PLaMo 3 Translate PLaMo 3 Translate 2B (GGUF Q4_K_M) | 2.88B | 6.62 GB | 3.31 GB | 1.99 GB |
| PLaMo 3 Translate PLaMo 3 Translate 8B | 8.53B | 20 GB | 9.81 GB | 5.89 GB |
| PLaMo 3 Translate PLaMo 3 Translate 8B (GGUF Q4_K_M) | 8.53B | 20 GB | 9.81 GB | 5.81 GB |
| PLaMo 3 Translate PLaMo 3 Translate 31B | 31.8B | 73 GB | 37 GB | 22 GB |
| PLaMo 3 Translate PLaMo 3 Translate 31B (NVFP4) | 31.8B | 73 GB | 37 GB | 21 GB |
| Ripple-65B Preview Ripple-65B Preview | 64.8B | 149 GB | 75 GB | 45 GB |
| Ripple-65B Preview Ripple-65B Preview NVFP4 (experimental) | 64.8B | 149 GB | 75 GB | 63 GB |
| Ripple-65B Preview Ripple-65B Base Preview | 64.8B | 149 GB | 75 GB | 45 GB |
| Sarvam Prism Sarvam Prism (custom FP8) | 105B | 241 GB | 121 GB | 120 GB |
| Hydrogen-1.0 Hydrogen-1.0 (BF16) | 753B | 1.73 TB | 866 GB | 520 GB |
| Hydrogen-1.0 Hydrogen-1.0-NVFP4 | 753B | 1.73 TB | 866 GB | 510 GB |
| Hydrogen-1.0 Hydrogen-1.0-MXFP4 | 753B | 1.73 TB | 866 GB | 465 GB |
| Kimi K3.1 Pro K3.1 Pro | 2.8T | 6.44 TB | 3.22 TB | 1.72 TB |
| S5-nano S5-nano | 4.66B | 11 GB | 5.36 GB | 3.22 GB |
| S5-nano S5-nano FP8 | 4.66B | 11 GB | 5.36 GB | 3.22 GB |
| S5-nano S5-nano Q4_K_M (GGUF) | 4.66B | 11 GB | 5.36 GB | 3.08 GB |
| Raon-1 nano Raon-1-nano (BF16) | 3.1B | 7.13 GB | 3.56 GB | 2.14 GB |
| Raon-1 nano GGUF Q8_0 | 3.1B | 7.13 GB | 3.56 GB | 2.14 GB |
| Raon-1 nano GGUF Q4_K_M | 3.1B | 7.13 GB | 3.56 GB | 2.31 GB |
| Raon-1 nano MLX (4-bit GPTQ) | 3.1B | 7.13 GB | 3.56 GB | 1.98 GB |
| Raon-1 nano LiteRT-LM bundle (4-bit) | 3.1B | 7.13 GB | 3.56 GB | 1.98 GB |
| Mage-VL-Cowork Mage-VL-Cowork (4B) | 4.74B | 11 GB | 5.45 GB | 3.27 GB |
| SenseNova-Loop-9B-Preview SenseNova-Loop-9B-Preview | 9.66B | 22 GB | 11 GB | 22 GB |
| Mistral Large 4 Large 4 | 1.05T | 2.42 TB | 1.21 TB | 725 GB |
| Mistral Large 4 Large 4 NVFP4 | 1.05T | 2.42 TB | 1.21 TB | 671 GB |
| LFM3 LFM3-1.7B | 1.73B | 3.98 GB | 1.99 GB | 1.19 GB |
| LFM3 LFM3-1.7B-Base | 1.73B | 3.98 GB | 1.99 GB | 1.19 GB |
| LFM3 LFM3-VL-2B | 1.92B | 4.42 GB | 2.21 GB | 1.32 GB |
| LFM3 LFM3-Omni-2B | 2.17B | 4.99 GB | 2.5 GB | 1.5 GB |
| MiniCPM-OCR 1.0 MiniCPM-OCR 1.0 | 1.3B | 2.99 GB | 1.49 GB | 0.897 GB |
| Smaug-Decisions Smaug-Audio-Decisions-0.7B | 740M | 1.7 GB | 0.851 GB | 0.511 GB |
| Smaug-Decisions Smaug-Decisions | 8.61B | 20 GB | 9.9 GB | 5.94 GB |
| Smaug-Decisions Smaug-Decisions-LiteRT | 8.61B | 20 GB | 9.9 GB | 5.94 GB |
| Nanbeige4.3-33B Nanbeige4.3-33B | 33.1B | 76 GB | 38 GB | 23 GB |
| Nanbeige4.3-33B Nanbeige4.3-33B-FP8 | 33.1B | 76 GB | 38 GB | 23 GB |
| Nanbeige4.3-33B Nanbeige4.3-33B-INT8 | 33.1B | 76 GB | 38 GB | 23 GB |
| Nanbeige4.3-33B Nanbeige4.3-33B-INT4 (quantization-aware training) | 33.1B | 76 GB | 38 GB | 25 GB |
| Nanbeige4.3-33B Nanbeige4.3-33B-Base | 33.1B | 76 GB | 38 GB | 23 GB |
| Raon-1 mini preview Raon-1-mini-preview (MXFP8) | 28.8B | 66 GB | 33 GB | 20 GB |
| Raon-1 mini preview Raon-1-mini-preview-NVFP4 | 28.8B | 66 GB | 33 GB | 19 GB |
| Raon-1 mini preview GGUF IQ4_XS | 28.8B | 66 GB | 33 GB | 18 GB |
| Raon-1 mini preview GGUF Q4_K_M | 28.8B | 66 GB | 33 GB | 22 GB |
| Raon-1 mini preview GGUF Q8_0 | 28.8B | 66 GB | 33 GB | 20 GB |
| Spark-X2.6 Spark-X2.6-1.7B | 1.71B | 3.93 GB | 1.97 GB | 1.18 GB |
| Spark-X2.6 Spark-X2.6-1.7B INT4 | 1.71B | 3.93 GB | 1.97 GB | 1.88 GB |
| Spark-X2.6 Spark-X2.6-4B | 4.11B | 9.45 GB | 4.73 GB | 2.84 GB |
| Spark-X2.6 Spark-X2.6-4B INT4 | 4.11B | 9.45 GB | 4.73 GB | 3.75 GB |
| Flint Flint (BF16) | 39.8B | 92 GB | 46 GB | 48 GB |
| Flint Flint INT4 (MLX, Apple silicon) | 39.8B | 92 GB | 46 GB | 48 GB |
| Flint Flint INT4 GGUF (Q4_1, Metal) | 39.8B | 92 GB | 46 GB | 48 GB |
| Flint Flint NVFP4 GGUF (NVIDIA CUDA) | 39.8B | 92 GB | 46 GB | 48 GB |
| MiniMax M3.1 Flash M3.1 Flash | 428B | 984 GB | 492 GB | 277 GB |
| Nemotron 3.5 Parse Nemotron 3.5 Parse | 631M | 1.45 GB | 0.726 GB | 0.435 GB |
| Dory 1.0 Dory1.0-4B (BF16) | 4B | 9.2 GB | 4.6 GB | 2.76 GB |
| Dory 1.0 Dory1.0-4B (MXFP8) | 4B | 9.2 GB | 4.6 GB | 2.76 GB |
| Dory 1.0 Dory1.0-4B (NVFP4) | 4B | 9.2 GB | 4.6 GB | 3.52 GB |
| Reflection Beam Beam 1.0 | 501B | 1.15 TB | 576 GB | 346 GB |
| Reflection Beam Beam 1.0 FP8 | 501B | 1.15 TB | 576 GB | 346 GB |
| Reflection Beam Beam 1.0 NVFP4 | 501B | 1.15 TB | 576 GB | 323 GB |
| Hy-Memory Hy-Memory-30B-A3B | 30.1B | 69 GB | 35 GB | 21 GB |
| Hy-Memory Hy-Memory-30B-A3B-FP8 | 30.1B | 69 GB | 35 GB | 21 GB |
| Hy-Memory Hy-Memory-30B-A3B (Q4_K_M GGUF) | 30.1B | 69 GB | 35 GB | 20 GB |
| Jais 3 0.9B (BF16) | 1.08B | 2.48 GB | 1.24 GB | 0.745 GB |
| Jais 3 3.7B (BF16) | 5.06B | 12 GB | 5.82 GB | 3.49 GB |
| Jais 3 7B (BF16) | 9B | 21 GB | 10 GB | 6.21 GB |
| Jais 3 7B GGUF Q4_K_M | 9B | 21 GB | 10 GB | 6.16 GB |
| Jais 3 32B (BF16) | 34.8B | 80 GB | 40 GB | 24 GB |
| Jais 3 MoVA-36B-A4B (BF16) | 37.4B | 86 GB | 43 GB | 26 GB |
| Jais 3 MoVA-36B-A4B GGUF Q4_K_M | 37.4B | 86 GB | 43 GB | 25 GB |
| Jais 3 375B-A23B (BF16) | 379B | 872 GB | 436 GB | 262 GB |
| Jais 3 375B-A23B (FP8) | 379B | 872 GB | 436 GB | 262 GB |
| MemT-1.0 MemT-1.0-Nano | 35.1B | 81 GB | 40 GB | 24 GB |
| MemT-1.0 MemT-1.0-Flash | 288B | 662 GB | 331 GB | 199 GB |
| Muse Spark Open Spark Open | 816B | 1.88 TB | 938 GB | 563 GB |
| Muse Spark Open Spark Open NVFP4 | 816B | 1.88 TB | 938 GB | 586 GB |
| Nemotron 3.5 Bolt E4B | 8B | 18 GB | 9.2 GB | 5.52 GB |
| Nemotron 3.5 Bolt 74B-A9B | 74B | 170 GB | 85 GB | 51 GB |
| Nemotron 3.5 Bolt 74B-A9B 24GB | 74B | 170 GB | 85 GB | 24 GB |
| Nemotron 3.5 Super VL | 120B | 276 GB | 138 GB | 83 GB |
| Nemotron 3.5 Super VL NVFP4 | 120B | 276 GB | 138 GB | 83 GB |
| Sage-A1.5 Agents-A1-4B | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| Sage-A1.5 Agents-A1-4B (Q4_K_M GGUF) | 4.54B | 10 GB | 5.22 GB | 2.98 GB |
| Sage-A1.5 Agents-A1 | 35.1B | 81 GB | 40 GB | 24 GB |
| Sage-A1.5 Sage-A1.5 | 36B | 83 GB | 41 GB | 25 GB |
| Sage-A1.5 Sage-A1.5 (Q8_0 GGUF) | 36B | 83 GB | 41 GB | 25 GB |
| Sage-A1.5 Sage-A1.5 (Q4_K_M GGUF) | 36B | 83 GB | 41 GB | 24 GB |
| Step 5 Preview Step-5-Preview (FP8) | 604B | 1.39 TB | 695 GB | 417 GB |
| Step 5 Preview Step-5-Preview-BF16 | 604B | 1.39 TB | 695 GB | 417 GB |
| Step 5 Preview Step-5-Preview-NVFP4 | 604B | 1.39 TB | 695 GB | 434 GB |
| TwIL TwIL-LM3 | 3.08B | 7.08 GB | 3.54 GB | 2.13 GB |
| TwIL TwIL-LM3 (Q4_K_M GGUF) | 3.08B | 7.08 GB | 3.54 GB | 2.11 GB |
| TwIL TwIL-LM3-Pro | 3.66B | 8.42 GB | 4.21 GB | 2.53 GB |
| TwIL TwIL-LM3-Pro (Q4_K_M GGUF) | 3.66B | 8.42 GB | 4.21 GB | 2.46 GB |
| TwIL TwIL-8B (balanced) | 8.79B | 20 GB | 10 GB | 6.07 GB |
| TwIL TwIL-8B (balanced, Q4_K_M GGUF) | 8.79B | 20 GB | 10 GB | 5.88 GB |
| LFM2.5-24B-A2B LFM2.5-24B-A2B | 24B | 55 GB | 28 GB | 17 GB |
| LFM2.5-24B-A2B LFM2.5-24B-A2B FP8 | 24B | 55 GB | 28 GB | 17 GB |
| Ling-3.1-flash Ling-3.1-flash-1019 | 560B | 1.29 TB | 644 GB | 386 GB |
| Ling-3.1-flash Ling-3.1-flash | 560B | 1.29 TB | 644 GB | 386 GB |
| Ling-3.1-flash Ling-3.1-flash-base | 560B | 1.29 TB | 644 GB | 386 GB |
| MiniCPM-V 4.7 1B | 1.55B | 3.56 GB | 1.78 GB | 1.07 GB |
| MiniCPM-V 4.7 35B-A3B | 35.2B | 81 GB | 40 GB | 24 GB |
| MiniCPM-V 4.7 35B-A3B int4 | 35.2B | 81 GB | 40 GB | 25 GB |
| LightOnOCR-3 LightOnOCR-3-0.8B | 853M | 1.96 GB | 0.981 GB | 0.589 GB |
| LightOnOCR-3 LightOnOCR-3-1B | 1.01B | 2.32 GB | 1.16 GB | 0.697 GB |
| LightOnOCR-3 LightOnOCR-3-4B | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| Mellum2.1 Mellum2.1 Thinking | 12.2B | 28 GB | 14 GB | 8.38 GB |
| Mellum2.1 Mellum2.1 Thinking GGUF Q4_K_M | 12.2B | 28 GB | 14 GB | 8.91 GB |
| Mellum2.1 Mellum2.1 Thinking GGUF MXFP4_MOE | 12.2B | 28 GB | 14 GB | 7.7 GB |
| Mellum2.1 Mellum2 Instruct (June 2026) | 12.2B | 28 GB | 14 GB | 8.38 GB |
| Mellum2.1 Mellum2 Base (June 2026) | 12.2B | 28 GB | 14 GB | 8.38 GB |
| Liquid d1 d1-omni-600M | 587M | 1.35 GB | 0.675 GB | 0.405 GB |
| Liquid d1 d1-2B | 1.92B | 4.42 GB | 2.21 GB | 1.32 GB |
| Liquid d1 d1-Omni-2B | 2.17B | 4.99 GB | 2.5 GB | 1.5 GB |
| Liquid d1 d1-3B | 3.12B | 7.18 GB | 3.59 GB | 2.15 GB |
| Kolibri 1 Kolibri 1 FP8 | 78B | 179 GB | 90 GB | 54 GB |
| Kolibri 1 Kolibri 1 BF16 | 78B | 179 GB | 90 GB | 54 GB |
| Clef Clef-flash (9B, lowest latency) | 9.41B | 22 GB | 11 GB | 6.49 GB |
| Clef Clef (27B, precision decisions) | 27.4B | 63 GB | 31 GB | 19 GB |
| pplx-decider pplx-decider flash v1.2 (4B) | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| pplx-decider pplx-decider flash v1.2 GGUF (Q8_0) | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| pplx-decider pplx-decider v1.2 (27B) | 26.1B | 60 GB | 30 GB | 18 GB |
| pplx-decider pplx-decider v1.1 (27B, one question per pass) | 26.1B | 60 GB | 30 GB | 18 GB |
| Xiaomi-OCR-0 Xiaomi-OCR-0 | 873M | 2.01 GB | 1 GB | 0.602 GB |
| AREX-2 AREX-2 (27B) | 27.4B | 63 GB | 32 GB | 19 GB |
| AutoTrust Decider Decider Mini 9B (JEV-9B) | 8.95B | 21 GB | 10 GB | 6.18 GB |
| AutoTrust Decider GEV-26B-Decide (Gemma 4) | 25.8B | 59 GB | 30 GB | 80 GB |
| AutoTrust Decider GEV-26B-Decide NVFP4 | 25.8B | 59 GB | 30 GB | 21 GB |
| AutoTrust Decider Decider Pro 27B (JEV-27B) | 26.9B | 62 GB | 31 GB | 19 GB |
| AutoTrust Decider Decider Pro Vision 27B v1.1 (text decisions) | 27.4B | 63 GB | 31 GB | 19 GB |
| AutoTrust Decider Decider Pro Vision 27B (JEV-27B-VL) | 27.8B | 64 GB | 32 GB | 80 GB |
| AutoTrust Decider Decider Pro 35B (JEV-35B) | 36B | 83 GB | 41 GB | 80 GB |
| AutoTrust Decider Decider Pro 35B NVFP4 | 36B | 83 GB | 41 GB | 32 GB |
| MiMo-V2.6 V2.6 Distill Qwen 9B | 9.4B | 22 GB | 11 GB | 6.49 GB |
| MiMo-V2.6 V2.6 Flash | 310B | 713 GB | 357 GB | 196 GB |
| MiMo-V2.6 V2.6 Pro | 1.02T | 2.35 TB | 1.17 TB | 630 GB |
| Ternary Bonsai 2 Ternary Bonsai 2 2B | 2.21B | 5.08 GB | 2.54 GB | 0.473 GB |
| Ternary Bonsai 2 Ternary Bonsai 2 4B | 4.54B | 10 GB | 5.22 GB | 1.04 GB |
| Ternary Bonsai 2 Ternary Bonsai 2 9B | 9.41B | 22 GB | 11 GB | 2.2 GB |
| Ternary Bonsai 2 Ternary Bonsai 2 27B | 27.4B | 63 GB | 31 GB | 6.55 GB |
| DeepSeek V4.1 Flash V4.1-Flash-1017 | 552B | 1.27 TB | 635 GB | 562 GB |
| DeepSeek V4.1 Flash V4.1-Flash | 552B | 1.27 TB | 635 GB | 561 GB |
| MiniCPM5-2B MiniCPM5-1B | 1.08B | 2.48 GB | 1.24 GB | 0.745 GB |
| MiniCPM5-2B MiniCPM5-2B | 2.52B | 5.8 GB | 2.9 GB | 1.74 GB |
| K2 Horizon 0.9B (BF16) | 1.08B | 2.48 GB | 1.24 GB | 0.745 GB |
| K2 Horizon 3.7B (BF16) | 5.06B | 12 GB | 5.82 GB | 3.49 GB |
| K2 Horizon 7B (BF16) | 9B | 21 GB | 10 GB | 6.21 GB |
| K2 Horizon 7B GGUF Q4_K_M | 9B | 21 GB | 10 GB | 6.16 GB |
| K2 Horizon 32B (BF16) | 34.8B | 80 GB | 40 GB | 24 GB |
| K2 Horizon MoVA-36B-A4B (BF16) | 37.4B | 86 GB | 43 GB | 26 GB |
| K2 Horizon MoVA-36B-A4B GGUF Q4_K_M | 37.4B | 86 GB | 43 GB | 25 GB |
| K2 Horizon 375B-A23B (BF16) | 379B | 872 GB | 436 GB | 262 GB |
| K2 Horizon 375B-A23B (FP8) | 379B | 872 GB | 436 GB | 262 GB |
| Index-Translate Index-Translate-2B | 2.27B | 5.22 GB | 2.61 GB | 1.57 GB |
| Index-Translate Index-Translate-2B (GGUF Q4_K_M) | 2.27B | 5.22 GB | 2.61 GB | 1.44 GB |
| Index-Translate Index-Translate-9B | 9.65B | 22 GB | 11 GB | 6.66 GB |
| Index-Translate Index-Translate-9B (GGUF Q4_K_M) | 9.65B | 22 GB | 11 GB | 6.36 GB |
| Index-Translate Index-Translate-35B-A3B (preview, MoE) | 36B | 83 GB | 41 GB | 25 GB |
| Needle 3 Needle 3 (20 layers, FP16 checkpoint) | 121M | 0.278 GB | 0.139 GB | 0.0835 GB |
| GLM-5.3 GLM-5.3 | 753B | 1.73 TB | 866 GB | 520 GB |
| Hy4 preview Hy4 preview (BF16) | 770B | 1.77 TB | 885 GB | 531 GB |
| Hy4 preview Hy4 preview-FP8 | 770B | 1.77 TB | 885 GB | 531 GB |
| GLM-5.3-Flash GLM-5.3-Flash | 320B | 736 GB | 368 GB | 221 GB |
| Qwen3.8-Flash-Next Flash-Next | 180B | 414 GB | 207 GB | 124 GB |
| Qwen3.8-Flash-Next Flash-Next FP8 | 180B | 414 GB | 207 GB | 124 GB |
| Granite 4.2 3B | 3.7B | 8.51 GB | 4.25 GB | 2.55 GB |
| Granite 4.2 8B | 8.8B | 20 GB | 10 GB | 6.07 GB |
| Granite 4.2 30B | 29.3B | 67 GB | 34 GB | 20 GB |
| Granite 4.2 30B MXFP4 | 29.3B | 67 GB | 34 GB | 19 GB |
| Ornith 1.5 Ornith-1.5-9B | 9.65B | 22 GB | 11 GB | 6.66 GB |
| Ornith 1.5 Ornith-1.5-9B (NVFP4) | 9.65B | 22 GB | 11 GB | 9.7 GB |
| Ornith 1.5 Ornith-1.5-35B-A3B | 36B | 83 GB | 41 GB | 25 GB |
| Ornith 1.5 Ornith-1.5-35B-A3B (FP8) | 36B | 83 GB | 41 GB | 25 GB |
| Ornith 1.5 Ornith-1.5-35B-A3B (NVFP4) | 36B | 83 GB | 41 GB | 26 GB |
| Ornith 1.5 Ornith-1.5-122B | 125B | 288 GB | 144 GB | 86 GB |
| Ornith 1.5 Ornith-1.5-122B (NVFP4) | 125B | 288 GB | 144 GB | 85 GB |
| Ornith 1.5 Ornith-1.5-397B | 403B | 928 GB | 464 GB | 278 GB |
| Ornith 1.5 Ornith-1.5-397B (FP8) | 403B | 928 GB | 464 GB | 278 GB |
| Qwen3.8-27B 27B | 27.8B | 64 GB | 32 GB | 19 GB |
| Qwen3.8-27B 27B FP8 | 27.8B | 64 GB | 32 GB | 19 GB |
| Qwen3.8-Max 2.4T-A95B | 2.45T | 5.63 TB | 2.81 TB | 1.69 TB |
| Qwen3.8-Max 2.4T-A95B FP8 | 2.45T | 5.63 TB | 2.81 TB | 1.69 TB |
| Nemotron 3.5 Lightning Lightning 30B-A3B (NVFP4) | 31.6B | 73 GB | 36 GB | 24 GB |
| Nemotron 3.5 Lightning Lightning 30B-A3B (BF16) | 31.6B | 73 GB | 36 GB | 22 GB |
| Muse Glimmer Glimmer 30B | 29.6B | 68 GB | 34 GB | 20 GB |
| Muse Glimmer Glimmer 30B GGUF (17 GB K-quant) | 29.6B | 68 GB | 34 GB | 24 GB |
| Motif 3 Motif 3 (BF16) | 314B | 722 GB | 361 GB | 217 GB |
| Motif 3 Motif 3 NVFP4 | 314B | 722 GB | 361 GB | 206 GB |
| K-EXAONE 2.0 K-EXAONE-2.0 (BF16) | 750B | 1.72 TB | 862 GB | 518 GB |
| K-EXAONE 2.0 K-EXAONE-2.0-FP8 | 750B | 1.72 TB | 862 GB | 518 GB |
| K-EXAONE 2.0 K-EXAONE-2.0-NVFP4 | 750B | 1.72 TB | 862 GB | 579 GB |
| A.X K2 A.X K2 (FP8) | 688B | 1.58 TB | 791 GB | 475 GB |
| A.X K2 A.X K2 NVFP4 | 688B | 1.58 TB | 791 GB | 438 GB |
| Kimi K3 K3 | 2.8T | 6.44 TB | 3.22 TB | 1.72 TB |
| Mage-VL Mage-VL (4B) | 4.74B | 11 GB | 5.45 GB | 3.27 GB |
| Apertus 1.5 Apertus 1.5 8B | 8B | 18 GB | 9.2 GB | 5.52 GB |
| Apertus 1.5 Apertus 1.5 70B | 70B | 161 GB | 81 GB | 48 GB |
| Solar Open 2 Solar Open 2 (BF16) | 250B | 575 GB | 288 GB | 173 GB |
| Solar Open 2 Solar Open 2 Nota NVFP4 | 250B | 575 GB | 288 GB | 168 GB |
| Solar Open 2 Solar Open 2 Nota INT4 | 250B | 575 GB | 288 GB | 157 GB |
| Laguna S 2.1 Laguna-S-2.1 (BF16) | 118B | 270 GB | 135 GB | 81 GB |
| Laguna S 2.1 Laguna-S-2.1-FP8 | 118B | 270 GB | 135 GB | 81 GB |
| Laguna S 2.1 Laguna-S-2.1-NVFP4 | 118B | 270 GB | 135 GB | 110 GB |
| Laguna S 2.1 Laguna-S-2.1-INT4 | 118B | 270 GB | 135 GB | 110 GB |
| Laguna S 2.1 GGUF Q4_K_M | 118B | 270 GB | 135 GB | 106 GB |
| Nanbeige4.2-3B Nanbeige4.2-3B | 4.17B | 9.59 GB | 4.8 GB | 2.88 GB |
| Nanbeige4.2-3B Nanbeige4.2-3B-FP8 | 4.17B | 9.59 GB | 4.8 GB | 2.88 GB |
| Nanbeige4.2-3B Nanbeige4.2-3B-GPTQ-Int8 | 4.17B | 9.59 GB | 4.8 GB | 2.88 GB |
| Nanbeige4.2-3B Nanbeige4.2-3B-Base | 4.17B | 9.59 GB | 4.8 GB | 2.88 GB |
| Inkling Inkling-Small | 276B | 635 GB | 317 GB | 190 GB |
| Inkling Inkling-Small NVFP4 | 276B | 635 GB | 317 GB | 188 GB |
| Inkling Inkling | 975B | 2.24 TB | 1.12 TB | 673 GB |
| Inkling Inkling NVFP4 | 975B | 2.24 TB | 1.12 TB | 653 GB |
| HunyuanOCR HunyuanOCR-1.5 | 1.12B | 2.58 GB | 1.29 GB | 0.773 GB |
| GigaChat 3.5 Ultra Instruct FP8 | 434B | 998 GB | 499 GB | 299 GB |
| GigaChat 3.5 Ultra Instruct BF16 | 434B | 998 GB | 499 GB | 299 GB |
| GigaChat 3.5 Ultra Reasoning FP8 | 438B | 1.01 TB | 504 GB | 302 GB |
| Hy3 Hy3 (BF16) | 295B | 679 GB | 339 GB | 204 GB |
| Hy3 Hy3-FP8 | 295B | 679 GB | 339 GB | 204 GB |
| Laguna XS 2.1 Laguna-XS-2.1 (BF16) | 33.4B | 77 GB | 38 GB | 23 GB |
| Laguna XS 2.1 Laguna-XS-2.1-FP8 | 33.4B | 77 GB | 38 GB | 23 GB |
| Laguna XS 2.1 Laguna-XS-2.1-NVFP4 | 33.4B | 77 GB | 38 GB | 24 GB |
| Laguna XS 2.1 Laguna-XS-2.1-INT4 | 33.4B | 77 GB | 38 GB | 26 GB |
| Laguna XS 2.1 GGUF Q4_K_M | 33.4B | 77 GB | 38 GB | 22 GB |
| Unlimited-OCR Unlimited-OCR-2 | 3.34B | 7.68 GB | 3.84 GB | 2.3 GB |
| Unlimited-OCR Unlimited-OCR | 3.34B | 7.68 GB | 3.84 GB | 2.3 GB |
| Laguna M.1 Laguna-M.1 (BF16) | 226B | 519 GB | 260 GB | 156 GB |
| Laguna M.1 Laguna-M.1-FP8 | 226B | 519 GB | 260 GB | 156 GB |
| Laguna M.1 Laguna-M.1-NVFP4 | 226B | 519 GB | 260 GB | 153 GB |
| GLM-5.2 GLM-5.2 (BF16) | 753B | 1.73 TB | 866 GB | 520 GB |
| GLM-5.2 GLM-5.2-FP8 | 753B | 1.73 TB | 866 GB | 520 GB |
| Kimi K2.7 Code K2.7 Code (INT4) | 1.03T | 2.36 TB | 1.18 TB | 655 GB |
| DiffusionGemma 26B A4B | 25.2B | 58 GB | 29 GB | 17 GB |
| Nemotron 3 Ultra Ultra 550B-A55B (BF16) | 550B | 1.26 TB | 633 GB | 379 GB |
| Nemotron 3 Ultra Ultra 550B-A55B (NVFP4) | 550B | 1.26 TB | 633 GB | 387 GB |
| MiniMax M3 M3 (BF16) | 428B | 984 GB | 492 GB | 295 GB |
| MiniMax M3 M3 MXFP8 | 428B | 984 GB | 492 GB | 295 GB |
| Ornith 1.0 Ornith-1.0-9B | 9.41B | 22 GB | 11 GB | 6.49 GB |
| Ornith 1.0 Ornith-1.0-35B | 35.1B | 81 GB | 40 GB | 24 GB |
| Ornith 1.0 Ornith-1.0-35B (FP8) | 35.1B | 81 GB | 40 GB | 24 GB |
| Ornith 1.0 Ornith-1.0-397B | 397B | 913 GB | 456 GB | 274 GB |
| Ornith 1.0 Ornith-1.0-397B (FP8) | 397B | 913 GB | 456 GB | 274 GB |
| Step 3.7 Flash Step-3.7-Flash (BF16) | 201B | 463 GB | 232 GB | 139 GB |
| Step 3.7 Flash Step-3.7-Flash-FP8 | 201B | 463 GB | 232 GB | 139 GB |
| Step 3.7 Flash Step-3.7-Flash-NVFP4 | 201B | 463 GB | 232 GB | 142 GB |
| Step 3.7 Flash GGUF Q4_K_S | 201B | 463 GB | 232 GB | 120 GB |
| PaddleOCR-VL PaddleOCR-VL-1.6 | 960M | 2.21 GB | 1.1 GB | 0.662 GB |
| Surya OCR 2 Surya OCR 2 | 690M | 1.59 GB | 0.793 GB | 0.476 GB |
| LocateAnything-3B LocateAnything-3B | 3.83B | 8.81 GB | 4.4 GB | 2.64 GB |
| Hy-MT2 Hy-MT2-1.8B | 2.04B | 4.69 GB | 2.35 GB | 1.41 GB |
| Hy-MT2 Hy-MT2-7B | 8.03B | 18 GB | 9.23 GB | 5.54 GB |
| Hy-MT2 Hy-MT2-30B-A3B (MoE) | 30.1B | 69 GB | 35 GB | 21 GB |
| Hy-MT2 Hy-MT2-30B-A3B-FP8 | 30.1B | 69 GB | 35 GB | 21 GB |
| Command A+ Command A+ BF16 | 218B | 501 GB | 251 GB | 150 GB |
| Command A+ Command A+ FP8 | 218B | 501 GB | 251 GB | 150 GB |
| Command A+ Command A+ W4A4 | 218B | 501 GB | 251 GB | 145 GB |
| NuExtract3 NuExtract3 (BF16) | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| NuExtract3 NuExtract3-FP8 | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| NuExtract3 NuExtract3-W4A16 | 4.54B | 10 GB | 5.22 GB | 6.07 GB |
| NuExtract3 NuExtract3-Q4_K_M (GGUF) | 4.54B | 10 GB | 5.22 GB | 3.06 GB |
| Laguna XS.2 Laguna-XS.2 (BF16) | 33.4B | 77 GB | 38 GB | 23 GB |
| Laguna XS.2 Laguna-XS.2-FP8 | 33.4B | 77 GB | 38 GB | 23 GB |
| Laguna XS.2 Laguna-XS.2-NVFP4 | 33.4B | 77 GB | 38 GB | 24 GB |
| Laguna XS.2 Laguna-XS.2-INT4 | 33.4B | 77 GB | 38 GB | 26 GB |
| Nemotron 3 Nano Omni Nano Omni 30B-A3B (BF16) | 31B | 71 GB | 36 GB | 80 GB |
| Nemotron 3 Nano Omni Nano Omni 30B-A3B (FP8) | 31B | 71 GB | 36 GB | 48 GB |
| Nemotron 3 Nano Omni Nano Omni 30B-A3B (NVFP4) | 31B | 71 GB | 36 GB | 32 GB |
| DeepSeek V4 V4-Flash-0731 | 284B | 653 GB | 327 GB | 184 GB |
| DeepSeek V4 V4-Flash (preview) | 284B | 653 GB | 327 GB | 176 GB |
| DeepSeek V4 V4-Pro-0813 | 1.6T | 3.68 TB | 1.84 TB | 982 GB |
| DeepSeek V4 V4-Pro (preview) | 1.6T | 3.68 TB | 1.84 TB | 952 GB |
| OpenAI Privacy Filter Privacy Filter (BF16) | 1.4B | 3.22 GB | 1.61 GB | 0.966 GB |
| OpenAI Privacy Filter ONNX q4 (Transformers.js with WebGPU) | 1.4B | 3.22 GB | 1.61 GB | 0.99 GB |
| Kimi K2.6 K2.6 (INT4) | 1.03T | 2.36 TB | 1.18 TB | 655 GB |
| Qwen3.6 27B | 27.8B | 64 GB | 32 GB | 19 GB |
| Qwen3.6 27B FP8 | 27.8B | 64 GB | 32 GB | 19 GB |
| Qwen3.6 35B-A3B | 36B | 83 GB | 41 GB | 25 GB |
| Qwen3.6 35B-A3B FP8 | 36B | 83 GB | 41 GB | 25 GB |
| MiniMax-M2.7 M2.7 (FP8) | 229B | 526 GB | 263 GB | 158 GB |
| GLM-5.1 GLM-5.1 (BF16) | 754B | 1.73 TB | 867 GB | 520 GB |
| GLM-5.1 GLM-5.1-FP8 | 754B | 1.73 TB | 867 GB | 520 GB |
| Gemma 4 E2B | 5.1B | 12 GB | 5.86 GB | 3.52 GB |
| Gemma 4 E4B | 8B | 18 GB | 9.2 GB | 5.52 GB |
| Gemma 4 12B Unified | 11.9B | 27 GB | 14 GB | 8.25 GB |
| Gemma 4 26B A4B | 25.2B | 58 GB | 29 GB | 17 GB |
| Gemma 4 31B | 30.7B | 71 GB | 35 GB | 21 GB |
| GigaChat 3.1 Lightning 10B-A1.8B FP8 | 11.5B | 26 GB | 13 GB | 7.92 GB |
| GigaChat 3.1 Lightning 10B-A1.8B BF16 | 11.5B | 26 GB | 13 GB | 7.92 GB |
| GigaChat 3.1 Lightning 10B-A1.8B GGUF Q4_K_M | 11.5B | 26 GB | 13 GB | 7.15 GB |
| Chandra OCR 2 Chandra OCR 2 | 5.3B | 12 GB | 6.09 GB | 3.66 GB |
| Nemotron 3 Nano 4B Nano 4B (BF16) | 3.97B | 9.13 GB | 4.57 GB | 2.74 GB |
| Nemotron 3 Nano 4B Nano 4B (FP8) | 3.97B | 9.13 GB | 4.57 GB | 2.74 GB |
| Nemotron 3 Nano 30B-A3B (BF16) | 31.6B | 73 GB | 36 GB | 22 GB |
| Nemotron 3 Nano 30B-A3B (NVFP4) | 31.6B | 73 GB | 36 GB | 21 GB |
| Nemotron 3 Super 120B-A12B (BF16) | 120B | 276 GB | 138 GB | 83 GB |
| Nemotron 3 Super 120B-A12B (NVFP4) | 120B | 276 GB | 138 GB | 88 GB |
| Sarvam 30B and 105B Sarvam-30B | 32.1B | 74 GB | 37 GB | 22 GB |
| Sarvam 30B and 105B Sarvam-30B FP8 | 32.1B | 74 GB | 37 GB | 22 GB |
| Sarvam 30B and 105B Sarvam-30B Q4_K_M (GGUF) | 32.1B | 74 GB | 37 GB | 22 GB |
| Sarvam 30B and 105B Sarvam-105B | 106B | 244 GB | 122 GB | 73 GB |
| Sarvam 30B and 105B Sarvam-105B FP8 | 106B | 244 GB | 122 GB | 73 GB |
| Sarvam 30B and 105B Sarvam-105B Q4_K_M (GGUF) | 106B | 244 GB | 122 GB | 71 GB |
| Qwen3.5 0.8B | 873M | 2.01 GB | 1 GB | 0.602 GB |
| Qwen3.5 2B | 2.27B | 5.23 GB | 2.62 GB | 1.57 GB |
| Qwen3.5 4B | 4.66B | 11 GB | 5.36 GB | 3.22 GB |
| Qwen3.5 9B | 9.65B | 22 GB | 11 GB | 6.66 GB |
| Qwen3.5 27B | 27.8B | 64 GB | 32 GB | 19 GB |
| Qwen3.5 35B-A3B | 36B | 83 GB | 41 GB | 25 GB |
| Qwen3.5 122B-A10B | 125B | 288 GB | 144 GB | 86 GB |
| Qwen3.5 397B-A17B | 403B | 928 GB | 464 GB | 278 GB |
| GLM-5 GLM-5 (BF16) | 754B | 1.73 TB | 867 GB | 520 GB |
| GLM-5 GLM-5-FP8 | 754B | 1.73 TB | 867 GB | 520 GB |
| MiniMax-M2.5 M2.5 (FP8) | 229B | 526 GB | 263 GB | 158 GB |
| MiniCPM-o 4.5 9B (BF16) | 9.37B | 22 GB | 11 GB | 19 GB |
| MiniCPM-o 4.5 9B AWQ (int4) | 9.37B | 22 GB | 11 GB | 11 GB |
| GLM-OCR GLM-OCR | 900M | 2.07 GB | 1.03 GB | 0.621 GB |
| Step 3.5 Flash Step-3.5-Flash (BF16) | 199B | 459 GB | 229 GB | 138 GB |
| Step 3.5 Flash Step-3.5-Flash-FP8 | 199B | 459 GB | 229 GB | 138 GB |
| Step 3.5 Flash GGUF Q4_K_S | 199B | 459 GB | 229 GB | 120 GB |
| DeepSeek-OCR 2 OCR 2 | 3.39B | 7.8 GB | 3.9 GB | 2.34 GB |
| Kimi K2.5 K2.5 (INT4) | 1.03T | 2.36 TB | 1.18 TB | 655 GB |
| GLM-4.7-Flash GLM-4.7-Flash (BF16) | 31.2B | 72 GB | 36 GB | 22 GB |
| TranslateGemma TranslateGemma 4B | 4.3B | 9.89 GB | 4.94 GB | 2.97 GB |
| TranslateGemma TranslateGemma 12B | 12.2B | 28 GB | 14 GB | 8.41 GB |
| TranslateGemma TranslateGemma 27B | 27.4B | 63 GB | 32 GB | 19 GB |
| Olmo 3.1 7B Think | 7.3B | 17 GB | 8.39 GB | 5.04 GB |
| Olmo 3.1 7B Instruct | 7.3B | 17 GB | 8.39 GB | 5.04 GB |
| Olmo 3.1 32B Think | 32.2B | 74 GB | 37 GB | 22 GB |
| Olmo 3.1 32B Instruct | 32.2B | 74 GB | 37 GB | 22 GB |
| DeepSeek-V3.2 V3.2 | 685B | 1.58 TB | 788 GB | 473 GB |
| DeepSeek-V3.2 V3.2-Speciale | 685B | 1.58 TB | 788 GB | 473 GB |
| DeepSeek-OCR OCR | 3.34B | 7.68 GB | 3.84 GB | 2.3 GB |
| Qwen3-VL 2B | 2.13B | 4.9 GB | 2.45 GB | 1.47 GB |
| Qwen3-VL 4B | 4.44B | 10 GB | 5.11 GB | 3.06 GB |
| Qwen3-VL 8B | 8.77B | 20 GB | 10 GB | 6.05 GB |
| Qwen3-VL 30B-A3B | 31.1B | 71 GB | 36 GB | 21 GB |
| Qwen3-VL 32B | 33.4B | 77 GB | 38 GB | 23 GB |
| Qwen3-VL 235B-A22B | 236B | 542 GB | 271 GB | 163 GB |
| Qwen3-Omni Thinking (thinker only) | 31.7B | 73 GB | 36 GB | 69 GB |
| Qwen3-Omni Captioner (audio descriptions) | 31.7B | 73 GB | 36 GB | 22 GB |
| Qwen3-Omni Instruct (thinker and talker) | 35.3B | 81 GB | 41 GB | 79 GB |
| gpt-oss gpt-oss-20b | 21B | 48 GB | 24 GB | 15 GB |
| gpt-oss gpt-oss-120b | 117B | 269 GB | 135 GB | 72 GB |
| Qwen3 0.6B | 752M | 1.73 GB | 0.865 GB | 0.519 GB |
| Qwen3 1.7B | 2.03B | 4.67 GB | 2.34 GB | 1.4 GB |
| Qwen3 4B | 4.02B | 9.25 GB | 4.63 GB | 2.78 GB |
| Qwen3 8B | 8.19B | 19 GB | 9.42 GB | 5.65 GB |
| Qwen3 14B | 14.8B | 34 GB | 17 GB | 10 GB |
| Qwen3 30B-A3B | 30.5B | 70 GB | 35 GB | 21 GB |
| Qwen3 32B | 32.8B | 75 GB | 38 GB | 23 GB |
| Qwen3 235B-A22B | 235B | 541 GB | 270 GB | 162 GB |