Calculateur de VRAM
Choisissez un modèle ou saisissez un nombre de paramètres pour voir la mémoire que les poids demandent aux différentes précisions, et le type de machine que cela suppose.
Calculateur de VRAM
Mémoire estimée (30.7B)
| Précision | Mémoire | Quel matériel peut le faire tourner |
|---|---|---|
| BF16 (qualité maximale) | 71 GB | Station de travail |
| FP8 / INT8 (haute qualité) | 35 GB | Station de travail |
| 4 bits (Q4, idéal en local) | 21 GB | Carte graphique gaming |
Quel matériel peut le faire tourner
| Matériel | BF16 | FP8 | 4-bit |
|---|---|---|---|
| Ordinateur portable ou smartphone jusqu’à 16 Go · Ordinateur portable standard, smartphone, carte graphique de 8 à 16 Go | Ne tient pas | Ne tient pas | Ne tient pas |
| Carte graphique gaming 16 à 32 Go · RTX 3090, 4090 ou 5090, Mac 32 Go | Ne tient pas | Ne tient pas | Tient |
| Station de travail 32 à 96 Go · RTX PRO 6000 (96 Go), plusieurs GPU | Tient | Tient | Tient |
| Ordinateur de bureau à grande mémoire 96 à 512 Go · Mac Studio, AMD Strix Halo, NVIDIA DGX Spark | Tient | Tient | Tient |
| Serveur GPU 512 Go à 1,5 To · Nœud 8x H100, H200 ou B200 | Tient | Tient | Tient |
| Cluster multi-nœuds plus de 1,5 To · Plusieurs serveurs GPU travaillant ensemble | Tient | Tient | Tient |
Ce sont des estimations pour vous aider à planifier, pas des garanties. Reportez-vous toujours aux indications du développeur.
Comment fonctionne l’estimation
La mémoire des poids égale le nombre de paramètres multiplié par les octets par paramètre : 2 octets en BF16, 1 en FP8 ou INT8, environ 0,6 en 4 bits (Q4). Nous ajoutons 15 % pour les tampons d’exécution et un cache de contexte modeste. Les contextes longs demandent plus, car le cache de clés-valeurs grossit à chaque token. Pour les modèles mixture-of-experts, tous les experts doivent être chargés : utilisez donc les paramètres totaux, et non les paramètres actifs.
Tous les modèles d’IA open source
| Modèle | Paramètres | BF16 | FP8 / INT8 | 4-bit |
|---|---|---|---|---|
| Nex-N2.6 Nex-N2.5-mini | 35.1B | 81 GB | 40 GB | 24 GB |
| Nex-N2.6 Nex-N2.6 (FP8) | 321B | 739 GB | 370 GB | 222 GB |
| Nex-N2.6 Nex-N2.5-Pro (FP8) | 397B | 913 GB | 456 GB | 274 GB |
| Nex-N2.6 Nex-N2.5-Max (FP8) | 1.6T | 3.68 TB | 1.84 TB | 1.1 TB |
| LongCat-2.5 LongCat-2.5 | 1.6T | 3.68 TB | 1.84 TB | 1.1 TB |
| LongCat-2.5 LongCat-2.5-W4A4 | 1.6T | 3.68 TB | 1.84 TB | 1.47 TB |
| Arete-27B 27B | 27.4B | 63 GB | 31 GB | 19 GB |
| Mirage Mirage (2-bit Cactus Quants, .cact file) | 51M | 0.118 GB | 0.059 GB | 0.0354 GB |
| Mirage Mirage (FP32 checkpoint) | 51M | 0.118 GB | 0.059 GB | 0.0354 GB |
| ERNIE 5.5 Flash Base ERNIE-5.5-Flash-Base (FP8) | 280B | 644 GB | 322 GB | 193 GB |
| ERNIE 5.5 Flash Base ERNIE-5.5-Flash-Base-BF16 | 280B | 644 GB | 322 GB | 193 GB |
| PLaMo 3 Translate PLaMo 3 Translate 0.8B | 890M | 2.05 GB | 1.02 GB | 0.614 GB |
| PLaMo 3 Translate PLaMo 3 Translate 0.8B (GGUF Q4_K_M) | 890M | 2.05 GB | 1.02 GB | 0.627 GB |
| PLaMo 3 Translate PLaMo 3 Translate 2B | 2.88B | 6.62 GB | 3.31 GB | 1.99 GB |
| PLaMo 3 Translate PLaMo 3 Translate 2B (GGUF Q4_K_M) | 2.88B | 6.62 GB | 3.31 GB | 1.99 GB |
| PLaMo 3 Translate PLaMo 3 Translate 8B | 8.53B | 20 GB | 9.81 GB | 5.89 GB |
| PLaMo 3 Translate PLaMo 3 Translate 8B (GGUF Q4_K_M) | 8.53B | 20 GB | 9.81 GB | 5.81 GB |
| PLaMo 3 Translate PLaMo 3 Translate 31B | 31.8B | 73 GB | 37 GB | 22 GB |
| PLaMo 3 Translate PLaMo 3 Translate 31B (NVFP4) | 31.8B | 73 GB | 37 GB | 21 GB |
| Ripple-65B Preview Ripple-65B Preview | 64.8B | 149 GB | 75 GB | 45 GB |
| Ripple-65B Preview Ripple-65B Preview NVFP4 (experimental) | 64.8B | 149 GB | 75 GB | 63 GB |
| Ripple-65B Preview Ripple-65B Base Preview | 64.8B | 149 GB | 75 GB | 45 GB |
| Sarvam Prism Sarvam Prism (custom FP8) | 105B | 241 GB | 121 GB | 120 GB |
| Hydrogen-1.0 Hydrogen-1.0 (BF16) | 753B | 1.73 TB | 866 GB | 520 GB |
| Hydrogen-1.0 Hydrogen-1.0-NVFP4 | 753B | 1.73 TB | 866 GB | 510 GB |
| Hydrogen-1.0 Hydrogen-1.0-MXFP4 | 753B | 1.73 TB | 866 GB | 465 GB |
| Kimi K3.1 Pro K3.1 Pro | 2.8T | 6.44 TB | 3.22 TB | 1.72 TB |
| S5-nano S5-nano | 4.66B | 11 GB | 5.36 GB | 3.22 GB |
| S5-nano S5-nano FP8 | 4.66B | 11 GB | 5.36 GB | 3.22 GB |
| S5-nano S5-nano Q4_K_M (GGUF) | 4.66B | 11 GB | 5.36 GB | 3.08 GB |
| Raon-1 nano Raon-1-nano (BF16) | 3.1B | 7.13 GB | 3.56 GB | 2.14 GB |
| Raon-1 nano GGUF Q8_0 | 3.1B | 7.13 GB | 3.56 GB | 2.14 GB |
| Raon-1 nano GGUF Q4_K_M | 3.1B | 7.13 GB | 3.56 GB | 2.31 GB |
| Raon-1 nano MLX (4-bit GPTQ) | 3.1B | 7.13 GB | 3.56 GB | 1.98 GB |
| Raon-1 nano LiteRT-LM bundle (4-bit) | 3.1B | 7.13 GB | 3.56 GB | 1.98 GB |
| Mage-VL-Cowork Mage-VL-Cowork (4B) | 4.74B | 11 GB | 5.45 GB | 3.27 GB |
| SenseNova-Loop-9B-Preview SenseNova-Loop-9B-Preview | 9.66B | 22 GB | 11 GB | 22 GB |
| Mistral Large 4 Large 4 | 1.05T | 2.42 TB | 1.21 TB | 725 GB |
| Mistral Large 4 Large 4 NVFP4 | 1.05T | 2.42 TB | 1.21 TB | 671 GB |
| LFM3 LFM3-1.7B | 1.73B | 3.98 GB | 1.99 GB | 1.19 GB |
| LFM3 LFM3-1.7B-Base | 1.73B | 3.98 GB | 1.99 GB | 1.19 GB |
| LFM3 LFM3-VL-2B | 1.92B | 4.42 GB | 2.21 GB | 1.32 GB |
| LFM3 LFM3-Omni-2B | 2.17B | 4.99 GB | 2.5 GB | 1.5 GB |
| MiniCPM-OCR 1.0 MiniCPM-OCR 1.0 | 1.3B | 2.99 GB | 1.49 GB | 0.897 GB |
| Smaug-Decisions Smaug-Audio-Decisions-0.7B | 740M | 1.7 GB | 0.851 GB | 0.511 GB |
| Smaug-Decisions Smaug-Decisions | 8.61B | 20 GB | 9.9 GB | 5.94 GB |
| Smaug-Decisions Smaug-Decisions-LiteRT | 8.61B | 20 GB | 9.9 GB | 5.94 GB |
| Nanbeige4.3-33B Nanbeige4.3-33B | 33.1B | 76 GB | 38 GB | 23 GB |
| Nanbeige4.3-33B Nanbeige4.3-33B-FP8 | 33.1B | 76 GB | 38 GB | 23 GB |
| Nanbeige4.3-33B Nanbeige4.3-33B-INT8 | 33.1B | 76 GB | 38 GB | 23 GB |
| Nanbeige4.3-33B Nanbeige4.3-33B-INT4 (quantization-aware training) | 33.1B | 76 GB | 38 GB | 25 GB |
| Nanbeige4.3-33B Nanbeige4.3-33B-Base | 33.1B | 76 GB | 38 GB | 23 GB |
| Raon-1 mini preview Raon-1-mini-preview (MXFP8) | 28.8B | 66 GB | 33 GB | 20 GB |
| Raon-1 mini preview Raon-1-mini-preview-NVFP4 | 28.8B | 66 GB | 33 GB | 19 GB |
| Raon-1 mini preview GGUF IQ4_XS | 28.8B | 66 GB | 33 GB | 18 GB |
| Raon-1 mini preview GGUF Q4_K_M | 28.8B | 66 GB | 33 GB | 22 GB |
| Raon-1 mini preview GGUF Q8_0 | 28.8B | 66 GB | 33 GB | 20 GB |
| Spark-X2.6 Spark-X2.6-1.7B | 1.71B | 3.93 GB | 1.97 GB | 1.18 GB |
| Spark-X2.6 Spark-X2.6-1.7B INT4 | 1.71B | 3.93 GB | 1.97 GB | 1.88 GB |
| Spark-X2.6 Spark-X2.6-4B | 4.11B | 9.45 GB | 4.73 GB | 2.84 GB |
| Spark-X2.6 Spark-X2.6-4B INT4 | 4.11B | 9.45 GB | 4.73 GB | 3.75 GB |
| Flint Flint (BF16) | 39.8B | 92 GB | 46 GB | 48 GB |
| Flint Flint INT4 (MLX, Apple silicon) | 39.8B | 92 GB | 46 GB | 48 GB |
| Flint Flint INT4 GGUF (Q4_1, Metal) | 39.8B | 92 GB | 46 GB | 48 GB |
| Flint Flint NVFP4 GGUF (NVIDIA CUDA) | 39.8B | 92 GB | 46 GB | 48 GB |
| MiniMax M3.1 Flash M3.1 Flash | 428B | 984 GB | 492 GB | 277 GB |
| Nemotron 3.5 Parse Nemotron 3.5 Parse | 631M | 1.45 GB | 0.726 GB | 0.435 GB |
| Dory 1.0 Dory1.0-4B (BF16) | 4B | 9.2 GB | 4.6 GB | 2.76 GB |
| Dory 1.0 Dory1.0-4B (MXFP8) | 4B | 9.2 GB | 4.6 GB | 2.76 GB |
| Dory 1.0 Dory1.0-4B (NVFP4) | 4B | 9.2 GB | 4.6 GB | 3.52 GB |
| Reflection Beam Beam 1.0 | 501B | 1.15 TB | 576 GB | 346 GB |
| Reflection Beam Beam 1.0 FP8 | 501B | 1.15 TB | 576 GB | 346 GB |
| Reflection Beam Beam 1.0 NVFP4 | 501B | 1.15 TB | 576 GB | 323 GB |
| Hy-Memory Hy-Memory-30B-A3B | 30.1B | 69 GB | 35 GB | 21 GB |
| Hy-Memory Hy-Memory-30B-A3B-FP8 | 30.1B | 69 GB | 35 GB | 21 GB |
| Hy-Memory Hy-Memory-30B-A3B (Q4_K_M GGUF) | 30.1B | 69 GB | 35 GB | 20 GB |
| Jais 3 0.9B (BF16) | 1.08B | 2.48 GB | 1.24 GB | 0.745 GB |
| Jais 3 3.7B (BF16) | 5.06B | 12 GB | 5.82 GB | 3.49 GB |
| Jais 3 7B (BF16) | 9B | 21 GB | 10 GB | 6.21 GB |
| Jais 3 7B GGUF Q4_K_M | 9B | 21 GB | 10 GB | 6.16 GB |
| Jais 3 32B (BF16) | 34.8B | 80 GB | 40 GB | 24 GB |
| Jais 3 MoVA-36B-A4B (BF16) | 37.4B | 86 GB | 43 GB | 26 GB |
| Jais 3 MoVA-36B-A4B GGUF Q4_K_M | 37.4B | 86 GB | 43 GB | 25 GB |
| Jais 3 375B-A23B (BF16) | 379B | 872 GB | 436 GB | 262 GB |
| Jais 3 375B-A23B (FP8) | 379B | 872 GB | 436 GB | 262 GB |
| MemT-1.0 MemT-1.0-Nano | 35.1B | 81 GB | 40 GB | 24 GB |
| MemT-1.0 MemT-1.0-Flash | 288B | 662 GB | 331 GB | 199 GB |
| Muse Spark Open Spark Open | 816B | 1.88 TB | 938 GB | 563 GB |
| Muse Spark Open Spark Open NVFP4 | 816B | 1.88 TB | 938 GB | 586 GB |
| Nemotron 3.5 Bolt E4B | 8B | 18 GB | 9.2 GB | 5.52 GB |
| Nemotron 3.5 Bolt 74B-A9B | 74B | 170 GB | 85 GB | 51 GB |
| Nemotron 3.5 Bolt 74B-A9B 24GB | 74B | 170 GB | 85 GB | 24 GB |
| Nemotron 3.5 Super VL | 120B | 276 GB | 138 GB | 83 GB |
| Nemotron 3.5 Super VL NVFP4 | 120B | 276 GB | 138 GB | 83 GB |
| Sage-A1.5 Agents-A1-4B | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| Sage-A1.5 Agents-A1-4B (Q4_K_M GGUF) | 4.54B | 10 GB | 5.22 GB | 2.98 GB |
| Sage-A1.5 Agents-A1 | 35.1B | 81 GB | 40 GB | 24 GB |
| Sage-A1.5 Sage-A1.5 | 36B | 83 GB | 41 GB | 25 GB |
| Sage-A1.5 Sage-A1.5 (Q8_0 GGUF) | 36B | 83 GB | 41 GB | 25 GB |
| Sage-A1.5 Sage-A1.5 (Q4_K_M GGUF) | 36B | 83 GB | 41 GB | 24 GB |
| Step 5 Preview Step-5-Preview (FP8) | 604B | 1.39 TB | 695 GB | 417 GB |
| Step 5 Preview Step-5-Preview-BF16 | 604B | 1.39 TB | 695 GB | 417 GB |
| Step 5 Preview Step-5-Preview-NVFP4 | 604B | 1.39 TB | 695 GB | 434 GB |
| TwIL TwIL-LM3 | 3.08B | 7.08 GB | 3.54 GB | 2.13 GB |
| TwIL TwIL-LM3 (Q4_K_M GGUF) | 3.08B | 7.08 GB | 3.54 GB | 2.11 GB |
| TwIL TwIL-LM3-Pro | 3.66B | 8.42 GB | 4.21 GB | 2.53 GB |
| TwIL TwIL-LM3-Pro (Q4_K_M GGUF) | 3.66B | 8.42 GB | 4.21 GB | 2.46 GB |
| TwIL TwIL-8B (balanced) | 8.79B | 20 GB | 10 GB | 6.07 GB |
| TwIL TwIL-8B (balanced, Q4_K_M GGUF) | 8.79B | 20 GB | 10 GB | 5.88 GB |
| LFM2.5-24B-A2B LFM2.5-24B-A2B | 24B | 55 GB | 28 GB | 17 GB |
| LFM2.5-24B-A2B LFM2.5-24B-A2B FP8 | 24B | 55 GB | 28 GB | 17 GB |
| Ling-3.1-flash Ling-3.1-flash-1019 | 560B | 1.29 TB | 644 GB | 386 GB |
| Ling-3.1-flash Ling-3.1-flash | 560B | 1.29 TB | 644 GB | 386 GB |
| Ling-3.1-flash Ling-3.1-flash-base | 560B | 1.29 TB | 644 GB | 386 GB |
| MiniCPM-V 4.7 1B | 1.55B | 3.56 GB | 1.78 GB | 1.07 GB |
| MiniCPM-V 4.7 35B-A3B | 35.2B | 81 GB | 40 GB | 24 GB |
| MiniCPM-V 4.7 35B-A3B int4 | 35.2B | 81 GB | 40 GB | 25 GB |
| LightOnOCR-3 LightOnOCR-3-0.8B | 853M | 1.96 GB | 0.981 GB | 0.589 GB |
| LightOnOCR-3 LightOnOCR-3-1B | 1.01B | 2.32 GB | 1.16 GB | 0.697 GB |
| LightOnOCR-3 LightOnOCR-3-4B | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| Mellum2.1 Mellum2.1 Thinking | 12.2B | 28 GB | 14 GB | 8.38 GB |
| Mellum2.1 Mellum2.1 Thinking GGUF Q4_K_M | 12.2B | 28 GB | 14 GB | 8.91 GB |
| Mellum2.1 Mellum2.1 Thinking GGUF MXFP4_MOE | 12.2B | 28 GB | 14 GB | 7.7 GB |
| Mellum2.1 Mellum2 Instruct (June 2026) | 12.2B | 28 GB | 14 GB | 8.38 GB |
| Mellum2.1 Mellum2 Base (June 2026) | 12.2B | 28 GB | 14 GB | 8.38 GB |
| Liquid d1 d1-omni-600M | 587M | 1.35 GB | 0.675 GB | 0.405 GB |
| Liquid d1 d1-2B | 1.92B | 4.42 GB | 2.21 GB | 1.32 GB |
| Liquid d1 d1-Omni-2B | 2.17B | 4.99 GB | 2.5 GB | 1.5 GB |
| Liquid d1 d1-3B | 3.12B | 7.18 GB | 3.59 GB | 2.15 GB |
| Kolibri 1 Kolibri 1 FP8 | 78B | 179 GB | 90 GB | 54 GB |
| Kolibri 1 Kolibri 1 BF16 | 78B | 179 GB | 90 GB | 54 GB |
| Clef Clef-flash (9B, lowest latency) | 9.41B | 22 GB | 11 GB | 6.49 GB |
| Clef Clef (27B, precision decisions) | 27.4B | 63 GB | 31 GB | 19 GB |
| pplx-decider pplx-decider flash v1.2 (4B) | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| pplx-decider pplx-decider flash v1.2 GGUF (Q8_0) | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| pplx-decider pplx-decider v1.2 (27B) | 26.1B | 60 GB | 30 GB | 18 GB |
| pplx-decider pplx-decider v1.1 (27B, one question per pass) | 26.1B | 60 GB | 30 GB | 18 GB |
| Xiaomi-OCR-0 Xiaomi-OCR-0 | 873M | 2.01 GB | 1 GB | 0.602 GB |
| AREX-2 AREX-2 (27B) | 27.4B | 63 GB | 32 GB | 19 GB |
| AutoTrust Decider Decider Mini 9B (JEV-9B) | 8.95B | 21 GB | 10 GB | 6.18 GB |
| AutoTrust Decider GEV-26B-Decide (Gemma 4) | 25.8B | 59 GB | 30 GB | 80 GB |
| AutoTrust Decider GEV-26B-Decide NVFP4 | 25.8B | 59 GB | 30 GB | 21 GB |
| AutoTrust Decider Decider Pro 27B (JEV-27B) | 26.9B | 62 GB | 31 GB | 19 GB |
| AutoTrust Decider Decider Pro Vision 27B v1.1 (text decisions) | 27.4B | 63 GB | 31 GB | 19 GB |
| AutoTrust Decider Decider Pro Vision 27B (JEV-27B-VL) | 27.8B | 64 GB | 32 GB | 80 GB |
| AutoTrust Decider Decider Pro 35B (JEV-35B) | 36B | 83 GB | 41 GB | 80 GB |
| AutoTrust Decider Decider Pro 35B NVFP4 | 36B | 83 GB | 41 GB | 32 GB |
| MiMo-V2.6 V2.6 Distill Qwen 9B | 9.4B | 22 GB | 11 GB | 6.49 GB |
| MiMo-V2.6 V2.6 Flash | 310B | 713 GB | 357 GB | 196 GB |
| MiMo-V2.6 V2.6 Pro | 1.02T | 2.35 TB | 1.17 TB | 630 GB |
| Ternary Bonsai 2 Ternary Bonsai 2 2B | 2.21B | 5.08 GB | 2.54 GB | 0.473 GB |
| Ternary Bonsai 2 Ternary Bonsai 2 4B | 4.54B | 10 GB | 5.22 GB | 1.04 GB |
| Ternary Bonsai 2 Ternary Bonsai 2 9B | 9.41B | 22 GB | 11 GB | 2.2 GB |
| Ternary Bonsai 2 Ternary Bonsai 2 27B | 27.4B | 63 GB | 31 GB | 6.55 GB |
| DeepSeek V4.1 Flash V4.1-Flash-1017 | 552B | 1.27 TB | 635 GB | 562 GB |
| DeepSeek V4.1 Flash V4.1-Flash | 552B | 1.27 TB | 635 GB | 561 GB |
| MiniCPM5-2B MiniCPM5-1B | 1.08B | 2.48 GB | 1.24 GB | 0.745 GB |
| MiniCPM5-2B MiniCPM5-2B | 2.52B | 5.8 GB | 2.9 GB | 1.74 GB |
| K2 Horizon 0.9B (BF16) | 1.08B | 2.48 GB | 1.24 GB | 0.745 GB |
| K2 Horizon 3.7B (BF16) | 5.06B | 12 GB | 5.82 GB | 3.49 GB |
| K2 Horizon 7B (BF16) | 9B | 21 GB | 10 GB | 6.21 GB |
| K2 Horizon 7B GGUF Q4_K_M | 9B | 21 GB | 10 GB | 6.16 GB |
| K2 Horizon 32B (BF16) | 34.8B | 80 GB | 40 GB | 24 GB |
| K2 Horizon MoVA-36B-A4B (BF16) | 37.4B | 86 GB | 43 GB | 26 GB |
| K2 Horizon MoVA-36B-A4B GGUF Q4_K_M | 37.4B | 86 GB | 43 GB | 25 GB |
| K2 Horizon 375B-A23B (BF16) | 379B | 872 GB | 436 GB | 262 GB |
| K2 Horizon 375B-A23B (FP8) | 379B | 872 GB | 436 GB | 262 GB |
| Index-Translate Index-Translate-2B | 2.27B | 5.22 GB | 2.61 GB | 1.57 GB |
| Index-Translate Index-Translate-2B (GGUF Q4_K_M) | 2.27B | 5.22 GB | 2.61 GB | 1.44 GB |
| Index-Translate Index-Translate-9B | 9.65B | 22 GB | 11 GB | 6.66 GB |
| Index-Translate Index-Translate-9B (GGUF Q4_K_M) | 9.65B | 22 GB | 11 GB | 6.36 GB |
| Index-Translate Index-Translate-35B-A3B (preview, MoE) | 36B | 83 GB | 41 GB | 25 GB |
| Needle 3 Needle 3 (20 layers, FP16 checkpoint) | 121M | 0.278 GB | 0.139 GB | 0.0835 GB |
| GLM-5.3 GLM-5.3 | 753B | 1.73 TB | 866 GB | 520 GB |
| Hy4 preview Hy4 preview (BF16) | 770B | 1.77 TB | 885 GB | 531 GB |
| Hy4 preview Hy4 preview-FP8 | 770B | 1.77 TB | 885 GB | 531 GB |
| GLM-5.3-Flash GLM-5.3-Flash | 320B | 736 GB | 368 GB | 221 GB |
| Qwen3.8-Flash-Next Flash-Next | 180B | 414 GB | 207 GB | 124 GB |
| Qwen3.8-Flash-Next Flash-Next FP8 | 180B | 414 GB | 207 GB | 124 GB |
| Granite 4.2 3B | 3.7B | 8.51 GB | 4.25 GB | 2.55 GB |
| Granite 4.2 8B | 8.8B | 20 GB | 10 GB | 6.07 GB |
| Granite 4.2 30B | 29.3B | 67 GB | 34 GB | 20 GB |
| Granite 4.2 30B MXFP4 | 29.3B | 67 GB | 34 GB | 19 GB |
| Ornith 1.5 Ornith-1.5-9B | 9.65B | 22 GB | 11 GB | 6.66 GB |
| Ornith 1.5 Ornith-1.5-9B (NVFP4) | 9.65B | 22 GB | 11 GB | 9.7 GB |
| Ornith 1.5 Ornith-1.5-35B-A3B | 36B | 83 GB | 41 GB | 25 GB |
| Ornith 1.5 Ornith-1.5-35B-A3B (FP8) | 36B | 83 GB | 41 GB | 25 GB |
| Ornith 1.5 Ornith-1.5-35B-A3B (NVFP4) | 36B | 83 GB | 41 GB | 26 GB |
| Ornith 1.5 Ornith-1.5-122B | 125B | 288 GB | 144 GB | 86 GB |
| Ornith 1.5 Ornith-1.5-122B (NVFP4) | 125B | 288 GB | 144 GB | 85 GB |
| Ornith 1.5 Ornith-1.5-397B | 403B | 928 GB | 464 GB | 278 GB |
| Ornith 1.5 Ornith-1.5-397B (FP8) | 403B | 928 GB | 464 GB | 278 GB |
| Qwen3.8-27B 27B | 27.8B | 64 GB | 32 GB | 19 GB |
| Qwen3.8-27B 27B FP8 | 27.8B | 64 GB | 32 GB | 19 GB |
| Qwen3.8-Max 2.4T-A95B | 2.45T | 5.63 TB | 2.81 TB | 1.69 TB |
| Qwen3.8-Max 2.4T-A95B FP8 | 2.45T | 5.63 TB | 2.81 TB | 1.69 TB |
| Nemotron 3.5 Lightning Lightning 30B-A3B (NVFP4) | 31.6B | 73 GB | 36 GB | 24 GB |
| Nemotron 3.5 Lightning Lightning 30B-A3B (BF16) | 31.6B | 73 GB | 36 GB | 22 GB |
| Muse Glimmer Glimmer 30B | 29.6B | 68 GB | 34 GB | 20 GB |
| Muse Glimmer Glimmer 30B GGUF (17 GB K-quant) | 29.6B | 68 GB | 34 GB | 24 GB |
| Motif 3 Motif 3 (BF16) | 314B | 722 GB | 361 GB | 217 GB |
| Motif 3 Motif 3 NVFP4 | 314B | 722 GB | 361 GB | 206 GB |
| K-EXAONE 2.0 K-EXAONE-2.0 (BF16) | 750B | 1.72 TB | 862 GB | 518 GB |
| K-EXAONE 2.0 K-EXAONE-2.0-FP8 | 750B | 1.72 TB | 862 GB | 518 GB |
| K-EXAONE 2.0 K-EXAONE-2.0-NVFP4 | 750B | 1.72 TB | 862 GB | 579 GB |
| A.X K2 A.X K2 (FP8) | 688B | 1.58 TB | 791 GB | 475 GB |
| A.X K2 A.X K2 NVFP4 | 688B | 1.58 TB | 791 GB | 438 GB |
| Kimi K3 K3 | 2.8T | 6.44 TB | 3.22 TB | 1.72 TB |
| Mage-VL Mage-VL (4B) | 4.74B | 11 GB | 5.45 GB | 3.27 GB |
| Apertus 1.5 Apertus 1.5 8B | 8B | 18 GB | 9.2 GB | 5.52 GB |
| Apertus 1.5 Apertus 1.5 70B | 70B | 161 GB | 81 GB | 48 GB |
| Solar Open 2 Solar Open 2 (BF16) | 250B | 575 GB | 288 GB | 173 GB |
| Solar Open 2 Solar Open 2 Nota NVFP4 | 250B | 575 GB | 288 GB | 168 GB |
| Solar Open 2 Solar Open 2 Nota INT4 | 250B | 575 GB | 288 GB | 157 GB |
| Laguna S 2.1 Laguna-S-2.1 (BF16) | 118B | 270 GB | 135 GB | 81 GB |
| Laguna S 2.1 Laguna-S-2.1-FP8 | 118B | 270 GB | 135 GB | 81 GB |
| Laguna S 2.1 Laguna-S-2.1-NVFP4 | 118B | 270 GB | 135 GB | 110 GB |
| Laguna S 2.1 Laguna-S-2.1-INT4 | 118B | 270 GB | 135 GB | 110 GB |
| Laguna S 2.1 GGUF Q4_K_M | 118B | 270 GB | 135 GB | 106 GB |
| Nanbeige4.2-3B Nanbeige4.2-3B | 4.17B | 9.59 GB | 4.8 GB | 2.88 GB |
| Nanbeige4.2-3B Nanbeige4.2-3B-FP8 | 4.17B | 9.59 GB | 4.8 GB | 2.88 GB |
| Nanbeige4.2-3B Nanbeige4.2-3B-GPTQ-Int8 | 4.17B | 9.59 GB | 4.8 GB | 2.88 GB |
| Nanbeige4.2-3B Nanbeige4.2-3B-Base | 4.17B | 9.59 GB | 4.8 GB | 2.88 GB |
| Inkling Inkling-Small | 276B | 635 GB | 317 GB | 190 GB |
| Inkling Inkling-Small NVFP4 | 276B | 635 GB | 317 GB | 188 GB |
| Inkling Inkling | 975B | 2.24 TB | 1.12 TB | 673 GB |
| Inkling Inkling NVFP4 | 975B | 2.24 TB | 1.12 TB | 653 GB |
| HunyuanOCR HunyuanOCR-1.5 | 1.12B | 2.58 GB | 1.29 GB | 0.773 GB |
| GigaChat 3.5 Ultra Instruct FP8 | 434B | 998 GB | 499 GB | 299 GB |
| GigaChat 3.5 Ultra Instruct BF16 | 434B | 998 GB | 499 GB | 299 GB |
| GigaChat 3.5 Ultra Reasoning FP8 | 438B | 1.01 TB | 504 GB | 302 GB |
| Hy3 Hy3 (BF16) | 295B | 679 GB | 339 GB | 204 GB |
| Hy3 Hy3-FP8 | 295B | 679 GB | 339 GB | 204 GB |
| Laguna XS 2.1 Laguna-XS-2.1 (BF16) | 33.4B | 77 GB | 38 GB | 23 GB |
| Laguna XS 2.1 Laguna-XS-2.1-FP8 | 33.4B | 77 GB | 38 GB | 23 GB |
| Laguna XS 2.1 Laguna-XS-2.1-NVFP4 | 33.4B | 77 GB | 38 GB | 24 GB |
| Laguna XS 2.1 Laguna-XS-2.1-INT4 | 33.4B | 77 GB | 38 GB | 26 GB |
| Laguna XS 2.1 GGUF Q4_K_M | 33.4B | 77 GB | 38 GB | 22 GB |
| Unlimited-OCR Unlimited-OCR-2 | 3.34B | 7.68 GB | 3.84 GB | 2.3 GB |
| Unlimited-OCR Unlimited-OCR | 3.34B | 7.68 GB | 3.84 GB | 2.3 GB |
| Laguna M.1 Laguna-M.1 (BF16) | 226B | 519 GB | 260 GB | 156 GB |
| Laguna M.1 Laguna-M.1-FP8 | 226B | 519 GB | 260 GB | 156 GB |
| Laguna M.1 Laguna-M.1-NVFP4 | 226B | 519 GB | 260 GB | 153 GB |
| GLM-5.2 GLM-5.2 (BF16) | 753B | 1.73 TB | 866 GB | 520 GB |
| GLM-5.2 GLM-5.2-FP8 | 753B | 1.73 TB | 866 GB | 520 GB |
| Kimi K2.7 Code K2.7 Code (INT4) | 1.03T | 2.36 TB | 1.18 TB | 655 GB |
| DiffusionGemma 26B A4B | 25.2B | 58 GB | 29 GB | 17 GB |
| Nemotron 3 Ultra Ultra 550B-A55B (BF16) | 550B | 1.26 TB | 633 GB | 379 GB |
| Nemotron 3 Ultra Ultra 550B-A55B (NVFP4) | 550B | 1.26 TB | 633 GB | 387 GB |
| MiniMax M3 M3 (BF16) | 428B | 984 GB | 492 GB | 295 GB |
| MiniMax M3 M3 MXFP8 | 428B | 984 GB | 492 GB | 295 GB |
| Ornith 1.0 Ornith-1.0-9B | 9.41B | 22 GB | 11 GB | 6.49 GB |
| Ornith 1.0 Ornith-1.0-35B | 35.1B | 81 GB | 40 GB | 24 GB |
| Ornith 1.0 Ornith-1.0-35B (FP8) | 35.1B | 81 GB | 40 GB | 24 GB |
| Ornith 1.0 Ornith-1.0-397B | 397B | 913 GB | 456 GB | 274 GB |
| Ornith 1.0 Ornith-1.0-397B (FP8) | 397B | 913 GB | 456 GB | 274 GB |
| Step 3.7 Flash Step-3.7-Flash (BF16) | 201B | 463 GB | 232 GB | 139 GB |
| Step 3.7 Flash Step-3.7-Flash-FP8 | 201B | 463 GB | 232 GB | 139 GB |
| Step 3.7 Flash Step-3.7-Flash-NVFP4 | 201B | 463 GB | 232 GB | 142 GB |
| Step 3.7 Flash GGUF Q4_K_S | 201B | 463 GB | 232 GB | 120 GB |
| PaddleOCR-VL PaddleOCR-VL-1.6 | 960M | 2.21 GB | 1.1 GB | 0.662 GB |
| Surya OCR 2 Surya OCR 2 | 690M | 1.59 GB | 0.793 GB | 0.476 GB |
| LocateAnything-3B LocateAnything-3B | 3.83B | 8.81 GB | 4.4 GB | 2.64 GB |
| Hy-MT2 Hy-MT2-1.8B | 2.04B | 4.69 GB | 2.35 GB | 1.41 GB |
| Hy-MT2 Hy-MT2-7B | 8.03B | 18 GB | 9.23 GB | 5.54 GB |
| Hy-MT2 Hy-MT2-30B-A3B (MoE) | 30.1B | 69 GB | 35 GB | 21 GB |
| Hy-MT2 Hy-MT2-30B-A3B-FP8 | 30.1B | 69 GB | 35 GB | 21 GB |
| Command A+ Command A+ BF16 | 218B | 501 GB | 251 GB | 150 GB |
| Command A+ Command A+ FP8 | 218B | 501 GB | 251 GB | 150 GB |
| Command A+ Command A+ W4A4 | 218B | 501 GB | 251 GB | 145 GB |
| NuExtract3 NuExtract3 (BF16) | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| NuExtract3 NuExtract3-FP8 | 4.54B | 10 GB | 5.22 GB | 3.13 GB |
| NuExtract3 NuExtract3-W4A16 | 4.54B | 10 GB | 5.22 GB | 6.07 GB |
| NuExtract3 NuExtract3-Q4_K_M (GGUF) | 4.54B | 10 GB | 5.22 GB | 3.06 GB |
| Laguna XS.2 Laguna-XS.2 (BF16) | 33.4B | 77 GB | 38 GB | 23 GB |
| Laguna XS.2 Laguna-XS.2-FP8 | 33.4B | 77 GB | 38 GB | 23 GB |
| Laguna XS.2 Laguna-XS.2-NVFP4 | 33.4B | 77 GB | 38 GB | 24 GB |
| Laguna XS.2 Laguna-XS.2-INT4 | 33.4B | 77 GB | 38 GB | 26 GB |
| Nemotron 3 Nano Omni Nano Omni 30B-A3B (BF16) | 31B | 71 GB | 36 GB | 80 GB |
| Nemotron 3 Nano Omni Nano Omni 30B-A3B (FP8) | 31B | 71 GB | 36 GB | 48 GB |
| Nemotron 3 Nano Omni Nano Omni 30B-A3B (NVFP4) | 31B | 71 GB | 36 GB | 32 GB |
| DeepSeek V4 V4-Flash-0731 | 284B | 653 GB | 327 GB | 184 GB |
| DeepSeek V4 V4-Flash (preview) | 284B | 653 GB | 327 GB | 176 GB |
| DeepSeek V4 V4-Pro-0813 | 1.6T | 3.68 TB | 1.84 TB | 982 GB |
| DeepSeek V4 V4-Pro (preview) | 1.6T | 3.68 TB | 1.84 TB | 952 GB |
| OpenAI Privacy Filter Privacy Filter (BF16) | 1.4B | 3.22 GB | 1.61 GB | 0.966 GB |
| OpenAI Privacy Filter ONNX q4 (Transformers.js with WebGPU) | 1.4B | 3.22 GB | 1.61 GB | 0.99 GB |
| Kimi K2.6 K2.6 (INT4) | 1.03T | 2.36 TB | 1.18 TB | 655 GB |
| Qwen3.6 27B | 27.8B | 64 GB | 32 GB | 19 GB |
| Qwen3.6 27B FP8 | 27.8B | 64 GB | 32 GB | 19 GB |
| Qwen3.6 35B-A3B | 36B | 83 GB | 41 GB | 25 GB |
| Qwen3.6 35B-A3B FP8 | 36B | 83 GB | 41 GB | 25 GB |
| MiniMax-M2.7 M2.7 (FP8) | 229B | 526 GB | 263 GB | 158 GB |
| GLM-5.1 GLM-5.1 (BF16) | 754B | 1.73 TB | 867 GB | 520 GB |
| GLM-5.1 GLM-5.1-FP8 | 754B | 1.73 TB | 867 GB | 520 GB |
| Gemma 4 E2B | 5.1B | 12 GB | 5.86 GB | 3.52 GB |
| Gemma 4 E4B | 8B | 18 GB | 9.2 GB | 5.52 GB |
| Gemma 4 12B Unified | 11.9B | 27 GB | 14 GB | 8.25 GB |
| Gemma 4 26B A4B | 25.2B | 58 GB | 29 GB | 17 GB |
| Gemma 4 31B | 30.7B | 71 GB | 35 GB | 21 GB |
| GigaChat 3.1 Lightning 10B-A1.8B FP8 | 11.5B | 26 GB | 13 GB | 7.92 GB |
| GigaChat 3.1 Lightning 10B-A1.8B BF16 | 11.5B | 26 GB | 13 GB | 7.92 GB |
| GigaChat 3.1 Lightning 10B-A1.8B GGUF Q4_K_M | 11.5B | 26 GB | 13 GB | 7.15 GB |
| Chandra OCR 2 Chandra OCR 2 | 5.3B | 12 GB | 6.09 GB | 3.66 GB |
| Nemotron 3 Nano 4B Nano 4B (BF16) | 3.97B | 9.13 GB | 4.57 GB | 2.74 GB |
| Nemotron 3 Nano 4B Nano 4B (FP8) | 3.97B | 9.13 GB | 4.57 GB | 2.74 GB |
| Nemotron 3 Nano 30B-A3B (BF16) | 31.6B | 73 GB | 36 GB | 22 GB |
| Nemotron 3 Nano 30B-A3B (NVFP4) | 31.6B | 73 GB | 36 GB | 21 GB |
| Nemotron 3 Super 120B-A12B (BF16) | 120B | 276 GB | 138 GB | 83 GB |
| Nemotron 3 Super 120B-A12B (NVFP4) | 120B | 276 GB | 138 GB | 88 GB |
| Sarvam 30B and 105B Sarvam-30B | 32.1B | 74 GB | 37 GB | 22 GB |
| Sarvam 30B and 105B Sarvam-30B FP8 | 32.1B | 74 GB | 37 GB | 22 GB |
| Sarvam 30B and 105B Sarvam-30B Q4_K_M (GGUF) | 32.1B | 74 GB | 37 GB | 22 GB |
| Sarvam 30B and 105B Sarvam-105B | 106B | 244 GB | 122 GB | 73 GB |
| Sarvam 30B and 105B Sarvam-105B FP8 | 106B | 244 GB | 122 GB | 73 GB |
| Sarvam 30B and 105B Sarvam-105B Q4_K_M (GGUF) | 106B | 244 GB | 122 GB | 71 GB |
| Qwen3.5 0.8B | 873M | 2.01 GB | 1 GB | 0.602 GB |
| Qwen3.5 2B | 2.27B | 5.23 GB | 2.62 GB | 1.57 GB |
| Qwen3.5 4B | 4.66B | 11 GB | 5.36 GB | 3.22 GB |
| Qwen3.5 9B | 9.65B | 22 GB | 11 GB | 6.66 GB |
| Qwen3.5 27B | 27.8B | 64 GB | 32 GB | 19 GB |
| Qwen3.5 35B-A3B | 36B | 83 GB | 41 GB | 25 GB |
| Qwen3.5 122B-A10B | 125B | 288 GB | 144 GB | 86 GB |
| Qwen3.5 397B-A17B | 403B | 928 GB | 464 GB | 278 GB |
| GLM-5 GLM-5 (BF16) | 754B | 1.73 TB | 867 GB | 520 GB |
| GLM-5 GLM-5-FP8 | 754B | 1.73 TB | 867 GB | 520 GB |
| MiniMax-M2.5 M2.5 (FP8) | 229B | 526 GB | 263 GB | 158 GB |
| MiniCPM-o 4.5 9B (BF16) | 9.37B | 22 GB | 11 GB | 19 GB |
| MiniCPM-o 4.5 9B AWQ (int4) | 9.37B | 22 GB | 11 GB | 11 GB |
| GLM-OCR GLM-OCR | 900M | 2.07 GB | 1.03 GB | 0.621 GB |
| Step 3.5 Flash Step-3.5-Flash (BF16) | 199B | 459 GB | 229 GB | 138 GB |
| Step 3.5 Flash Step-3.5-Flash-FP8 | 199B | 459 GB | 229 GB | 138 GB |
| Step 3.5 Flash GGUF Q4_K_S | 199B | 459 GB | 229 GB | 120 GB |
| DeepSeek-OCR 2 OCR 2 | 3.39B | 7.8 GB | 3.9 GB | 2.34 GB |
| Kimi K2.5 K2.5 (INT4) | 1.03T | 2.36 TB | 1.18 TB | 655 GB |
| GLM-4.7-Flash GLM-4.7-Flash (BF16) | 31.2B | 72 GB | 36 GB | 22 GB |
| TranslateGemma TranslateGemma 4B | 4.3B | 9.89 GB | 4.94 GB | 2.97 GB |
| TranslateGemma TranslateGemma 12B | 12.2B | 28 GB | 14 GB | 8.41 GB |
| TranslateGemma TranslateGemma 27B | 27.4B | 63 GB | 32 GB | 19 GB |
| Olmo 3.1 7B Think | 7.3B | 17 GB | 8.39 GB | 5.04 GB |
| Olmo 3.1 7B Instruct | 7.3B | 17 GB | 8.39 GB | 5.04 GB |
| Olmo 3.1 32B Think | 32.2B | 74 GB | 37 GB | 22 GB |
| Olmo 3.1 32B Instruct | 32.2B | 74 GB | 37 GB | 22 GB |
| DeepSeek-V3.2 V3.2 | 685B | 1.58 TB | 788 GB | 473 GB |
| DeepSeek-V3.2 V3.2-Speciale | 685B | 1.58 TB | 788 GB | 473 GB |
| DeepSeek-OCR OCR | 3.34B | 7.68 GB | 3.84 GB | 2.3 GB |
| Qwen3-VL 2B | 2.13B | 4.9 GB | 2.45 GB | 1.47 GB |
| Qwen3-VL 4B | 4.44B | 10 GB | 5.11 GB | 3.06 GB |
| Qwen3-VL 8B | 8.77B | 20 GB | 10 GB | 6.05 GB |
| Qwen3-VL 30B-A3B | 31.1B | 71 GB | 36 GB | 21 GB |
| Qwen3-VL 32B | 33.4B | 77 GB | 38 GB | 23 GB |
| Qwen3-VL 235B-A22B | 236B | 542 GB | 271 GB | 163 GB |
| Qwen3-Omni Thinking (thinker only) | 31.7B | 73 GB | 36 GB | 69 GB |
| Qwen3-Omni Captioner (audio descriptions) | 31.7B | 73 GB | 36 GB | 22 GB |
| Qwen3-Omni Instruct (thinker and talker) | 35.3B | 81 GB | 41 GB | 79 GB |
| gpt-oss gpt-oss-20b | 21B | 48 GB | 24 GB | 15 GB |
| gpt-oss gpt-oss-120b | 117B | 269 GB | 135 GB | 72 GB |
| Qwen3 0.6B | 752M | 1.73 GB | 0.865 GB | 0.519 GB |
| Qwen3 1.7B | 2.03B | 4.67 GB | 2.34 GB | 1.4 GB |
| Qwen3 4B | 4.02B | 9.25 GB | 4.63 GB | 2.78 GB |
| Qwen3 8B | 8.19B | 19 GB | 9.42 GB | 5.65 GB |
| Qwen3 14B | 14.8B | 34 GB | 17 GB | 10 GB |
| Qwen3 30B-A3B | 30.5B | 70 GB | 35 GB | 21 GB |
| Qwen3 32B | 32.8B | 75 GB | 38 GB | 23 GB |
| Qwen3 235B-A22B | 235B | 541 GB | 270 GB | 162 GB |