Open-source AI models by VRAM and hardware

Memory decides what you can run. Each group below lists the open models whose smallest variant fits that kind of machine, using the developer's stated minimum where one exists and a 4-bit estimate otherwise. Bigger variants of the same model need the next group up.

  • List updated November 8, 2026

Laptop or phone (up to 16 GB)

Typical laptop, phone, 8 to 16 GB graphics card

Model Released Parameters Context License Smallest variant needs
ZONOS3-Mini Zyphra 800M 100M active – Apache 2.0 (Permissive) 10 GB Laptop or phone
Mirage Cactus Compute 51M – Apache 2.0 (Permissive) 0.0354 GB Laptop or phone
PLaMo 3 Translate Preferred Networks 890M – 31.8B 32K PLaMo Community (Conditional) 0.614 GB Laptop or phone
S5-nano Maritaca AI 4.66B 256K Apache 2.0 (Permissive) 3.08 GB Laptop or phone
Raon-1 nano KRAFTON 3.1B 256K Apache 2.0 (Permissive) 1.98 GB Laptop or phone
Mage-VL-Cowork Microsoft 4.74B 32K Apache 2.0 (Permissive) 3.27 GB Laptop or phone
LFM3 Liquid AI 1.73B – 2.17B 256K LFM Open 1.0 (Conditional) 1.19 GB Laptop or phone
LFM3-Audio-2B Liquid AI 2B 32K LFM Open 1.0 (Conditional) 4.6 GB Laptop or phone
MiniCPM-OCR 1.0 OpenBMB 1.3B 256K Apache 2.0 (Permissive) 0.897 GB Laptop or phone
Smaug-Decisions Abacus.AI 740M – 8.61B 128K Apache 2.0 (Permissive) 0.511 GB Laptop or phone
Maya 2 Native Maya Research 2.5B – Apache 2.0 (Permissive) 5.75 GB Laptop or phone
Phonon 31M Gradium 31M – Apache 2.0 (Permissive) 0.0747 GB Laptop or phone
Phonon 40M Gradium 40M – CC BY-NC (Non-commercial) 0.0858 GB Laptop or phone
Granite Speech 5.0 IBM 470M – 2.31B – Apache 2.0 (Permissive) 1.09 GB Laptop or phone
Nemotron 3.5 Embed NVIDIA 1.55B – 8.38B 32K OpenMDW-1.1 (Permissive) 1.46 GB Laptop or phone
Spark-X2.6 TokenSpark (SparkLLM) 1.71B – 4.11B 1M Apache 2.0 (Permissive) 1.18 GB Laptop or phone
Nemotron 3.5 Parse NVIDIA 631M – OpenMDW-1.1 (Permissive) 0.435 GB Laptop or phone
Dory 1.0 NVIDIA 4B 256K OpenMDW-1.1 (Permissive) 2.76 GB Laptop or phone
MOSS-Image OpenMOSS 5.08B – Apache 2.0 (Permissive) 4.2 GB Laptop or phone
FLUX 3 Image Klein Black Forest Labs 5.6B – FLUX Kommunity (Conditional) 8 GB Laptop or phone
Jais 3 Institute of Foundation Models (MBZUAI) 1.08B – 379B 23B active 512K Apache 2.0 (Permissive) 0.745 GB Laptop or phone
Jais-ASR Institute of Foundation Models (MBZUAI) 5.72B – Apache 2.0 (Permissive) 3.63 GB Laptop or phone
Nemotron 3.5 NVIDIA 8B – 120B 12B active 1M OpenMDW-1.1 (Permissive) 5.52 GB Laptop or phone
Sage-A1.5 Shanghai AI Laboratory 4.54B – 36B 3B active 256K Apache 2.0 (Permissive) 2.98 GB Laptop or phone
TwIL webAI 3.08B – 8.79B 128K webAI Non-Commercial (Non-commercial) 2.11 GB Laptop or phone
MiniCPM-V 4.7 OpenBMB 1.55B – 35.2B 3B active 256K Apache 2.0 (Permissive) 1.07 GB Laptop or phone
LightOnOCR-3 LightOn 853M – 4.54B 256K Apache 2.0 (Permissive) 0.589 GB Laptop or phone
Mellum2.1 JetBrains 12.2B 2.5B active 128K Apache 2.0 (Permissive) 7.7 GB Laptop or phone
Liquid d1 Liquid AI 587M – 3.12B 128K LFM Open 1.0 (Conditional) 0.405 GB Laptop or phone
EmbeddingGemma 2 Google DeepMind 270M – 740M 8K Apache 2.0 (Permissive) 0.621 GB Laptop or phone
Kandinsky 6.0 Video Kandinsky Lab 3B – 29B – MIT (Permissive) 16 GB Laptop or phone
Whistle Cactus Compute 55M – Apache 2.0 (Permissive) 0.253 GB Laptop or phone
Clef Cloudflare 9.41B – 27.4B 64K Apache 2.0 (Permissive) 6.49 GB Laptop or phone
pplx-decider Perplexity 4.54B – 26.1B 256K Apache 2.0 (Permissive) 3.13 GB Laptop or phone
KittenTTS 2 KittenML (Stellon Labs) 1.7B – Stellon Labs Community (Conditional) 6 GB Laptop or phone
Xiaomi-OCR-0 Xiaomi 873M 256K Apache 2.0 (Permissive) 0.602 GB Laptop or phone
AutoTrust Decider AutoTrust AI Lab 8.95B – 36B 3B active 256K Apache 2.0 (Permissive) 6.18 GB Laptop or phone
MiMo-V2.6 Xiaomi 9.4B – 1.02T 42B active 1M MIT (Permissive) 6.49 GB Laptop or phone
Ternary Bonsai 2 PrismML 2.21B – 27.4B 256K Apache 2.0 (Permissive) 0.473 GB Laptop or phone
MiniCPM5-2B OpenBMB 1.08B – 2.52B 128K Apache 2.0 (Permissive) 0.745 GB Laptop or phone
K2 Horizon Institute of Foundation Models (MBZUAI) 1.08B – 379B 23B active 512K Apache 2.0 (Permissive) 0.745 GB Laptop or phone
Confucius4-R2T2 NetEase Youdao 2.04B – NetEase Youdao Model Use (Conditional) 4.69 GB Laptop or phone
Index-Translate Bilibili 2.27B – 36B 3B active 256K Apache 2.0 (Permissive) 1.44 GB Laptop or phone
Needle 3 Cactus Compute 121M 8K Apache 2.0 (Permissive) 0.0835 GB Laptop or phone
Breeze TTS 2 BreezeBlue 3.5B – BreezeBlue Non-Commercial (Non-commercial) 12 GB Laptop or phone
Granite 4.2 IBM 3.7B – 29.3B 128K Apache 2.0 (Permissive) 2.55 GB Laptop or phone
Ornith 1.5 DeepReinforce 9.65B – 403B 17B active 256K MIT (Permissive) 6.66 GB Laptop or phone
LTX-2.5 LTX (Lightricks) 22B – LTX-2.x Community (Conditional) 16 GB Laptop or phone
IndexTTS-2.5 Bilibili 800M – Bilibili Model Use (Conditional) 6 GB Laptop or phone
Giga-Embeddings Sber (GigaChat) 480M – 10.5B 1.8B active 8K MIT (Permissive) 1.13 GB Laptop or phone
Mage-VL Microsoft 4.74B 256K Apache 2.0 (Permissive) 3.27 GB Laptop or phone
Apertus 1.5 Swiss AI Initiative 8B – 70B 256K Apache 2.0 (Permissive) 5.52 GB Laptop or phone
Nanbeige4.2-3B Nanbeige LLM Lab 4.17B 256K Apache 2.0 (Permissive) 2.88 GB Laptop or phone
GigaAM Multilingual Sber (GigaChat) 220M – 600M – MIT (Permissive) 1.01 GB Laptop or phone
Jina Reranker v3.5 Jina AI 597M 128K CC BY-NC (Non-commercial) 0.46 GB Laptop or phone
MOSS-Transcribe-Diarize OpenMOSS 910M 128K Apache 2.0 (Permissive) 2.09 GB Laptop or phone
HunyuanOCR Tencent 1.12B 128K Tencent Hunyuan (Conditional) 0.773 GB Laptop or phone
Unlimited-OCR Baidu 3.34B – MIT (Permissive) 2.3 GB Laptop or phone
Chatterbox Resemble AI 500M – MIT (Permissive) 3.69 GB Laptop or phone
VieNeu-TTS v3 Phạm Nguyễn Ngọc Bảo (VieNeu-TTS) 48M – 131M – Apache 2.0 (Permissive) 0.322 GB Laptop or phone
Higgs TTS 3 Boson AI 4.65B – Boson Higgs Non-Commercial (Non-commercial) 11 GB Laptop or phone
Magenta RealTime 2 Google DeepMind 230M – 2.4B – CC BY 4.0 (Permissive) 2.53 GB Laptop or phone
Nemotron 3.5 ASR NVIDIA 638M – OpenMDW-1.1 (Permissive) 2.93 GB Laptop or phone
Ornith 1.0 DeepReinforce 9.41B – 397B 17B active 256K MIT (Permissive) 6.49 GB Laptop or phone
Cosmos 3 NVIDIA 3.86B – 64.6B – OpenMDW-1.1 (Permissive) 11 GB Laptop or phone
PaddleOCR-VL Baidu 960M – Apache 2.0 (Permissive) 0.662 GB Laptop or phone
Surya OCR 2 Datalab 690M 256K OpenRAIL-M (Datalab Surya) (Conditional) 0.476 GB Laptop or phone
LocateAnything-3B NVIDIA 3.83B – NVIDIA Non-Commercial (Non-commercial) 2.64 GB Laptop or phone
MOSS-TTS OpenMOSS 4.55B – 8.49B – Apache 2.0 (Permissive) 10 GB Laptop or phone
MOSS-SoundEffect v2.0 OpenMOSS 1.3B – Apache 2.0 (Permissive) 13 GB Laptop or phone
Hy-MT2 Tencent 2.04B – 30.1B 3B active 256K Apache 2.0 (Permissive) 1.41 GB Laptop or phone
Stable Audio 3 Stability AI 460M – 1.4B – Stability Community (Conditional) 4.02 GB Laptop or phone
NuExtract3 NuMind 4.54B 128K Apache 2.0 (Permissive) 3.06 GB Laptop or phone
Anima CircleStone Labs 2.09B – CircleStone Non-Commercial (Non-commercial) 6.44 GB Laptop or phone
Jina Embeddings v5 Omni Jina AI 990M – 1.63B 32K CC BY-NC (Non-commercial) 2.27 GB Laptop or phone
Supertonic 3 Supertone 99M – OpenRAIL-M (Conditional) 0.46 GB Laptop or phone
Granite Embedding R2 IBM 48M – 312M 32K Apache 2.0 (Permissive) 0.115 GB Laptop or phone
OpenAI Privacy Filter OpenAI 1.4B 50M active 128K Apache 2.0 (Permissive) 0.966 GB Laptop or phone
MOSS-TTS-Nano OpenMOSS 100M – Apache 2.0 (Permissive) 0.276 GB Laptop or phone
Gemma 4 Google DeepMind 5.1B – 30.7B 256K Apache 2.0 (Permissive) 3.52 GB Laptop or phone
OmniVoice Xiaomi 613M – CC BY-NC (Non-commercial) 3.75 GB Laptop or phone
VoxCPM2 OpenBMB 2.29B – Apache 2.0 (Permissive) 8 GB Laptop or phone
Harrier OSS v1 Microsoft 270M – 27B 32K MIT (Permissive) 0.621 GB Laptop or phone
Cohere Transcribe Cohere 2.07B – Apache 2.0 (Permissive) 4.75 GB Laptop or phone
GigaChat 3.1 Lightning Sber (GigaChat) 11.5B 1.8B active 256K MIT (Permissive) 7.15 GB Laptop or phone
Voxtral TTS Mistral AI 4.09B – CC BY-NC (Non-commercial) 9.2 GB Laptop or phone
Chandra OCR 2 Datalab 5.3B 256K OpenRAIL-M (Datalab) (Conditional) 3.66 GB Laptop or phone
Nemotron 3 Nano 4B NVIDIA 3.97B 256K NVIDIA Nemotron (Permissive) 2.74 GB Laptop or phone
Jina Embeddings v5 Jina AI 239M – 677M 32K CC BY-NC (Non-commercial) 0.552 GB Laptop or phone
Qwen3.5 Alibaba Qwen 873M – 403B 17B active 256K Apache 2.0 (Permissive) 0.602 GB Laptop or phone
Voxtral Realtime Mistral AI 4.43B 128K Apache 2.0 (Permissive) 10 GB Laptop or phone
MiniCPM-o 4.5 OpenBMB 9.37B 40K Apache 2.0 (Permissive) 11 GB Laptop or phone
GLM-OCR Z.ai (Zhipu AI) 900M – MIT (Permissive) 0.621 GB Laptop or phone
Qwen3-ASR Alibaba Qwen 918M – 2.35B – Apache 2.0 (Permissive) 2.12 GB Laptop or phone
DeepSeek-OCR 2 DeepSeek 3.39B – Apache 2.0 (Permissive) 2.34 GB Laptop or phone
ACE-Step 1.5 ACE-Step 2B – 4B – MIT (Permissive) 4 GB Laptop or phone
Qwen3-TTS Alibaba Qwen 910M – 1.92B – Apache 2.0 (Permissive) 3.68 GB Laptop or phone
VibeVoice-ASR Microsoft 2.81B – 8.67B 64K MIT (Permissive) 6.47 GB Laptop or phone
TranslateGemma Google DeepMind 4.3B – 27.4B 2K Gemma Terms (Conditional) 2.97 GB Laptop or phone
voyage-4-nano Voyage AI 346M 32K Apache 2.0 (Permissive) 0.425 GB Laptop or phone
pplx-embed Perplexity 590M – 8.4B 32K MIT (Permissive) 2.76 GB Laptop or phone
Pocket TTS Kyutai 18M – 100M – CC BY 4.0 (Permissive) 0.127 GB Laptop or phone
Qwen3-VL-Reranker Alibaba Qwen 2.13B – 8.77B 32K Apache 2.0 (Permissive) 4.9 GB Laptop or phone
Qwen3-VL-Embedding Alibaba Qwen 2.13B – 8.14B 32K Apache 2.0 (Permissive) 4.9 GB Laptop or phone
Fun-CosyVoice 3 Tongyi Lab Speech Team 500M – Apache 2.0 (Permissive) 6.21 GB Laptop or phone
Olmo 3.1 Allen Institute for AI (Ai2) 7.3B – 32.2B 64K Apache 2.0 (Permissive) 5.04 GB Laptop or phone
Z-Image Tongyi MAI 6.15B – Apache 2.0 (Permissive) 16 GB Laptop or phone
GigaAM-v3 Sber (GigaChat) 220M – 240M – MIT (Permissive) 0.506 GB Laptop or phone
DeepSeek-OCR DeepSeek 3.34B 570M active – MIT (Permissive) 2.3 GB Laptop or phone
Qwen3-VL Alibaba Qwen 2.13B – 236B 22B active 256K Apache 2.0 (Permissive) 1.47 GB Laptop or phone
VibeVoice-TTS Microsoft 1.02B – 2.7B 64K MIT (Permissive) 2.35 GB Laptop or phone
Parakeet TDT 0.6B v3 NVIDIA 627M – CC BY 4.0 (Permissive) 2.89 GB Laptop or phone
gpt-oss OpenAI 21B – 117B 5.1B active 128K Apache 2.0 (Permissive) 15 GB Laptop or phone
Qwen3-Embedding Alibaba Qwen 600M – 7.57B 32K Apache 2.0 (Permissive) 1.38 GB Laptop or phone
Qwen3-Reranker Alibaba Qwen 596M – 8.19B 32K Apache 2.0 (Permissive) 1.37 GB Laptop or phone
Qwen3 Alibaba Qwen 752M – 235B 22B active 32K Apache 2.0 (Permissive) 0.519 GB Laptop or phone
Kokoro hexgrad 82M – Apache 2.0 (Permissive) 0.38 GB Laptop or phone
Whisper large-v3-turbo OpenAI 810M – 1.54B – MIT (Permissive) 6 GB Laptop or phone
BGE Reranker v2 m3 BAAI 568M 8K Apache 2.0 (Permissive) 2.61 GB Laptop or phone
BGE-M3 BAAI 568M 8K MIT (Permissive) 2.61 GB Laptop or phone

Gaming GPU (16 to 32 GB)

RTX 3090, 4090 or 5090, 32 GB Mac

Model Released Parameters Context License Smallest variant needs
Nex-N2.6 Nex-AGI 35.1B – 1.6T 256K Apache 2.0 (Permissive) 24 GB Gaming GPU
Arete-27B Nous Research 27.4B 256K Apache 2.0 (Permissive) 19 GB Gaming GPU
HyperFlow H3 Flash Video Rebirth 13.7B – 13.9B – MiniMax H3 Community (Conditional) 18 GB Gaming GPU
P-H3-Image Pruna AI 20B – 33.1B – MiniMax H3 Community (Conditional) 21 GB Gaming GPU
SenseNova-Loop-9B-Preview SenseTime 9.66B 256K Apache 2.0 (Permissive) 22 GB Gaming GPU
Nemotron 3.5 Transcribe NVIDIA 34B 4.3B active 64K OpenMDW-1.1 (Permissive) 25 GB Gaming GPU
Nanbeige4.3-33B Nanbeige LLM Lab 33.1B 512K Apache 2.0 (Permissive) 23 GB Gaming GPU
Hy-Nomas Tencent 8.55B – Apache 2.0 (Permissive) 24 GB Gaming GPU
Raon-1 mini preview KRAFTON 28.8B 4.3B active 256K Apache 2.0 (Permissive) 18 GB Gaming GPU
Nemotron 3.5 Rerank 8B NVIDIA 8.38B 32K OpenMDW-1.1 (Permissive) 19 GB Gaming GPU
Hy-Memory Tencent 30.1B 3B active 256K Apache 2.0 (Permissive) 20 GB Gaming GPU
MemT-1.0 MemTensor 35.1B – 288B 17B active 256K Apache 2.0 (Permissive) 24 GB Gaming GPU
Drama 3 Fish Audio 35.9B 3B active – Fish Audio Community 1.0 (Conditional) 25 GB Gaming GPU
LFM2.5-24B-A2B Liquid AI 24B 2.45B active 128K LFM Open 1.0 (Conditional) 17 GB Gaming GPU
FIBO 2.0 Bria AI 8.13B – CC BY-NC (Non-commercial) 29 GB Gaming GPU
AREX-2 BAAI 27.4B 256K Apache 2.0 (Permissive) 19 GB Gaming GPU
Qwen-Image-2.1 Alibaba Qwen 7.1B – Qwen Research License (Non-commercial) 20 GB Gaming GPU
AuK Tencent 1.5B – MIT (Permissive) 18 GB Gaming GPU
YuE2 M-A-P 3.63B – CC BY-NC (Non-commercial) 24 GB Gaming GPU
SenseNova-U1.5 SenseTime 17.5B – Apache 2.0 (Permissive) 24 GB Gaming GPU
Qwen3.8-27B Alibaba Qwen 27.8B 256K Apache 2.0 (Permissive) 19 GB Gaming GPU
MiniMax Music 3 MiniMax 11.1B – MiniMax Music3 Community (Conditional) 24 GB Gaming GPU
Nemotron 3.5 Lightning NVIDIA 31.6B 3B active 1M OpenMDW-1.1 (Permissive) 22 GB Gaming GPU
Muse Glimmer Meta 29.6B 128K Apache 2.0 (Permissive) 20 GB Gaming GPU
Laguna XS 2.1 Poolside 33.4B 3B active 256K OpenMDW-1.1 (Permissive) 22 GB Gaming GPU
DiffusionGemma Google DeepMind 25.2B 3.8B active 256K Apache 2.0 (Permissive) 17 GB Gaming GPU
Ideogram 4 Ideogram 9.3B – Ideogram Non-Commercial (Non-commercial) 19 GB Gaming GPU
HiDream-O1-Image HiDream.ai 8.8B – MIT (Permissive) 20 GB Gaming GPU
Laguna XS.2 Poolside 33.4B 3B active 256K Apache 2.0 (Permissive) 23 GB Gaming GPU
Nemotron 3 Nano Omni NVIDIA 31B 3B active 256K NVIDIA Open Model (Permissive) 32 GB Gaming GPU
Qwen3.6 Alibaba Qwen 27.8B – 36B 3B active 256K Apache 2.0 (Permissive) 19 GB Gaming GPU
Nemotron 3 NVIDIA 31.6B – 120B 12B active 1M NVIDIA Nemotron (Permissive) 21 GB Gaming GPU
S2 Pro Fish Audio 4.56B – Fish Audio Research (Non-commercial) 24 GB Gaming GPU
Sarvam 30B and 105B Sarvam AI 32.1B – 106B 10.3B active 128K Apache 2.0 (Permissive) 22 GB Gaming GPU
MOSS-TTSD OpenMOSS 8.36B – Apache 2.0 (Permissive) 19 GB Gaming GPU
GLM-4.7-Flash Z.ai (Zhipu AI) 31.2B 3B active 198K MIT (Permissive) 22 GB Gaming GPU
HeartMuLa HeartMuLa 3.94B – Apache 2.0 (Permissive) 26 GB Gaming GPU
Qwen3-Omni Alibaba Qwen 31.7B – 35.3B 3B active 64K Apache 2.0 (Permissive) 22 GB Gaming GPU
Wan 2.2 Alibaba Wan 5B – 27B 14B active – Apache 2.0 (Permissive) 24 GB Gaming GPU

Workstation (32 to 96 GB)

RTX PRO 6000 (96 GB), several GPUs

Model Released Parameters Context License Smallest variant needs
Sophon-Realtime Adventists AI 32B – Apache 2.0 (Permissive) 80 GB Workstation
Ripple-65B Preview Ricursive Intelligence 64.8B 1M Apache 2.0 (Permissive) 45 GB Workstation
Flint Recursive 39.8B 2.5B active 256K Apache 2.0 (Permissive) 48 GB Workstation
Kolibri 1 Aleph Alpha 78B 3.5B active 1M Apache 2.0 (Permissive) 54 GB Workstation
Ming-Image 0.1 Design inclusionAI (Ant Group) 6.2B – MIT (Permissive) 80 GB Workstation
Laguna S 2.1 Poolside 118B 8B active 1M OpenMDW-1.1 (Permissive) 81 GB Workstation
Krea 2 Krea 12.8B – Krea 2 Community (Conditional) 41 GB Workstation
LTX-2.3 LTX (Lightricks) 22B – LTX-2 Community (Conditional) 34 GB Workstation

Big-memory desktop (96 to 512 GB)

Mac Studio, AMD Strix Halo, NVIDIA DGX Spark

Model Released Parameters Context License Smallest variant needs
MiniMax H3-Image MiniMax 33.1B – MiniMax H3-Image Community (Conditional) 155 GB Big-memory desktop
ERNIE 5.5 Flash Base Baidu 280B 14B active 1M ERNIE 5.5 Flash Base (Conditional) 193 GB Big-memory desktop
Sarvam Prism Sarvam AI 105B 10.3B active 128K Apache 2.0 (Permissive) 120 GB Big-memory desktop
Hydrogen-1.0 Deep Principle 753B 40B active 1M MIT (Permissive) 465 GB Big-memory desktop
Pika H3 Flex Pika 33.1B – MiniMax H3 Community (Conditional) 169 GB Big-memory desktop
MiniMax M3.1 Flash MiniMax 428B 23B active 1M MiniMax Community (Conditional) 277 GB Big-memory desktop
Reflection Beam Reflection AI 501B 23.4B active 1M Apache 2.0 (Permissive) 323 GB Big-memory desktop
Step 5 Preview StepFun 604B 27B active 1M StepFun 1.0 (Conditional) 417 GB Big-memory desktop
Ling-3.1-flash inclusionAI (Ant Group) 560B 25B active 1M MIT (Permissive) 386 GB Big-memory desktop
GLM-5.3-Flash Z.ai (Zhipu AI) 320B 18B active 1M MIT (Permissive) 221 GB Big-memory desktop
Qwen3.8-Flash-Next Alibaba Qwen 180B 6B active 256K Qwen Community 1.0 (Conditional) 124 GB Big-memory desktop
MiniMax H3 MiniMax 33.1B – MiniMax H3 Community (Conditional) 166 GB Big-memory desktop
Motif 3 Motif Technologies 314B 13.2B active 256K MIT (Permissive) 206 GB Big-memory desktop
A.X K2 SK Telecom 688B 33B active 256K Apache 2.0 (Permissive) 438 GB Big-memory desktop
Solar Open 2 Upstage 250B 15B active 1M Upstage Solar (Conditional) 157 GB Big-memory desktop
Inkling Thinking Machines Lab 276B – 975B 41B active 1M Apache 2.0 (Permissive) 188 GB Big-memory desktop
GigaChat 3.5 Ultra Sber (GigaChat) 434B – 438B 28B active 256K MIT (Permissive) 299 GB Big-memory desktop
Hy3 Tencent 295B 21B active 256K Apache 2.0 (Permissive) 204 GB Big-memory desktop
Laguna M.1 Poolside 226B 23.4B active 256K Apache 2.0 (Permissive) 153 GB Big-memory desktop
Nemotron 3 Ultra NVIDIA 550B 55B active 1M OpenMDW-1.1 (Permissive) 379 GB Big-memory desktop
MiniMax M3 MiniMax 428B 23B active 1M MiniMax Community (Conditional) 295 GB Big-memory desktop
Step 3.7 Flash StepFun 201B 11B active 256K Apache 2.0 (Permissive) 120 GB Big-memory desktop
Command A+ Cohere 218B 25B active 128K Apache 2.0 (Permissive) 145 GB Big-memory desktop
DeepSeek V4 DeepSeek 284B – 1.6T 49B active 1M MIT (Permissive) 176 GB Big-memory desktop
MiniMax-M2.7 MiniMax 229B 10B active 200K MiniMax M2.7 NC (Non-commercial) 158 GB Big-memory desktop
MiniMax-M2.5 MiniMax 229B 10B active 192K MiniMax Model (Conditional) 158 GB Big-memory desktop
Step 3.5 Flash StepFun 199B 11B active 256K Apache 2.0 (Permissive) 120 GB Big-memory desktop
DeepSeek-V3.2 DeepSeek 685B 37B active 160K MIT (Permissive) 473 GB Big-memory desktop

GPU server (512 GB to 1.5 TB)

8x H100, H200 or B200 node

Model Released Parameters Context License Smallest variant needs
LongCat-2.5 Meituan 1.6T 48B active 1M MIT (Permissive) 1.1 TB GPU server
Mistral Large 4 Mistral AI 1.05T 52B active 1M Mistral Open-Weight (Conditional) 671 GB GPU server
Muse Spark Open Meta 816B 42B active 1M Muse Model License (Conditional) 563 GB GPU server
DeepSeek V4.1 Flash DeepSeek 552B 16B active 1M MIT (Permissive) 561 GB GPU server
GLM-5.3 Z.ai (Zhipu AI) 753B 40B active 1M GLM-5.3 License (Conditional) 520 GB GPU server
Hy4 preview Tencent 770B 49B active 1M Apache 2.0 (Permissive) 531 GB GPU server
K-EXAONE 2.0 LG AI Research 750B 37B active 256K Apache 2.0 (Permissive) 518 GB GPU server
GLM-5.2 Z.ai (Zhipu AI) 753B 40B active 1M MIT (Permissive) 520 GB GPU server
Kimi K2.7 Code Moonshot AI 1.03T 32B active 256K Modified MIT (Conditional) 655 GB GPU server
Kimi K2.6 Moonshot AI 1.03T 32B active 256K Modified MIT (Conditional) 655 GB GPU server
GLM-5.1 Z.ai (Zhipu AI) 754B 40B active 198K MIT (Permissive) 520 GB GPU server
GLM-5 Z.ai (Zhipu AI) 754B 40B active 198K MIT (Permissive) 520 GB GPU server
Kimi K2.5 Moonshot AI 1.03T 32B active 256K Modified MIT (Conditional) 655 GB GPU server

Multi-node cluster (over 1.5 TB)

Several GPU servers working together

Model Released Parameters Context License Smallest variant needs
Kimi K3.1 Pro Moonshot AI 2.8T 104B active 1M Kimi K3 License (Conditional) 1.72 TB Multi-node cluster
Qwen3.8-Max Alibaba Qwen 2.45T 95B active 1M Qwen3.8-Max License (Conditional) 1.69 TB Multi-node cluster
Kimi K3 Moonshot AI 2.8T 104B active 1M Kimi K3 License (Conditional) 1.72 TB Multi-node cluster

How we chose

  • For language models, the figure is the smallest variant at 4-bit precision plus about 15% overhead, unless the developer states a minimum.
  • For image, video and speech models, the figure is a stated or measured minimum, or the full download size plus about 15%.
  • Long contexts and many simultaneous users need more memory than these figures.