Open-source AI models by VRAM and hardware
Memory decides what you can run. Each group below lists the open models whose smallest variant fits that kind of machine, using the developer's stated minimum where one exists and a 4-bit estimate otherwise. Bigger variants of the same model need the next group up.
Laptop or phone (up to 16 GB)
Typical laptop, phone, 8 to 16 GB graphics card
| Model | Released | Parameters | Context | License | Smallest variant needs |
|---|---|---|---|---|---|
| ZONOS3-Mini Zyphra | 800M 100M active | – | Apache 2.0 (Permissive) | 10 GB Laptop or phone | |
| Mirage Cactus Compute | 51M | – | Apache 2.0 (Permissive) | 0.0354 GB Laptop or phone | |
| PLaMo 3 Translate Preferred Networks | 890M – 31.8B | 32K | PLaMo Community (Conditional) | 0.614 GB Laptop or phone | |
| S5-nano Maritaca AI | 4.66B | 256K | Apache 2.0 (Permissive) | 3.08 GB Laptop or phone | |
| Raon-1 nano KRAFTON | 3.1B | 256K | Apache 2.0 (Permissive) | 1.98 GB Laptop or phone | |
| Mage-VL-Cowork Microsoft | 4.74B | 32K | Apache 2.0 (Permissive) | 3.27 GB Laptop or phone | |
| LFM3 Liquid AI | 1.73B – 2.17B | 256K | LFM Open 1.0 (Conditional) | 1.19 GB Laptop or phone | |
| LFM3-Audio-2B Liquid AI | 2B | 32K | LFM Open 1.0 (Conditional) | 4.6 GB Laptop or phone | |
| MiniCPM-OCR 1.0 OpenBMB | 1.3B | 256K | Apache 2.0 (Permissive) | 0.897 GB Laptop or phone | |
| Smaug-Decisions Abacus.AI | 740M – 8.61B | 128K | Apache 2.0 (Permissive) | 0.511 GB Laptop or phone | |
| Maya 2 Native Maya Research | 2.5B | – | Apache 2.0 (Permissive) | 5.75 GB Laptop or phone | |
| Phonon 31M Gradium | 31M | – | Apache 2.0 (Permissive) | 0.0747 GB Laptop or phone | |
| Phonon 40M Gradium | 40M | – | CC BY-NC (Non-commercial) | 0.0858 GB Laptop or phone | |
| Granite Speech 5.0 IBM | 470M – 2.31B | – | Apache 2.0 (Permissive) | 1.09 GB Laptop or phone | |
| Nemotron 3.5 Embed NVIDIA | 1.55B – 8.38B | 32K | OpenMDW-1.1 (Permissive) | 1.46 GB Laptop or phone | |
| Spark-X2.6 TokenSpark (SparkLLM) | 1.71B – 4.11B | 1M | Apache 2.0 (Permissive) | 1.18 GB Laptop or phone | |
| Nemotron 3.5 Parse NVIDIA | 631M | – | OpenMDW-1.1 (Permissive) | 0.435 GB Laptop or phone | |
| Dory 1.0 NVIDIA | 4B | 256K | OpenMDW-1.1 (Permissive) | 2.76 GB Laptop or phone | |
| MOSS-Image OpenMOSS | 5.08B | – | Apache 2.0 (Permissive) | 4.2 GB Laptop or phone | |
| FLUX 3 Image Klein Black Forest Labs | 5.6B | – | FLUX Kommunity (Conditional) | 8 GB Laptop or phone | |
| Jais 3 Institute of Foundation Models (MBZUAI) | 1.08B – 379B 23B active | 512K | Apache 2.0 (Permissive) | 0.745 GB Laptop or phone | |
| Jais-ASR Institute of Foundation Models (MBZUAI) | 5.72B | – | Apache 2.0 (Permissive) | 3.63 GB Laptop or phone | |
| Nemotron 3.5 NVIDIA | 8B – 120B 12B active | 1M | OpenMDW-1.1 (Permissive) | 5.52 GB Laptop or phone | |
| Sage-A1.5 Shanghai AI Laboratory | 4.54B – 36B 3B active | 256K | Apache 2.0 (Permissive) | 2.98 GB Laptop or phone | |
| TwIL webAI | 3.08B – 8.79B | 128K | webAI Non-Commercial (Non-commercial) | 2.11 GB Laptop or phone | |
| MiniCPM-V 4.7 OpenBMB | 1.55B – 35.2B 3B active | 256K | Apache 2.0 (Permissive) | 1.07 GB Laptop or phone | |
| LightOnOCR-3 LightOn | 853M – 4.54B | 256K | Apache 2.0 (Permissive) | 0.589 GB Laptop or phone | |
| Mellum2.1 JetBrains | 12.2B 2.5B active | 128K | Apache 2.0 (Permissive) | 7.7 GB Laptop or phone | |
| Liquid d1 Liquid AI | 587M – 3.12B | 128K | LFM Open 1.0 (Conditional) | 0.405 GB Laptop or phone | |
| EmbeddingGemma 2 Google DeepMind | 270M – 740M | 8K | Apache 2.0 (Permissive) | 0.621 GB Laptop or phone | |
| Kandinsky 6.0 Video Kandinsky Lab | 3B – 29B | – | MIT (Permissive) | 16 GB Laptop or phone | |
| Whistle Cactus Compute | 55M | – | Apache 2.0 (Permissive) | 0.253 GB Laptop or phone | |
| Clef Cloudflare | 9.41B – 27.4B | 64K | Apache 2.0 (Permissive) | 6.49 GB Laptop or phone | |
| pplx-decider Perplexity | 4.54B – 26.1B | 256K | Apache 2.0 (Permissive) | 3.13 GB Laptop or phone | |
| KittenTTS 2 KittenML (Stellon Labs) | 1.7B | – | Stellon Labs Community (Conditional) | 6 GB Laptop or phone | |
| Xiaomi-OCR-0 Xiaomi | 873M | 256K | Apache 2.0 (Permissive) | 0.602 GB Laptop or phone | |
| AutoTrust Decider AutoTrust AI Lab | 8.95B – 36B 3B active | 256K | Apache 2.0 (Permissive) | 6.18 GB Laptop or phone | |
| MiMo-V2.6 Xiaomi | 9.4B – 1.02T 42B active | 1M | MIT (Permissive) | 6.49 GB Laptop or phone | |
| Ternary Bonsai 2 PrismML | 2.21B – 27.4B | 256K | Apache 2.0 (Permissive) | 0.473 GB Laptop or phone | |
| MiniCPM5-2B OpenBMB | 1.08B – 2.52B | 128K | Apache 2.0 (Permissive) | 0.745 GB Laptop or phone | |
| K2 Horizon Institute of Foundation Models (MBZUAI) | 1.08B – 379B 23B active | 512K | Apache 2.0 (Permissive) | 0.745 GB Laptop or phone | |
| Confucius4-R2T2 NetEase Youdao | 2.04B | – | NetEase Youdao Model Use (Conditional) | 4.69 GB Laptop or phone | |
| Index-Translate Bilibili | 2.27B – 36B 3B active | 256K | Apache 2.0 (Permissive) | 1.44 GB Laptop or phone | |
| Needle 3 Cactus Compute | 121M | 8K | Apache 2.0 (Permissive) | 0.0835 GB Laptop or phone | |
| Breeze TTS 2 BreezeBlue | 3.5B | – | BreezeBlue Non-Commercial (Non-commercial) | 12 GB Laptop or phone | |
| Granite 4.2 IBM | 3.7B – 29.3B | 128K | Apache 2.0 (Permissive) | 2.55 GB Laptop or phone | |
| Ornith 1.5 DeepReinforce | 9.65B – 403B 17B active | 256K | MIT (Permissive) | 6.66 GB Laptop or phone | |
| LTX-2.5 LTX (Lightricks) | 22B | – | LTX-2.x Community (Conditional) | 16 GB Laptop or phone | |
| IndexTTS-2.5 Bilibili | 800M | – | Bilibili Model Use (Conditional) | 6 GB Laptop or phone | |
| Giga-Embeddings Sber (GigaChat) | 480M – 10.5B 1.8B active | 8K | MIT (Permissive) | 1.13 GB Laptop or phone | |
| Mage-VL Microsoft | 4.74B | 256K | Apache 2.0 (Permissive) | 3.27 GB Laptop or phone | |
| Apertus 1.5 Swiss AI Initiative | 8B – 70B | 256K | Apache 2.0 (Permissive) | 5.52 GB Laptop or phone | |
| Nanbeige4.2-3B Nanbeige LLM Lab | 4.17B | 256K | Apache 2.0 (Permissive) | 2.88 GB Laptop or phone | |
| GigaAM Multilingual Sber (GigaChat) | 220M – 600M | – | MIT (Permissive) | 1.01 GB Laptop or phone | |
| Jina Reranker v3.5 Jina AI | 597M | 128K | CC BY-NC (Non-commercial) | 0.46 GB Laptop or phone | |
| MOSS-Transcribe-Diarize OpenMOSS | 910M | 128K | Apache 2.0 (Permissive) | 2.09 GB Laptop or phone | |
| HunyuanOCR Tencent | 1.12B | 128K | Tencent Hunyuan (Conditional) | 0.773 GB Laptop or phone | |
| Unlimited-OCR Baidu | 3.34B | – | MIT (Permissive) | 2.3 GB Laptop or phone | |
| Chatterbox Resemble AI | 500M | – | MIT (Permissive) | 3.69 GB Laptop or phone | |
| VieNeu-TTS v3 Phạm Nguyễn Ngọc Bảo (VieNeu-TTS) | 48M – 131M | – | Apache 2.0 (Permissive) | 0.322 GB Laptop or phone | |
| Higgs TTS 3 Boson AI | 4.65B | – | Boson Higgs Non-Commercial (Non-commercial) | 11 GB Laptop or phone | |
| Magenta RealTime 2 Google DeepMind | 230M – 2.4B | – | CC BY 4.0 (Permissive) | 2.53 GB Laptop or phone | |
| Nemotron 3.5 ASR NVIDIA | 638M | – | OpenMDW-1.1 (Permissive) | 2.93 GB Laptop or phone | |
| Ornith 1.0 DeepReinforce | 9.41B – 397B 17B active | 256K | MIT (Permissive) | 6.49 GB Laptop or phone | |
| Cosmos 3 NVIDIA | 3.86B – 64.6B | – | OpenMDW-1.1 (Permissive) | 11 GB Laptop or phone | |
| PaddleOCR-VL Baidu | 960M | – | Apache 2.0 (Permissive) | 0.662 GB Laptop or phone | |
| Surya OCR 2 Datalab | 690M | 256K | OpenRAIL-M (Datalab Surya) (Conditional) | 0.476 GB Laptop or phone | |
| LocateAnything-3B NVIDIA | 3.83B | – | NVIDIA Non-Commercial (Non-commercial) | 2.64 GB Laptop or phone | |
| MOSS-TTS OpenMOSS | 4.55B – 8.49B | – | Apache 2.0 (Permissive) | 10 GB Laptop or phone | |
| MOSS-SoundEffect v2.0 OpenMOSS | 1.3B | – | Apache 2.0 (Permissive) | 13 GB Laptop or phone | |
| Hy-MT2 Tencent | 2.04B – 30.1B 3B active | 256K | Apache 2.0 (Permissive) | 1.41 GB Laptop or phone | |
| Stable Audio 3 Stability AI | 460M – 1.4B | – | Stability Community (Conditional) | 4.02 GB Laptop or phone | |
| NuExtract3 NuMind | 4.54B | 128K | Apache 2.0 (Permissive) | 3.06 GB Laptop or phone | |
| Anima CircleStone Labs | 2.09B | – | CircleStone Non-Commercial (Non-commercial) | 6.44 GB Laptop or phone | |
| Jina Embeddings v5 Omni Jina AI | 990M – 1.63B | 32K | CC BY-NC (Non-commercial) | 2.27 GB Laptop or phone | |
| Supertonic 3 Supertone | 99M | – | OpenRAIL-M (Conditional) | 0.46 GB Laptop or phone | |
| Granite Embedding R2 IBM | 48M – 312M | 32K | Apache 2.0 (Permissive) | 0.115 GB Laptop or phone | |
| OpenAI Privacy Filter OpenAI | 1.4B 50M active | 128K | Apache 2.0 (Permissive) | 0.966 GB Laptop or phone | |
| MOSS-TTS-Nano OpenMOSS | 100M | – | Apache 2.0 (Permissive) | 0.276 GB Laptop or phone | |
| Gemma 4 Google DeepMind | 5.1B – 30.7B | 256K | Apache 2.0 (Permissive) | 3.52 GB Laptop or phone | |
| OmniVoice Xiaomi | 613M | – | CC BY-NC (Non-commercial) | 3.75 GB Laptop or phone | |
| VoxCPM2 OpenBMB | 2.29B | – | Apache 2.0 (Permissive) | 8 GB Laptop or phone | |
| Harrier OSS v1 Microsoft | 270M – 27B | 32K | MIT (Permissive) | 0.621 GB Laptop or phone | |
| Cohere Transcribe Cohere | 2.07B | – | Apache 2.0 (Permissive) | 4.75 GB Laptop or phone | |
| GigaChat 3.1 Lightning Sber (GigaChat) | 11.5B 1.8B active | 256K | MIT (Permissive) | 7.15 GB Laptop or phone | |
| Voxtral TTS Mistral AI | 4.09B | – | CC BY-NC (Non-commercial) | 9.2 GB Laptop or phone | |
| Chandra OCR 2 Datalab | 5.3B | 256K | OpenRAIL-M (Datalab) (Conditional) | 3.66 GB Laptop or phone | |
| Nemotron 3 Nano 4B NVIDIA | 3.97B | 256K | NVIDIA Nemotron (Permissive) | 2.74 GB Laptop or phone | |
| Jina Embeddings v5 Jina AI | 239M – 677M | 32K | CC BY-NC (Non-commercial) | 0.552 GB Laptop or phone | |
| Qwen3.5 Alibaba Qwen | 873M – 403B 17B active | 256K | Apache 2.0 (Permissive) | 0.602 GB Laptop or phone | |
| Voxtral Realtime Mistral AI | 4.43B | 128K | Apache 2.0 (Permissive) | 10 GB Laptop or phone | |
| MiniCPM-o 4.5 OpenBMB | 9.37B | 40K | Apache 2.0 (Permissive) | 11 GB Laptop or phone | |
| GLM-OCR Z.ai (Zhipu AI) | 900M | – | MIT (Permissive) | 0.621 GB Laptop or phone | |
| Qwen3-ASR Alibaba Qwen | 918M – 2.35B | – | Apache 2.0 (Permissive) | 2.12 GB Laptop or phone | |
| DeepSeek-OCR 2 DeepSeek | 3.39B | – | Apache 2.0 (Permissive) | 2.34 GB Laptop or phone | |
| ACE-Step 1.5 ACE-Step | 2B – 4B | – | MIT (Permissive) | 4 GB Laptop or phone | |
| Qwen3-TTS Alibaba Qwen | 910M – 1.92B | – | Apache 2.0 (Permissive) | 3.68 GB Laptop or phone | |
| VibeVoice-ASR Microsoft | 2.81B – 8.67B | 64K | MIT (Permissive) | 6.47 GB Laptop or phone | |
| TranslateGemma Google DeepMind | 4.3B – 27.4B | 2K | Gemma Terms (Conditional) | 2.97 GB Laptop or phone | |
| voyage-4-nano Voyage AI | 346M | 32K | Apache 2.0 (Permissive) | 0.425 GB Laptop or phone | |
| pplx-embed Perplexity | 590M – 8.4B | 32K | MIT (Permissive) | 2.76 GB Laptop or phone | |
| Pocket TTS Kyutai | 18M – 100M | – | CC BY 4.0 (Permissive) | 0.127 GB Laptop or phone | |
| Qwen3-VL-Reranker Alibaba Qwen | 2.13B – 8.77B | 32K | Apache 2.0 (Permissive) | 4.9 GB Laptop or phone | |
| Qwen3-VL-Embedding Alibaba Qwen | 2.13B – 8.14B | 32K | Apache 2.0 (Permissive) | 4.9 GB Laptop or phone | |
| Fun-CosyVoice 3 Tongyi Lab Speech Team | 500M | – | Apache 2.0 (Permissive) | 6.21 GB Laptop or phone | |
| Olmo 3.1 Allen Institute for AI (Ai2) | 7.3B – 32.2B | 64K | Apache 2.0 (Permissive) | 5.04 GB Laptop or phone | |
| Z-Image Tongyi MAI | 6.15B | – | Apache 2.0 (Permissive) | 16 GB Laptop or phone | |
| GigaAM-v3 Sber (GigaChat) | 220M – 240M | – | MIT (Permissive) | 0.506 GB Laptop or phone | |
| DeepSeek-OCR DeepSeek | 3.34B 570M active | – | MIT (Permissive) | 2.3 GB Laptop or phone | |
| Qwen3-VL Alibaba Qwen | 2.13B – 236B 22B active | 256K | Apache 2.0 (Permissive) | 1.47 GB Laptop or phone | |
| VibeVoice-TTS Microsoft | 1.02B – 2.7B | 64K | MIT (Permissive) | 2.35 GB Laptop or phone | |
| Parakeet TDT 0.6B v3 NVIDIA | 627M | – | CC BY 4.0 (Permissive) | 2.89 GB Laptop or phone | |
| gpt-oss OpenAI | 21B – 117B 5.1B active | 128K | Apache 2.0 (Permissive) | 15 GB Laptop or phone | |
| Qwen3-Embedding Alibaba Qwen | 600M – 7.57B | 32K | Apache 2.0 (Permissive) | 1.38 GB Laptop or phone | |
| Qwen3-Reranker Alibaba Qwen | 596M – 8.19B | 32K | Apache 2.0 (Permissive) | 1.37 GB Laptop or phone | |
| Qwen3 Alibaba Qwen | 752M – 235B 22B active | 32K | Apache 2.0 (Permissive) | 0.519 GB Laptop or phone | |
| Kokoro hexgrad | 82M | – | Apache 2.0 (Permissive) | 0.38 GB Laptop or phone | |
| Whisper large-v3-turbo OpenAI | 810M – 1.54B | – | MIT (Permissive) | 6 GB Laptop or phone | |
| BGE Reranker v2 m3 BAAI | 568M | 8K | Apache 2.0 (Permissive) | 2.61 GB Laptop or phone | |
| BGE-M3 BAAI | 568M | 8K | MIT (Permissive) | 2.61 GB Laptop or phone |
Gaming GPU (16 to 32 GB)
RTX 3090, 4090 or 5090, 32 GB Mac
| Model | Released | Parameters | Context | License | Smallest variant needs |
|---|---|---|---|---|---|
| Nex-N2.6 Nex-AGI | 35.1B – 1.6T | 256K | Apache 2.0 (Permissive) | 24 GB Gaming GPU | |
| Arete-27B Nous Research | 27.4B | 256K | Apache 2.0 (Permissive) | 19 GB Gaming GPU | |
| HyperFlow H3 Flash Video Rebirth | 13.7B – 13.9B | – | MiniMax H3 Community (Conditional) | 18 GB Gaming GPU | |
| P-H3-Image Pruna AI | 20B – 33.1B | – | MiniMax H3 Community (Conditional) | 21 GB Gaming GPU | |
| SenseNova-Loop-9B-Preview SenseTime | 9.66B | 256K | Apache 2.0 (Permissive) | 22 GB Gaming GPU | |
| Nemotron 3.5 Transcribe NVIDIA | 34B 4.3B active | 64K | OpenMDW-1.1 (Permissive) | 25 GB Gaming GPU | |
| Nanbeige4.3-33B Nanbeige LLM Lab | 33.1B | 512K | Apache 2.0 (Permissive) | 23 GB Gaming GPU | |
| Hy-Nomas Tencent | 8.55B | – | Apache 2.0 (Permissive) | 24 GB Gaming GPU | |
| Raon-1 mini preview KRAFTON | 28.8B 4.3B active | 256K | Apache 2.0 (Permissive) | 18 GB Gaming GPU | |
| Nemotron 3.5 Rerank 8B NVIDIA | 8.38B | 32K | OpenMDW-1.1 (Permissive) | 19 GB Gaming GPU | |
| Hy-Memory Tencent | 30.1B 3B active | 256K | Apache 2.0 (Permissive) | 20 GB Gaming GPU | |
| MemT-1.0 MemTensor | 35.1B – 288B 17B active | 256K | Apache 2.0 (Permissive) | 24 GB Gaming GPU | |
| Drama 3 Fish Audio | 35.9B 3B active | – | Fish Audio Community 1.0 (Conditional) | 25 GB Gaming GPU | |
| LFM2.5-24B-A2B Liquid AI | 24B 2.45B active | 128K | LFM Open 1.0 (Conditional) | 17 GB Gaming GPU | |
| FIBO 2.0 Bria AI | 8.13B | – | CC BY-NC (Non-commercial) | 29 GB Gaming GPU | |
| AREX-2 BAAI | 27.4B | 256K | Apache 2.0 (Permissive) | 19 GB Gaming GPU | |
| Qwen-Image-2.1 Alibaba Qwen | 7.1B | – | Qwen Research License (Non-commercial) | 20 GB Gaming GPU | |
| AuK Tencent | 1.5B | – | MIT (Permissive) | 18 GB Gaming GPU | |
| YuE2 M-A-P | 3.63B | – | CC BY-NC (Non-commercial) | 24 GB Gaming GPU | |
| SenseNova-U1.5 SenseTime | 17.5B | – | Apache 2.0 (Permissive) | 24 GB Gaming GPU | |
| Qwen3.8-27B Alibaba Qwen | 27.8B | 256K | Apache 2.0 (Permissive) | 19 GB Gaming GPU | |
| MiniMax Music 3 MiniMax | 11.1B | – | MiniMax Music3 Community (Conditional) | 24 GB Gaming GPU | |
| Nemotron 3.5 Lightning NVIDIA | 31.6B 3B active | 1M | OpenMDW-1.1 (Permissive) | 22 GB Gaming GPU | |
| Muse Glimmer Meta | 29.6B | 128K | Apache 2.0 (Permissive) | 20 GB Gaming GPU | |
| Laguna XS 2.1 Poolside | 33.4B 3B active | 256K | OpenMDW-1.1 (Permissive) | 22 GB Gaming GPU | |
| DiffusionGemma Google DeepMind | 25.2B 3.8B active | 256K | Apache 2.0 (Permissive) | 17 GB Gaming GPU | |
| Ideogram 4 Ideogram | 9.3B | – | Ideogram Non-Commercial (Non-commercial) | 19 GB Gaming GPU | |
| HiDream-O1-Image HiDream.ai | 8.8B | – | MIT (Permissive) | 20 GB Gaming GPU | |
| Laguna XS.2 Poolside | 33.4B 3B active | 256K | Apache 2.0 (Permissive) | 23 GB Gaming GPU | |
| Nemotron 3 Nano Omni NVIDIA | 31B 3B active | 256K | NVIDIA Open Model (Permissive) | 32 GB Gaming GPU | |
| Qwen3.6 Alibaba Qwen | 27.8B – 36B 3B active | 256K | Apache 2.0 (Permissive) | 19 GB Gaming GPU | |
| Nemotron 3 NVIDIA | 31.6B – 120B 12B active | 1M | NVIDIA Nemotron (Permissive) | 21 GB Gaming GPU | |
| S2 Pro Fish Audio | 4.56B | – | Fish Audio Research (Non-commercial) | 24 GB Gaming GPU | |
| Sarvam 30B and 105B Sarvam AI | 32.1B – 106B 10.3B active | 128K | Apache 2.0 (Permissive) | 22 GB Gaming GPU | |
| MOSS-TTSD OpenMOSS | 8.36B | – | Apache 2.0 (Permissive) | 19 GB Gaming GPU | |
| GLM-4.7-Flash Z.ai (Zhipu AI) | 31.2B 3B active | 198K | MIT (Permissive) | 22 GB Gaming GPU | |
| HeartMuLa HeartMuLa | 3.94B | – | Apache 2.0 (Permissive) | 26 GB Gaming GPU | |
| Qwen3-Omni Alibaba Qwen | 31.7B – 35.3B 3B active | 64K | Apache 2.0 (Permissive) | 22 GB Gaming GPU | |
| Wan 2.2 Alibaba Wan | 5B – 27B 14B active | – | Apache 2.0 (Permissive) | 24 GB Gaming GPU |
Workstation (32 to 96 GB)
RTX PRO 6000 (96 GB), several GPUs
| Model | Released | Parameters | Context | License | Smallest variant needs |
|---|---|---|---|---|---|
| Sophon-Realtime Adventists AI | 32B | – | Apache 2.0 (Permissive) | 80 GB Workstation | |
| Ripple-65B Preview Ricursive Intelligence | 64.8B | 1M | Apache 2.0 (Permissive) | 45 GB Workstation | |
| Flint Recursive | 39.8B 2.5B active | 256K | Apache 2.0 (Permissive) | 48 GB Workstation | |
| Kolibri 1 Aleph Alpha | 78B 3.5B active | 1M | Apache 2.0 (Permissive) | 54 GB Workstation | |
| Ming-Image 0.1 Design inclusionAI (Ant Group) | 6.2B | – | MIT (Permissive) | 80 GB Workstation | |
| Laguna S 2.1 Poolside | 118B 8B active | 1M | OpenMDW-1.1 (Permissive) | 81 GB Workstation | |
| Krea 2 Krea | 12.8B | – | Krea 2 Community (Conditional) | 41 GB Workstation | |
| LTX-2.3 LTX (Lightricks) | 22B | – | LTX-2 Community (Conditional) | 34 GB Workstation |
Big-memory desktop (96 to 512 GB)
Mac Studio, AMD Strix Halo, NVIDIA DGX Spark
| Model | Released | Parameters | Context | License | Smallest variant needs |
|---|---|---|---|---|---|
| MiniMax H3-Image MiniMax | 33.1B | – | MiniMax H3-Image Community (Conditional) | 155 GB Big-memory desktop | |
| ERNIE 5.5 Flash Base Baidu | 280B 14B active | 1M | ERNIE 5.5 Flash Base (Conditional) | 193 GB Big-memory desktop | |
| Sarvam Prism Sarvam AI | 105B 10.3B active | 128K | Apache 2.0 (Permissive) | 120 GB Big-memory desktop | |
| Hydrogen-1.0 Deep Principle | 753B 40B active | 1M | MIT (Permissive) | 465 GB Big-memory desktop | |
| Pika H3 Flex Pika | 33.1B | – | MiniMax H3 Community (Conditional) | 169 GB Big-memory desktop | |
| MiniMax M3.1 Flash MiniMax | 428B 23B active | 1M | MiniMax Community (Conditional) | 277 GB Big-memory desktop | |
| Reflection Beam Reflection AI | 501B 23.4B active | 1M | Apache 2.0 (Permissive) | 323 GB Big-memory desktop | |
| Step 5 Preview StepFun | 604B 27B active | 1M | StepFun 1.0 (Conditional) | 417 GB Big-memory desktop | |
| Ling-3.1-flash inclusionAI (Ant Group) | 560B 25B active | 1M | MIT (Permissive) | 386 GB Big-memory desktop | |
| GLM-5.3-Flash Z.ai (Zhipu AI) | 320B 18B active | 1M | MIT (Permissive) | 221 GB Big-memory desktop | |
| Qwen3.8-Flash-Next Alibaba Qwen | 180B 6B active | 256K | Qwen Community 1.0 (Conditional) | 124 GB Big-memory desktop | |
| MiniMax H3 MiniMax | 33.1B | – | MiniMax H3 Community (Conditional) | 166 GB Big-memory desktop | |
| Motif 3 Motif Technologies | 314B 13.2B active | 256K | MIT (Permissive) | 206 GB Big-memory desktop | |
| A.X K2 SK Telecom | 688B 33B active | 256K | Apache 2.0 (Permissive) | 438 GB Big-memory desktop | |
| Solar Open 2 Upstage | 250B 15B active | 1M | Upstage Solar (Conditional) | 157 GB Big-memory desktop | |
| Inkling Thinking Machines Lab | 276B – 975B 41B active | 1M | Apache 2.0 (Permissive) | 188 GB Big-memory desktop | |
| GigaChat 3.5 Ultra Sber (GigaChat) | 434B – 438B 28B active | 256K | MIT (Permissive) | 299 GB Big-memory desktop | |
| Hy3 Tencent | 295B 21B active | 256K | Apache 2.0 (Permissive) | 204 GB Big-memory desktop | |
| Laguna M.1 Poolside | 226B 23.4B active | 256K | Apache 2.0 (Permissive) | 153 GB Big-memory desktop | |
| Nemotron 3 Ultra NVIDIA | 550B 55B active | 1M | OpenMDW-1.1 (Permissive) | 379 GB Big-memory desktop | |
| MiniMax M3 MiniMax | 428B 23B active | 1M | MiniMax Community (Conditional) | 295 GB Big-memory desktop | |
| Step 3.7 Flash StepFun | 201B 11B active | 256K | Apache 2.0 (Permissive) | 120 GB Big-memory desktop | |
| Command A+ Cohere | 218B 25B active | 128K | Apache 2.0 (Permissive) | 145 GB Big-memory desktop | |
| DeepSeek V4 DeepSeek | 284B – 1.6T 49B active | 1M | MIT (Permissive) | 176 GB Big-memory desktop | |
| MiniMax-M2.7 MiniMax | 229B 10B active | 200K | MiniMax M2.7 NC (Non-commercial) | 158 GB Big-memory desktop | |
| MiniMax-M2.5 MiniMax | 229B 10B active | 192K | MiniMax Model (Conditional) | 158 GB Big-memory desktop | |
| Step 3.5 Flash StepFun | 199B 11B active | 256K | Apache 2.0 (Permissive) | 120 GB Big-memory desktop | |
| DeepSeek-V3.2 DeepSeek | 685B 37B active | 160K | MIT (Permissive) | 473 GB Big-memory desktop |
GPU server (512 GB to 1.5 TB)
8x H100, H200 or B200 node
| Model | Released | Parameters | Context | License | Smallest variant needs |
|---|---|---|---|---|---|
| LongCat-2.5 Meituan | 1.6T 48B active | 1M | MIT (Permissive) | 1.1 TB GPU server | |
| Mistral Large 4 Mistral AI | 1.05T 52B active | 1M | Mistral Open-Weight (Conditional) | 671 GB GPU server | |
| Muse Spark Open Meta | 816B 42B active | 1M | Muse Model License (Conditional) | 563 GB GPU server | |
| DeepSeek V4.1 Flash DeepSeek | 552B 16B active | 1M | MIT (Permissive) | 561 GB GPU server | |
| GLM-5.3 Z.ai (Zhipu AI) | 753B 40B active | 1M | GLM-5.3 License (Conditional) | 520 GB GPU server | |
| Hy4 preview Tencent | 770B 49B active | 1M | Apache 2.0 (Permissive) | 531 GB GPU server | |
| K-EXAONE 2.0 LG AI Research | 750B 37B active | 256K | Apache 2.0 (Permissive) | 518 GB GPU server | |
| GLM-5.2 Z.ai (Zhipu AI) | 753B 40B active | 1M | MIT (Permissive) | 520 GB GPU server | |
| Kimi K2.7 Code Moonshot AI | 1.03T 32B active | 256K | Modified MIT (Conditional) | 655 GB GPU server | |
| Kimi K2.6 Moonshot AI | 1.03T 32B active | 256K | Modified MIT (Conditional) | 655 GB GPU server | |
| GLM-5.1 Z.ai (Zhipu AI) | 754B 40B active | 198K | MIT (Permissive) | 520 GB GPU server | |
| GLM-5 Z.ai (Zhipu AI) | 754B 40B active | 198K | MIT (Permissive) | 520 GB GPU server | |
| Kimi K2.5 Moonshot AI | 1.03T 32B active | 256K | Modified MIT (Conditional) | 655 GB GPU server |
Multi-node cluster (over 1.5 TB)
Several GPU servers working together
| Model | Released | Parameters | Context | License | Smallest variant needs |
|---|---|---|---|---|---|
| Kimi K3.1 Pro Moonshot AI | 2.8T 104B active | 1M | Kimi K3 License (Conditional) | 1.72 TB Multi-node cluster | |
| Qwen3.8-Max Alibaba Qwen | 2.45T 95B active | 1M | Qwen3.8-Max License (Conditional) | 1.69 TB Multi-node cluster | |
| Kimi K3 Moonshot AI | 2.8T 104B active | 1M | Kimi K3 License (Conditional) | 1.72 TB Multi-node cluster |
How we chose
- For language models, the figure is the smallest variant at 4-bit precision plus about 15% overhead, unless the developer states a minimum.
- For image, video and speech models, the figure is a stated or measured minimum, or the full download size plus about 15%.
- Long contexts and many simultaneous users need more memory than these figures.