Guides
Written for people who are new to this, and checked so that experts do not wince.
- What is an open-source AI model? A plain-English guide
An open AI model is one you can download and run yourself. Learn what open weights and open source mean, what you can do with these models and how to start safely.
- Open weights vs open source AI: what is the difference?
Open weights means a model's trained parameters can be downloaded. Open-source AI, as the OSI defines it, also needs code and training-data information. Here is why it matters.
- AI model licenses explained: can you use an open model commercially?
A plain-English guide to open AI licenses: Apache 2.0, MIT, community licenses with revenue caps, research-only terms and gated downloads, plus a checklist to run before you ship.
- How much memory do I need to run an AI model? A simple guide
Estimate the VRAM or RAM an open AI model needs: the parameters-times-bytes rule, what quantization saves, why context length and mixture of experts matter, with worked tables.
- How to run an AI model on your own computer
A beginner's walkthrough for running open language models locally with Ollama or LM Studio: check your memory, pick a model, run it and connect other apps to it.
- Quantization explained: Q4, FP8, GGUF and what you give up
Quantization shrinks a model by storing its weights with fewer bits. Learn what FP8, INT4, Q4_K_M, GGUF, MXFP4 and NVFP4 mean, how much they save and how to pick one.
- How to choose an open AI model: a practical decision guide
Choose an open model by task, hardware, license and capabilities. A step-by-step decision guide with shortlists for chat, coding, documents, images, video, speech, music, translation and search.
- Fine-tuning an open model for beginners: LoRA, QLoRA and when you need it
Learn when to fine-tune an open AI model instead of prompting or using RAG, how LoRA and QLoRA cut the cost, what data you need and what to check in the license.
- How to evaluate AI models yourself: look past the benchmark charts
Benchmark scores in model announcements are mostly self-reported. Learn how to build a small test set, compare models fairly and judge quality, speed, memory and license for your task.
- Running image and video AI models locally: ComfyUI, memory and licenses
How to run open image and video generators such as FLUX, Z-Image, Krea 2, MOSS-Image, Anima, Wan, LTX and Cosmos 3 on your own GPU: ComfyUI basics, memory, offloading, LoRAs and license checks.
- How to choose an open-source OCR model for PDFs and scans
Compare open OCR and document-parsing models by size, license, language and tooling, and find out which one fits invoices, long PDFs, Chinese pages or a laptop.
- How to choose an open-source embedding model for search and RAG
Pick an open embedding model by language, input length, modality, size and license, and compare BGE-M3, Qwen3-Embedding, EmbeddingGemma 2, Granite Embedding R2 and more.
- How to choose an open-source text-to-speech model
Compare open text-to-speech models by languages, latency, voice cloning and license: Qwen3-TTS, VoxCPM2, Fun-CosyVoice3, OmniVoice, Voxtral TTS, Chatterbox and tiny CPU models like Kokoro.
- How to choose an open-source speech-to-text model
Compare open speech-to-text models by languages, live streaming, speaker labels, memory and license: Whisper large-v3-turbo, Qwen3-ASR, Voxtral Realtime, VibeVoice-ASR and more.
- How to choose a runner or inference engine for open models
Ollama, LM Studio, llama.cpp, MLX-LM, vLLM, SGLang, TensorRT-LLM and KTransformers compared: which tool fits a laptop, a Mac, a phone, a home server or a production API.
- Self-hosting an open model vs using an API: how to decide
Should you run an open model yourself or call a hosted API? Compare privacy, cost structure, hardware, licenses and maintenance, with a checklist and real memory figures.
- How to pick an open model for a coding agent
Choose an open model for agentic coding: what to check (tool calling, context, memory, license), which models fit one GPU or a server, and how to test them on your own repository.
- How to choose an open-source translation model
Compare open translation models by language coverage, license, size and instruction support, and find which one fits documents, subtitles, Japanese, images or a laptop.
- How to choose an open-source music generation model
Compare open music and sound models by what they make, hardware and license: MiniMax Music 3, YuE2, ACE-Step 1.5, HeartMuLa, Stable Audio 3, Magenta RealTime 2 and MOSS-SoundEffect.