KoboldCpp
A single-file app that runs GGUF models with a built-in web UI, and also generates images, video, speech and music.
KoboldCpp is free, open-source software for running GGUF language models on your own computer. It is built on llama.cpp and inspired by KoboldAI, and it ships as one executable with no installation: ready-to-run downloads exist for Windows, Linux and macOS on Apple Silicon. You download a GGUF model separately, pick it in the launcher and open the bundled KoboldAI Lite web UI in your browser at localhost:5001.
Beyond text, the README lists image generation and editing (Stable Diffusion, SDXL, Flux, Qwen Image, Z-Image and others), video generation (Wan 2.2, LTX 2.3 and MiniMax H3), speech-to-text with Whisper, text-to-speech including Qwen3-TTS, and music generation. It also offers MCP server support, tool calling, web search, an integrated agent, and endpoints that are compatible with the KoboldAI, OpenAI and Ollama APIs.
It began as a tool for story writing and role-play, and the memory, world-info and character-card features for that remain a strength. The license is AGPL-3.0, which asks you to share your changes if you offer a modified version to users over a network. The README also warns that koboldcpp.com is a fake site: only the GitHub releases and koboldcpp.net are official.
Good for
- Running a GGUF model without installing anything
- Story writing and role-play with a rich built-in interface
- One app for text, images, speech and more
- Connecting other apps through KoboldAI-, OpenAI- or Ollama-style endpoints
Watch out for
- Intel Macs need a build from source, because the macOS download is for Apple Silicon
- Use only the official downloads from GitHub or koboldcpp.net, since the README warns about a fake website
- The AGPL-3.0 license has sharing duties if you modify it and offer it over a network