Ollama
Ollama runs large language models (LLMs) like Llama, Mistral and Gemma locally, on your own hardware, with a single command. It's the foundation for private AI at home: nothing goes to the cloud, no per-token cost, and it works offline.
Project summary: Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
- Stars
- 174,743
- License
- MIT
- Platform
- Docker, Python
- Version
- v0.30.10
Similar alternatives
Open-WebUI
★ 142,641Open WebUI is a ChatGPT-like chat interface for LLMs that connects to Ollama or any OpenAI-compatible API. Hosted by you, it becomes a private ChatGPT for your family or team, with history and users under your control.
LobeHub
★ 78,968LobeChat (LobeHub) is a modern AI chat interface supporting multiple models, plugins and custom assistants. Hosted by you, it offers a ChatGPT-like experience with your own providers and full conversation privacy.
AnythingLLM
★ 61,942AnythingLLM is a full AI application that chats with your documents (RAG), with agents and multiple models. Self-hosted, it becomes a private AI knowledge base for you or your team.
LocalAI
★ 47,061LocalAI runs AI models (text, image, audio) locally, with an API compatible with OpenAI's. Self-hosted, it's a drop-in replacement to run AI without sending data to the cloud or paying per token.
LibreChat
★ 39,643LibreChat is a ChatGPT-style chat interface that connects multiple AI providers, with multi-user, search and plugins. Self-hosted, it centralizes LLM access with your data kept private.
Vane
★ 35,412AI-powered search engine (alternative to Perplexity AI).