Ollama
Ollama is a highly popular, open-source local LLM runner that allows developers to run leading open-weights models like Llama and Gemma entirely offline on local consumer hardware. By providing a clean local API endpoint, it has become the gold standard for privacy-first AI application development.