Ollama

Run open-source LLMs locally with a simple CLI. Supports LLaMA, Mistral, Gemma, and many more models.