Ollama

run large language models locally

Ollama lets you get up and running with large language models such as Llama, Mistral, Gemma and others on your own machine. It bundles model weights, configuration and a runtime into a single tool and exposes both a command-line interface and a local HTTP API. https://ollama.com/ Utility