Ollama

Ollama is a tool for running large language models locally on your own hardware. It provides a simple command-line interface and a REST API compatible with the OpenAI API format, making it straightforward to pull, run, and switch between models from a growing library. Models run entirely on your machine, with no data sent to external services.

The platform integrates with thousands of applications and developer tools — including coding assistants, RAG pipelines, document processing workflows, and AI chat interfaces — through its API layer. Custom models can be created and shared using a Modelfile format similar to a Dockerfile, and multi-modal models that handle text and images are supported.

Ollama is aimed at developers, researchers, and organisations who want to run AI inference locally for privacy, cost control, or offline use, and who need a straightforward way to manage and serve multiple models without complex infrastructure setup.