Ollama Setup

Ollama runs LLMs locally. No API key, fully offline. It is currently the only supported backend for ai.*.

Install Ollama

# macOS
brew install ollama

# Or download from https://ollama.com

Pull a model

ollama pull gemma4                  # general-purpose
ollama pull mistral:7b-instruct     # smaller, fast for classification

Start the server

ollama serve

Default address: http://localhost:11434.

Configure Keel

# Use one model for everything
export KEEL_OLLAMA_MODEL=gemma4
keel run agent.keel

Per-model aliases

If your program uses @model "fast" or using: "smart", map those aliases to Ollama tags:

export KEEL_MODEL_FAST=gemma4
export KEEL_MODEL_SMART=mistral:7b-instruct

Then in your program:

urgency = ai.classify(email.body, as: Urgency, using: "fast")
reply   = ai.draft("response to {email}", using: "smart")

Custom host

export OLLAMA_HOST=http://192.168.1.100:11434
keel run agent.keel

Verify

KEEL_OLLAMA_MODEL=gemma4 keel run examples/hello_world.keel

Expected output:

⚡ LLM provider: Ollama (http://localhost:11434)
   * → gemma4
▸ Starting agent LocalTest
  🤖 Classifying as [happy, neutral, sad] using gemma4 (ollama @ ...)
  ✓ Result: happy