CodeVetter · Repo Unpack · Feature catalog

ollama/ollama

Scanned commit 6383a0fa9c dated 2026-09-18 — last upstream commit. Generated by codevetter codevetter 1.12.0 on 2026-09-22. Deep analysis by swe-2 via the devin CLI on 2026-09-22 (runtime not recorded).

User-facing surface = CLI subcommands + REST endpoints + OpenAI/Anthropic compat shims + a desktop chat app. Features cover the full model lifecycle (pull/create/push/copy/show/list/ps/delete), inference (generate/chat/embed with streaming NDJSON, thinking, tools, vision/audio, structured output, logprobs), cloud remote inference on ollama.com, experimental web search/fetch, and Codex Desktop integration via a loopback proxy.

CLI commands: create, show, run, stop, serve (alias start), pull, push, signin/login, signout/logout, list, ps, cp, rm; hidden commands `runner` (MLX runner entrypoint) and `gpu-discover`
cmd/cmd.go#L2393-L2595
Native API endpoints: /api/generate, /api/chat, /api/embed, /api/embeddings, /api/pull, /api/push, /api/tags (GET+HEAD), /api/show, /api/delete, /api/create, /api/blobs/:digest (POST+HEAD), /api/copy, /api/ps, /api/me, /api/signout, /api/version, /api/status
server/routes.go#L1892-L1930
OpenAI-compatible endpoints /v1/chat/completions, /v1/completions, /v1/embeddings, /v1/models(+/:model), /v1/responses(+ /compact), /v1/audio/transcriptions are middleware translators over the native handlers
server/routes.go#L1932-L1943 middleware/openai.go#L27-L80 openai/openai.go#L1-L30
Anthropic compatibility is provided by POST /v1/messages -> middleware.AnthropicMessagesMiddleware -> ChatHandler
server/routes.go#L1945-L1946 middleware/anthropic.go anthropic/anthropic.go
`ollama create` supports two paths: classic Modelfile+API (parser.ParseFile -> CreateRequest -> blob upload -> /api/create) and in-process safetensors import with --quantize/--draft-quantize/--force when the server is local (OLLAMA_CREATE_REMOTE forces remote)
cmd/cmd.go#L220-L315 cmd/cmd.go#L317-L400 parser/parser.go#L56-L120 create/create.go#L22-L100
Chat features include thinking control (think bool or level; --think/--hidethinking flags), tool calling via api.Tools parsed by model parsers, vision/audio inputs (ImageData, MediaKind), and shift/truncate context management options
api/types.go#L104-L120 cmd/cmd.go#L830-L855 llm/server.go#L156-L228 model/parsers/parsers.go#L12-L24
Structured output: GenerateRequest.Format accepts a JSON schema which is passed to llama-server's json_schema field; a built-in BNF grammarJSON exists for generic JSON mode
api/types.go#L89-L91 llm/llama_server.go#L8-L10 llm/llama_server.go#L52-L73
Cloud/remote models: models whose Config has RemoteHost+RemoteModel are proxied by ChatHandler to remoteURL via api.NewClient, gated by envconfig.Remotes() allowlist and OLLAMA_NO_CLOUD; :cloud model refs take cloudPassthroughMiddleware on /v1 routes (inferred)
server/routes.go#L2555-L2621 server/routes.go#L1935-L1946 envconfig/config.go#L166-L177 internal/cloud/policy.go
Experimental endpoints: POST /api/experimental/web_search, /api/experimental/web_fetch, GET /api/experimental/model-recommendations served from a stale-while-revalidate modelCaches.recommendations
server/routes.go#L1921-L1923 server/routes.go#L1951-L1967 middleware/web_search.go
A loopback-only Codex Desktop reverse proxy is mounted at /api/codex/* (proxy.CodexDesktopPathPrefix) to route between native Ollama models and Codex upstreams, with request logging via writeActivity
server/routes.go#L1898-L1900 internal/proxy/codex_desktop.go#L28-L30 internal/proxy/codex_desktop.go#L157-L163 internal/proxy/codex_desktop.go#L645-L657
Model auth uses an ed25519 keypair at ~/.ollama/id_ed25519 generated on serve start (initializeKeypair); registry challenge-response tokens are obtained via signed nonce requests (getAuthorizationToken)
cmd/cmd.go#L2101-L2163 server/auth.go#L22-L100
Interactive UX: bare `ollama` launches a Bubbletea TUI (runInteractiveTUI + welcome flow via cmd/launch + cmd/tui); `ollama run` without prompt enters readline-based interactive session; selectors/sign-in/upgrade prompts are injected as launch.Default* hooks
cmd/cmd.go#L62-L99 cmd/cmd.go#L2400-L2414 cmd/interactive.go
Separate `bench` main package under cmd/bench provides a benchmarking CLI hitting the API (used by CI bench step)
cmd/bench/bench.go .github/workflows/test.yaml#L451-L455