Windows

Note: Qwen 3 coder is a 30B parameter model requiring at least 24GB of VRAM to run smoothly. More is required for longer context lengths.

Note: Qwen 3 coder is a 30B parameter model requiring at least 24GB of VRAM to run smoothly. More is required for longer context lengths.

Available Resources

Usage

Using with Claude Code

Endpoints

Models

Differences from the Anthropic API

Signing in

API keys

Status codes

Error messages

Errors that occur while streaming

Get started

Base URL

Example request

Libraries

• Python

  • URL: https://github.com/ollama/ollama-python

• JavaScript

  • URL: https://github.com/ollama/ollama-js

Versioning

Usage

Endpoints

Models

Disabling streaming

When to use streaming vs non-streaming

Example response

Recommended models

• embeddinggemma

  • URL: https://ollama.com/library/embeddinggemma

• qwen3-embedding

  • URL: https://ollama.com/library/qwen3-embedding

• all-minilm

  • URL: https://ollama.com/library/all-minilm

Generate embeddings

Generate a batch of embeddings

Tips

Key streaming concepts

Handling streamed chunks

Generating structured JSON

Generating structured JSON with a schema

Example: Extract structured data

Example: Vision with structured outputs

Tips for reliable structured outputs

Supported models

• Qwen 3

  • URL: https://ollama.com/library/qwen3

• GPT-OSS

  • URL: https://ollama.com/library/gpt-oss

• DeepSeek-v3.1

  • URL: https://ollama.com/library/deepseek-v3.1

• DeepSeek R1

  • URL: https://ollama.com/library/deepseek-r1

• thinking models

  • URL: https://ollama.com/search?c=thinking

Enable thinking in API calls

Stream the reasoning trace

CLI quick reference

Calling a single tool

Parallel tool calling

Multi-turn tool calling (Agent loop)

Tool calling with streaming

Using functions as tools with Ollama Python SDK

Quick start

Usage with Ollama's API

Authentication

Web search API

Web fetch API

Building a search agent

MCP Server

Cloud Models

Cloud API access

Local only

Setting context length

CPU only

Nvidia GPU

• Link: Configure the repository

curl -fsSL  \
    | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg
curl -fsSL https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list \
    | sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' \
    | sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
sudo apt-get update

• URL: https://nvidia.github.io/libnvidia-container/gpgkey

• Link: Configure the repository

curl -fsSL  \
    | sudo tee /etc/yum.repos.d/nvidia-container-toolkit.repo

• URL: https://nvidia.github.io/libnvidia-container/stable/rpm/nvidia-container-toolkit.repo

AMD GPU

Vulkan Support

Run model locally

Try different models

How can I upgrade Ollama?

How can I view the logs?

Is my GPU compatible with Ollama?

How can I specify the context window size?

How can I tell if my model was loaded onto the GPU?

How do I configure Ollama server?

How do I use Ollama behind a proxy?

Does Ollama send my prompts and answers back to ollama.com?

How do I disable Ollama's cloud features?

How can I expose Ollama on my network?

How can I use Ollama with a proxy server?

How can I use Ollama with ngrok?

How can I use Ollama with Cloudflare Tunnel?

How can I allow additional web origins to access Ollama?

Where are models stored?

How can I use Ollama in Visual Studio Code?

How do I use Ollama with GPU acceleration in Docker?

Why is networking slow in WSL2 on Windows 10?

How can I preload a model into Ollama to get faster response times?

How do I keep a model loaded in memory or make it unload immediately?

How do I manage the maximum number of requests the Ollama server can queue?

How does Ollama handle concurrent requests?

How does Ollama load models on multiple GPUs?

How can I enable Flash Attention?

How can I set the quantization type for the K/V cache?

Where can I find my Ollama Public Key?

• Ollama Cloud

  • URL: https://ollama.com/cloud

• https://ollama.com/settings/keys

  • URL: https://ollama.com/settings/keys

How can I stop Ollama from starting when I login to my computer?

Nvidia

AMD Radeon

Metal (Apple GPUs)

Vulkan GPU Support

• https://dgpu-docs.intel.com/driver/client/overview.html

  • URL: https://dgpu-docs.intel.com/driver/client/overview.html

• https://amdgpu-install.readthedocs.io/en/latest/install-script.html#specifying-a-vulkan-implementation

  • URL: https://amdgpu-install.readthedocs.io/en/latest/install-script.html#specifying-a-vulkan-implementation

Table of Contents

• Importing a Safetensors adapter

  • URL: #Importing-a-fine-tuned-adapter-from-Safetensors-weights

• Importing a Safetensors model

  • URL: #Importing-a-model-from-Safetensors-weights

• Importing a GGUF file

  • URL: #Importing-a-GGUF-based-model-or-adapter

• Sharing models on ollama.com

  • URL: #Sharing-your-model-on-ollamacom

Importing a fine tuned adapter from Safetensors weights

• fine tuning framework

  • URL: https://huggingface.co/docs/transformers/en/training

• Unsloth

  • URL: https://github.com/unslothai/unsloth

• MLX

  • URL: https://github.com/ml-explore/mlx

Importing a model from Safetensors weights

Importing a GGUF based model or adapter

Quantizing a Model

Sharing your model on ollama.com

Libraries

Community

Install

Usage with Ollama

Recommended Models

Install

Usage with Ollama

Connecting to ollama.com

• API key

  • URL: https://ollama.com/settings/keys

• Link: Click on

  Use custom base URL

  and set it to `
  • URL: https://ollama.com`

Install

Usage with Ollama

Connecting to ollama.com

Install

Usage with Ollama

Cloud Models

Connecting to ollama.com

• API key

  • URL: https://ollama.com/settings/keys

• Link: Add the cloud configuration block to

  ~/.factory/config.json

  :

{
  "custom_models": [
    {
      "model_display_name": "qwen3-coder [Ollama Cloud]",
      "model": "qwen3-coder:480b",
      "base_url": "
      "api_key": "OLLAMA_API_KEY",
      "provider": "generic-chat-completion-api",
      "max_tokens": 128000
    }
  ]
}

• URL: https://ollama.com/v1/",

Goose Desktop

• Link: Confirm API Host is ` and click Submit

  • URL: http://localhost:11434`

• API key

  • URL: https://ollama.com/settings/keys

• Link: In Goose, set API Host to `

  • URL: https://ollama.com`

Goose CLI

• API key

  • URL: https://ollama.com/settings/keys

• Link: Update OLLAMA_HOST to `

  • URL: https://ollama.com`

Coding Agents

• Claude Code

  • URL: /integrations/claude-code

• Codex

  • URL: /integrations/codex

• OpenCode

  • URL: /integrations/opencode

• Droid

  • URL: /integrations/droid

• Goose

  • URL: /integrations/goose

• Pi

  • URL: /integrations/pi

Assistants

• OpenClaw
  • URL: /integrations/openclaw

IDEs & Editors

• VS Code

  • URL: /integrations/vscode

• Cline

  • URL: /integrations/cline

• Roo Code

  • URL: /integrations/roo-code

• JetBrains

  • URL: /integrations/jetbrains

• Xcode

  • URL: /integrations/xcode

• Zed

  • URL: /integrations/zed

Chat & RAG

• Onyx
  • URL: /integrations/onyx

Automation

• n8n
  • URL: /integrations/n8n

Notebooks

• marimo
  • URL: /integrations/marimo

Install

Usage with Ollama

• Link: Confirm the Host URL is ` then click Ok
  • URL: http://localhost:11434`,

Install

Usage with Ollama

• Link: In marimo, go to the user settings and go to the AI tab. From here you can find and configure Ollama as an AI provider. For local use you would typically point the base url to `
  • URL: http://localhost:11434/v1`.

Connecting to ollama.com

Install

Using Ollama Locally

• Link: Confirm Base URL is set to

  if running locally or

  http://host.docker.internal:11434` if running through docker and click Save
  • URL: http://localhost:11434`

Connecting to ollama.com

• API key

  • URL: https://ollama.com/settings/keys

• Link: Set the API URL to `

  • URL: https://ollama.com`

Overview

Install Onyx

Usage with Ollama

• Link: Provide your Ollama API URL and select your models. <Note>If you're running Onyx in Docker, to access your computer's local network use

  instead of

  http://127.0.0.1`.</Note>
  • URL: http://host.docker.internal`

Send your first query

Quick start

Configure without launching

Recommended models

Connect messaging apps

Stopping the gateway

Install

Usage with Ollama

Cloud Models

Connecting to ollama.com

• API key
  • URL: https://ollama.com/settings/keys

Install

Usage with Ollama

Install

Usage with Ollama

• Link: (Optional) Update

  Base URL

  if your Ollama instance is running remotely. The default is `
  • URL: http://localhost:11434`

Connecting to ollama.com

• API key

  • URL: https://ollama.com/settings/keys

• Link: Enable

  Use custom base URL

  and set it to `
  • URL: https://ollama.com`

Install

Usage with Ollama

Install

Usage with Ollama

Connecting to ollama.com directly

• API key

  • URL: https://ollama.com/settings/keys

• Link: Select Internet Hosted and enter URL as `

  • URL: https://ollama.com`

Install

Usage with Ollama

• Link: Confirm the Host URL is ` then click Connect
  • URL: http://localhost:11434`,

Connecting to ollama.com

• API key

  • URL: https://ollama.com/settings/keys

• Link: Set the API URL to `

  • URL: https://ollama.com`

Install

Manual install

Customizing

Updating

Installing specific versions

Viewing logs

Uninstall

System Requirements

Filesystem Requirements

Troubleshooting

Uninstall

Table of Contents

• Format

  • URL: #format

• Examples

  • URL: #examples

• Instructions

  • URL: #instructions

• Notes

  • URL: #notes

Format

Examples

Instructions

Notes

Get Started

Assistants

Coding

API

LLM libraries

Installing older or pre-release versions on Linux

Linux tmp noexec

Linux docker

NVIDIA GPU Discovery

AMD GPU Discovery

Multiple AMD GPUs

• https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/native\_linux/mgpu.html#mgpu-known-issues-and-limitations
  • URL: https://rocm.docs.amd.com/projects/radeon/en/latest/docs/install/native_linux/mgpu.html#mgpu-known-issues-and-limitations

Windows Terminal Errors

System Requirements

• https://www.amd.com/en/support
  • URL: https://www.amd.com/en/support

Filesystem Requirements

API Access

Troubleshooting

Uninstall

Standalone CLI

How to Use This Skill

Reference these resources when working with Windows.