← Back to Skills Marketplace
Ollama Proxy
by
Twin Geeks
· GitHub ↗
· v1.0.3
· MIT-0
169
Downloads
3
Stars
2
Active Installs
4
Versions
Install in OpenClaw
/install ollama-proxy
Description
Ollama proxy — one endpoint that routes to multiple Ollama instances. Drop-in Ollama proxy replacement for localhost:11434. Same Ollama API, same model names...
Usage Guidance
What to check before installing/run: 1) Confirm the PyPI package and upstream source (https://github.com/geeks-accelerator/ollama-herd) — inspect the package code or repository history for anything unexpected before pip installing. 2) Note the inconsistency: the SKILL.md metadata references local config/log paths (~/.fleet-manager/...), but the registry shows no required config paths — expect the tool to create/read those files. 3) Ensure python3/pip are available on machines where you run the proxy/node; the registry's required-binaries list only mentions curl/wget, so verify the environment. 4) The proxy does local network discovery and will route traffic between machines — only run on trusted networks and consider running first in an isolated environment. 5) If you need stronger assurance, ask the publisher for a reproducible install method or a signed release; reviewing the PyPI package contents or building from source will reduce risk. Additional information that would change this assessment to 'benign': registry metadata updated to declare the config paths and python/pip requirements, and a link to a reviewed repository/release that you (or your security team) have inspected.
Capability Analysis
Type: OpenClaw Skill
Name: ollama-proxy
Version: 1.0.3
The skill provides documentation and instructions for using 'ollama-herd', a legitimate open-source load balancer and proxy for Ollama instances. The SKILL.md file contains standard usage examples, links to the official GitHub repository (geeks-accelerator/ollama-herd), and explicit safety guardrails for the AI agent, such as instructions to never modify configuration files in '~/.fleet-manager/' without authorization. No malicious code, data exfiltration patterns, or harmful prompt injections were identified.
Capability Assessment
Purpose & Capability
The name/description (a proxy that routes to multiple Ollama instances) aligns with the instructions: pip installing ollama-herd, running 'herd' (proxy) and 'herd-node' (agents). This is a reasonable set of capabilities for the stated purpose.
Instruction Scope
SKILL.md tells users to install the Python package from PyPI and run herd/herd-node which perform network discovery, scoring, logging, and local tracing. That behavior fits the proxy's purpose. However, the SKILL.md's embedded metadata lists config paths (~/.fleet-manager/latency.db, ~/.fleet-manager/logs/herd.jsonl) that imply the skill will read/write local files, but the registry metadata above the skill claims 'Required config paths: none' — an inconsistency to verify.
Install Mechanism
This is an instruction-only skill that tells the user to 'pip install ollama-herd' from PyPI (a standard, public registry). There is no automatic installer declared by the skill itself. Using PyPI is expected for a Python-based tool; risk is moderate but typical for such packages.
Credentials
No environment variables or credentials are requested in the registry metadata and the examples show 'api_key="not-needed"'. That is proportional. Minor mismatch: the SKILL.md metadata marks python3/pip as optionalBins while the runtime instructs 'pip install' and running 'herd' which do require Python/pip on hosts — the required binaries list in the registry only lists curl/wget (for examples) which should be clarified.
Persistence & Privilege
The skill is not marked always:true and does not request system-wide privileges in the registry. The proxy runs as a separate process (herd) and stores logs/traces locally per the SKILL.md — this is expected behavior for a fleet manager and not an overreach by itself.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install ollama-proxy - After installation, invoke the skill by name or use
/ollama-proxy - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.3
Added /api/pull to drop-in compatibility examples
v1.0.2
Cross-platform support: macOS, Linux, and Windows. Updated OS metadata, descriptions, and hardware recommendations.
v1.0.1
- Updated documentation for clarity; replaced references to "proxy" with "Ollama proxy" and consistently branded features and examples.
- Expanded multilingual description, mentioning "Ollama代理 | proxy Ollama."
- Clarified setup, API usage, and endpoint instructions with explicit Ollama proxy naming.
- Improved feature comparison tables, tool integration notes, and routing explanations for easier understanding.
- No changes to code or functionality—documentation only.
v1.0.0
Ollama-proxy 1.0.0 — Initial release
- Provides a single, drop-in API endpoint to route requests to multiple Ollama instances across your network.
- Auto-discovers Ollama nodes and intelligently routes based on realtime signals like queue depth, memory, health, and model availability.
- Full Ollama API and OpenAI-compatible endpoint supported; switch by changing your base URL.
- Aggregates models and routing decisions fleet-wide, enables seamless failover and load balancing.
- Real-time dashboard, health checks, and detailed request tracing included.
- No data leaves your network; explicit confirmation required for model downloads and deletions.
Metadata
Frequently Asked Questions
What is Ollama Proxy?
Ollama proxy — one endpoint that routes to multiple Ollama instances. Drop-in Ollama proxy replacement for localhost:11434. Same Ollama API, same model names... It is an AI Agent Skill for Claude Code / OpenClaw, with 169 downloads so far.
How do I install Ollama Proxy?
Run "/install ollama-proxy" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Ollama Proxy free?
Yes, Ollama Proxy is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Ollama Proxy support?
Ollama Proxy is cross-platform and runs anywhere OpenClaw / Claude Code is available (darwin, linux, windows).
Who created Ollama Proxy?
It is built and maintained by Twin Geeks (@twinsgeeks); the current version is v1.0.3.
More Skills