← 返回 Skills 市场
chapati23

Skill

作者 chapati · GitHub ↗ · v1.0.0
cross-platform ⚠ suspicious
329
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install llm-speedtest
功能描述
Ping major LLM providers in parallel and compare real API latency. Run with /ping
使用说明 (SKILL.md)

LLM Speedtest

Ping major LLM providers in parallel and compare real API latency (TTFT).

When to Use

  • User types /ping or asks about model latency/speed
  • Comparing provider response times
  • Checking if a specific provider is slow or down

How It Works

Runs scripts/ping.sh which:

  1. Retrieves API keys from pass shared/ (users may need to adapt key sourcing for their setup)
  2. Fires parallel curl requests to each provider with a minimal prompt ("hi", max_tokens=1)
  3. Measures total round-trip time per provider
  4. Sorts results by latency and displays with color badges

Output Format

Results are sorted fastest-to-slowest with color badges:

  • 🟢 \x3C 2s — Fast
  • 🟡 2–5s — Normal
  • 🔴 5–30s — Slow
  • 30s — Timeout

Example:

⚡ Model Latency — 14:32

🟢 `Gemini       412ms`
🟢 `GPT-4o       623ms`
🟢 `Sonnet       891ms`
🟡 `Grok        2104ms`
🟡 `MiniMax     3210ms`
🟡 `Opus        4102ms`

_real API latency (TTFT)_

Models Tested

Provider Model
Anthropic Claude Sonnet 4
Anthropic Claude Opus 4
OpenAI GPT-4o-mini
Google Gemini 2.5 Flash
MiniMax MiniMax-M1
xAI Grok 3 Mini Fast

Cost

~$0.0001 per run (1 token per model, cheapest tiers).

Note

This skill uses pass shared/ for API key retrieval. If you don't use pass, you'll need to adapt scripts/ping.sh to source keys from environment variables or another secret manager.

安全使用建议
This script will read your LLM provider API keys (it expects them in pass at shared/<provider>/api-key) and send tiny requests to each provider to measure latency. Before using: (1) Confirm you have and trust the providers whose keys will be used; the script will transmit your keys to those provider APIs as part of normal requests. (2) Ensure you have the required binaries installed (pass, curl, bc, mktemp) — the registry metadata does not declare these but the script requires them. (3) If you prefer environment variables, adapt the script to source keys from env vars (the shipped script does not read them). (4) Note Google API key is used in a query parameter (may appear in logs/proxy traces); consider using header-based auth if preferred. (5) Run the script in a safe/test environment first and inspect it locally; it deletes temp files and discards response bodies, but verify it behaves as expected. The inconsistencies are likely sloppy metadata, not malicious intent, but review and adapt the script before granting it access to real credentials.
功能分析
Type: OpenClaw Skill Name: llm-speedtest Version: 1.0.0 The skill 'llm-speedtest' is designed to measure LLM API latency. It transparently uses `curl` to ping various LLM providers and retrieves API keys via the `pass` command-line utility, as explicitly documented in `SKILL.md`. The script `scripts/ping.sh` executes these `curl` commands in parallel, processes the timing data, and formats the output. There is no evidence of data exfiltration, malicious execution, persistence mechanisms, obfuscation, or prompt injection attempts against the agent. All actions are aligned with the stated purpose of a utility for checking LLM API latency.
能力评估
Purpose & Capability
Name/description match the implementation: scripts/ping.sh makes parallel requests to multiple LLM provider APIs and measures latency. The providers and models listed in SKILL.md align with the endpoints called in the script.
Instruction Scope
SKILL.md correctly instructs running scripts/ping.sh and documents that it uses `pass shared/` to retrieve API keys. The script only sends minimal prompts and discards response bodies, returning timing results. It does not attempt to read unrelated system files or exfiltrate data to third parties. However, SKILL.md suggests optionally adapting to environment variables even though the shipped script does not read them; that mismatch is a small scope ambiguity the user should address.
Install Mechanism
No install spec (instruction-only with one script). Nothing is downloaded or written to disk beyond a short-lived temp dir created at runtime. This is low install risk.
Credentials
Registry metadata lists no required env vars or required binaries, but SKILL.md lists optional API keys and the script actually retrieves keys from `pass shared/...`. The script implicitly requires the `pass` binary plus common utilities (curl, bc, mktemp, sort). The requested credentials (provider API keys) are appropriate for the stated purpose, but the metadata omission of required binaries and the mismatch between env-vars listed in SKILL.md and the script's actual secret sourcing is an inconsistency worth noting.
Persistence & Privilege
The skill does not request permanent presence (always: false), does not modify other skills or system configuration, and does not store credentials or enable itself. It runs ephemeral network requests only when invoked.
如何使用
  1. 确保已安装 OpenClaw(本地或 Docker 部署)
  2. 在对话框中输入安装命令:/install llm-speedtest
  3. 安装完成后,直接呼叫该 Skill 的名称或使用 /llm-speedtest 触发
  4. 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v1.0.0
Initial release: parallel LLM latency checker
元数据
Slug llm-speedtest
版本 1.0.0
许可证
累计安装 0
当前安装数 0
历史版本数 1
常见问题

Skill 是什么?

Ping major LLM providers in parallel and compare real API latency. Run with /ping. 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 329 次。

如何安装 Skill?

在 OpenClaw 或 Claude Code 对话框中运行命令「/install llm-speedtest」即可一键安装,无需额外配置。

Skill 是免费的吗?

是的,Skill 完全免费(开源免费),可自由下载、安装和使用。

Skill 支持哪些平台?

Skill 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。

谁开发了 Skill?

由 chapati(@chapati23)开发并维护,当前版本 v1.0.0。

💬 留言讨论