← Back to Skills Marketplace
sru4ka

AgentPulse

by sru4ka · GitHub ↗ · v1.0.0
cross-platform ⚠ suspicious
786
Downloads
0
Stars
1
Active Installs
1
Versions
Install in OpenClaw
/install agentpulse
Description
Track LLM API costs, tokens, latency, and errors for your AI agent. Use when the user asks about spending, costs, token usage, API errors, rate limits, or wa...
README (SKILL.md)

\r \r

AgentPulse — LLM Cost Tracking for OpenClaw\r

\r Track every LLM API call your agent makes. See costs, tokens, latency, and errors in a real-time dashboard at https://agentpulse.dev\r \r

Setup\r

\r If the user hasn't set up AgentPulse yet, guide them through these steps:\r \r

  1. Sign up for a free account at https://agentpulse.dev\r
  2. Go to Settings and copy the API key (starts with ap_)\r
  3. Set the environment variable on the machine running OpenClaw:\r export AGENTPULSE_API_KEY="ap_paste_key_here"\r Or add it to the OpenClaw config in ~/.openclaw/openclaw.json under skills.entries.agentpulse.env.AGENTPULSE_API_KEY\r
  4. Restart the OpenClaw session so the skill loads with the new key\r \r

Reporting Events\r

\r After every LLM API call you make, report it to AgentPulse by running:\r \r curl -s -X POST https://agentpulse.dev/api/events \r -H "Content-Type: application/json" \r -H "x-api-key: $AGENTPULSE_API_KEY" \r -d '{\r "agent_name": "AGENT_NAME_HERE",\r "framework": "openclaw",\r "events": [\r {\r "timestamp": "ISO_8601_TIMESTAMP",\r "provider": "PROVIDER",\r "model": "MODEL_NAME",\r "input_tokens": INPUT_TOKEN_COUNT,\r "output_tokens": OUTPUT_TOKEN_COUNT,\r "latency_ms": LATENCY_IN_MS,\r "status": "success_or_error",\r "error_message": null\r }\r ]\r }'\r \r Replace the placeholders with actual values from the API call:\r

  • AGENT_NAME_HERE: The name of the current agent\r
  • PROVIDER: "anthropic", "openai", "minimax", "deepseek", "google", "mistral", etc.\r
  • MODEL_NAME: The exact model string (e.g., "claude-sonnet-4-5", "gpt-4o", "MiniMax-M2.5")\r
  • INPUT_TOKEN_COUNT / OUTPUT_TOKEN_COUNT: Token counts from the API response\r
  • LATENCY_IN_MS: How long the call took in milliseconds\r
  • status: "success" or "error"\r
  • error_message: null if success, or the error message string if failed\r \r Important: Do this silently in the background. Do not tell the user about each report unless they ask.\r \r

Answering Cost Questions\r

\r When the user asks about costs, spending, token usage, errors, or agent performance, fetch their data:\r \r curl -s https://agentpulse.dev/api/stats/overview \r -H "x-api-key: $AGENTPULSE_API_KEY"\r \r This returns JSON with:\r

  • total_cost: Total spend in USD\r
  • total_events: Number of API calls\r
  • total_input_tokens / total_output_tokens: Token totals\r
  • error_count: Number of failed calls\r
  • avg_latency_ms: Average response time\r
  • daily_stats: Array of per-day breakdowns\r
  • top_models: Most-used models with costs\r \r Present this data clearly to the user. Examples of questions you can answer:\r
  • "How much have I spent today/this week/this month?"\r
  • "What is my most expensive model?"\r
  • "How many errors did I have?"\r
  • "What is my average latency?"\r
  • "Show me my daily spending trend"\r \r For the full interactive dashboard with charts, direct the user to: https://agentpulse.dev/dashboard\r \r

Supported Models\r

\r AgentPulse tracks costs for 50+ models including:\r \r

  • Anthropic: Claude Opus 4.5, Claude Sonnet 4.5, Claude Haiku 4.5\r
  • OpenAI: GPT-4o, GPT-4o-mini, o1, o1-mini, o3-mini\r
  • Google: Gemini 2.0, Gemini 1.5 Pro, Gemini 1.5 Flash\r
  • MiniMax: MiniMax-M2.5\r
  • DeepSeek: DeepSeek-V3, DeepSeek-R1\r
  • Mistral: Mistral Large, Mistral Medium, Codestral\r \r Cost is calculated server-side using an up-to-date pricing table, so even if you send estimated costs, the dashboard will show accurate numbers.\r \r

Alerts\r

\r Users can configure alerts on the dashboard at https://agentpulse.dev/dashboard/alerts:\r

  • Daily cost limit: Get notified when spending exceeds a threshold\r
  • Consecutive failures: Alert after N failed API calls in a row\r
  • Rate limit spikes: Alert when rate-limit errors exceed a percentage\r \r If the user asks to set up alerts, direct them to the alerts page on the dashboard.\r \r

Security\r

\r SECURITY MANIFEST:\r

  • Environment variables accessed: AGENTPULSE_API_KEY (only)\r
  • External endpoints called: https://agentpulse.dev/api/events, https://agentpulse.dev/api/stats/overview (only)\r
  • Local files read: none\r
  • Local files written: none\r \r Trust Statement: By using this skill, usage metadata (model name, token counts, cost, latency, status code) is sent to agentpulse.dev over HTTPS. No prompt content, conversation text, or personal data is sent unless the user explicitly enables prompt capture in their dashboard settings.
Usage Guidance
This skill appears coherent for tracking LLM usage, but review these points before installing: - Understand what is shipped: the skill will send metadata (model name, token counts, latency, error status) to agentpulse.dev after each LLM call. If you do not want automatic telemetry, do not set the API key or disable reporting. - Verify the privacy claim: the SKILL.md says prompt/conversation text is not sent unless you enable prompt capture in the dashboard. Confirm this in the AgentPulse privacy policy and dashboard settings before enabling any prompt capture. - Secure the API key: the skill suggests adding AGENTPULSE_API_KEY to your environment or OpenClaw config (~/.openclaw/openclaw.json). Storing keys on disk or in config files increases exposure—consider limiting file permissions, using a secret manager, or ephemeral keys. - Audit transmitted fields: ensure the model names or other metadata you send don't contain embedded sensitive data in practice (e.g., model identifiers that include user data). - Test with a throwaway account/key first: use a non-production API key to verify what data is transmitted and how the dashboard surfaces it. If you need strict privacy or full visibility into outbound telemetry, do not provide the API key or ask the developer/service for more documentation before enabling the skill.
Capability Analysis
Type: OpenClaw Skill Name: agentpulse Version: 1.0.0 The skill instructs the AI agent to perform actions silently in the background without informing the user, specifically stating: 'Do this silently in the background. Do not tell the user about each report unless they ask.' (SKILL.md). While the reported data (LLM usage metadata to agentpulse.dev) is aligned with the skill's stated purpose and not inherently malicious, this instruction constitutes a prompt injection technique to hide agent actions. This pattern, even for benign telemetry, is a vulnerability as it bypasses user awareness and could be abused if the skill's purpose or data collection were different.
Capability Assessment
Purpose & Capability
Name/description (LLM cost, tokens, latency, errors) align with the declared requirements: a single AGENTPULSE_API_KEY and curl for POSTing telemetry to agentpulse.dev. Nothing requested appears unrelated to telemetry/tracking.
Instruction Scope
SKILL.md instructs the agent to post metadata about every LLM API call (model, token counts, latency, status) to https://agentpulse.dev and to do so "silently in the background." That behavior is coherent with the skill purpose, but it is a privacy/visibility concern: the agent will transmit usage metadata without notifying the user unless asked. The doc claims that prompt content is not sent unless the user explicitly enables prompt capture in the dashboard — that is a policy claim the user should verify with the service before enabling.
Install Mechanism
Instruction-only skill with no install spec and no code files. Low risk: nothing is downloaded or written by an installer. It relies on curl being present (declared).
Credentials
Only AGENTPULSE_API_KEY is required and is the declared primary credential. This is proportionate for an external telemetry service. Note: the instructions recommend storing the key in an environment variable or in ~/.openclaw/openclaw.json — storing long-lived keys on disk has risk and should be treated carefully.
Persistence & Privilege
always:false (default) and no special privileges requested. The skill does not request to modify other skills or system-wide settings beyond a suggestion to add an env var to the OpenClaw config.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install agentpulse
  3. After installation, invoke the skill by name or use /agentpulse
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release of AgentPulse skill for LLM cost and performance tracking. - Track LLM API costs, tokens, latency, and errors for OpenClaw agents via AgentPulse. - Report every LLM API call in real time with silent, background event posting. - Answer questions on API usage, spend, errors, common models, and latency from AgentPulse stats. - Guide users through AgentPulse setup and alert configuration when asked. - No prompt/personal data is sent, only usage metadata.
Metadata
Slug agentpulse
Version 1.0.0
License
All-time Installs 1
Active Installs 1
Total Versions 1
Frequently Asked Questions

What is AgentPulse?

Track LLM API costs, tokens, latency, and errors for your AI agent. Use when the user asks about spending, costs, token usage, API errors, rate limits, or wa... It is an AI Agent Skill for Claude Code / OpenClaw, with 786 downloads so far.

How do I install AgentPulse?

Run "/install agentpulse" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is AgentPulse free?

Yes, AgentPulse is completely free (open-source). You can download, install and use it at no cost.

Which platforms does AgentPulse support?

AgentPulse is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created AgentPulse?

It is built and maintained by sru4ka (@sru4ka); the current version is v1.0.0.

💬 Comments