← Back to Skills Marketplace
crawleo

Crawleo Web Search

by Crawleo · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ✓ Security Clean
99
Downloads
1
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install crawleo
Description
Use when OpenClaw needs Crawleo-powered web search, Google Search SERP data, Google Maps place data, URL crawling/content extraction, or headful browser craw...
README (SKILL.md)

Crawleo OpenClaw Skill

Use this skill when OpenClaw needs Crawleo-powered live web search, Google Search SERP data, Google Maps place data, URL crawling/content extraction, or headful browser crawling for protected and highly dynamic sites.

Current Implementation Status

This repository now includes offline-tested Crawleo REST wrapper helpers for all five documented endpoints. Live Crawleo calls require CRAWLEO_API_KEY; user-facing examples and optional live verification are expanded in later slices. Do not claim live behavior was verified unless an explicitly enabled live test has run.

Source of Truth

Use contracts/crawleo-endpoints.json as the machine-readable endpoint contract, contracts/crawleo-endpoints.md as the human-readable contract, and contracts/coverage-checklist.md as the endpoint-to-wrapper/test/example coverage checklist. These files cover:

  • /search mapped to MCP tool search_web
  • /google-search mapped to MCP tool google_search
  • /google-maps mapped to MCP tool google_maps
  • /crawl mapped to MCP tool crawl_web
  • /headful-browser mapped to MCP tool headful_browser

Crawleo endpoint-specific docs take precedence over the local OpenAPI snapshot when sources conflict. If a default, limit, response field, error table, or parameter is unclear, write not specified in Crawleo docs rather than inventing behavior.

Authentication and Secret Handling

Live Crawleo REST calls require CRAWLEO_API_KEY. Send it with Crawleo's documented x-api-key header by default. Crawleo also documents Authorization: Bearer YOUR_API_KEY as an alternate authentication style.

Create a client with createCrawleoClient({ apiKey: process.env.CRAWLEO_API_KEY }), then call client.search, client.googleSearch, client.googleMaps, client.crawl, or client.headfulBrowser with endpoint parameters from contracts/crawleo-endpoints.json.

Never print, echo, log, persist, or include API key values in errors, examples, test output, or debug output.

Offline-First Behavior

Default commands, examples, and tests must be offline-safe. They must not call https://api.crawleo.dev, require CRAWLEO_API_KEY, or consume Crawleo credits unless explicitly marked as live tests.

Live tests must require both:

  1. CRAWLEO_API_KEY
  2. CRAWLEO_ENABLE_LIVE_TESTS=1

Run optional live verification with:

CRAWLEO_API_KEY=... CRAWLEO_ENABLE_LIVE_TESTS=1 npm run test:live

Without both variables, the live test skips safely and exits 0.

Endpoint Use Guidance

  • Use /search / search_web for Bing-powered web search with optional auto-crawling and content extraction for LLM/RAG workflows.
  • Use /google-search / google_search for Google SERP data, including web, news, images, places, shopping, knowledge graph, People Also Ask, related searches, and answer boxes.
  • Use /google-maps / google_maps for structured place/business/landmark data from Google Maps.
  • Use /crawl / crawl_web for direct URL crawling and content extraction. Try this before headful browser to reduce credit usage.
  • Use /headful-browser / headful_browser only when standard crawling is blocked or a headed browser/screenshot path is required. Crawleo docs say this costs 50 credits per URL and failed requests cost 0 credits.

Verification

Run offline verification with:

npm test
npm run verify:contracts
npm run verify:examples
npm run verify:scaffold

At this stage, npm run verify:scaffold proves the self-contained package files exist, point to the Crawleo contract inventory, and export the runtime wrapper surface. Later slices add richer examples, documentation, and optional live-test gating.

Usage Guidance
Install only if you trust Crawleo and are comfortable sending search queries, map queries, and selected URLs to api.crawleo.dev. Configure CRAWLEO_API_KEY carefully, monitor credit usage—especially for headful browser calls—and ask the agent to confirm before crawling sensitive, protected, or high-cost targets.
Capability Analysis
Type: OpenClaw Skill Name: crawleo Version: 1.0.0 The 'crawleo' skill bundle is a well-structured and legitimate wrapper for the Crawleo REST API, providing web search, Google SERP data, and web crawling capabilities. The implementation in `src/client.js` and `src/errors.js` includes proactive security measures, such as a `redactSecret` function designed to prevent the accidental leakage of the `CRAWLEO_API_KEY` in logs or error messages. The `SKILL.md` instructions for the AI agent are strictly aligned with the tool's purpose and include explicit warnings against persisting or echoing sensitive credentials. No evidence of data exfiltration, malicious execution, or prompt injection was found across the code, documentation, or verification scripts.
Capability Tags
requires-sensitive-credentials
Capability Assessment
Purpose & Capability
The stated purpose—Crawleo-backed search, Google data lookup, crawling, and headful-browser crawling—matches the provided REST wrapper code and documented endpoints.
Instruction Scope
Instructions allow agent use of external search/crawl/headful-browser workflows, including credit-consuming operations, but they are disclosed and purpose-aligned.
Install Mechanism
No automatic install script or runtime dependency package is declared; setup guidance is standard npm/local-copy documentation.
Credentials
Live use requires CRAWLEO_API_KEY and sends requests to Crawleo. The registry requirements list no env vars, but SKILL.md and skill.json disclose the live API key requirement.
Persistence & Privilege
The provided runtime code does not show background workers, persistent local storage, broad local file access, cookie/session access, or protected-path writes.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install crawleo
  3. After installation, invoke the skill by name or use /crawleo
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release of Crawleo OpenClaw Skill. - Provides offline-tested REST API wrapper helpers for all five Crawleo endpoints: `/search`, `/google-search`, `/google-maps`, `/crawl`, `/headful-browser` - Implements clear, contract-based mapping for each endpoint with MCP tool integration - Enforces offline-safe behavior by default; live API calls require both `CRAWLEO_API_KEY` and explicit opt-in - Documents thorough usage guidance, authentication requirements, and endpoint-specific details - Establishes verification commands for offline contract and example checking
Metadata
Slug crawleo
Version 1.0.0
License MIT-0
All-time Installs 0
Active Installs 0
Total Versions 1
Frequently Asked Questions

What is Crawleo Web Search?

Use when OpenClaw needs Crawleo-powered web search, Google Search SERP data, Google Maps place data, URL crawling/content extraction, or headful browser craw... It is an AI Agent Skill for Claude Code / OpenClaw, with 99 downloads so far.

How do I install Crawleo Web Search?

Run "/install crawleo" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is Crawleo Web Search free?

Yes, Crawleo Web Search is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does Crawleo Web Search support?

Crawleo Web Search is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created Crawleo Web Search?

It is built and maintained by Crawleo (@crawleo); the current version is v1.0.0.

💬 Comments