← Back to Skills Marketplace
nirveshdagar

Websearch

by nirveshdagar · GitHub ↗ · v2.0.2 · MIT-0
cross-platform ✓ Security Clean
189
Downloads
2
Stars
0
Active Installs
3
Versions
Install in OpenClaw
/install multi-engine-websearch
Description
Multi-engine web search across 6 engines: DuckDuckGo, DDG Lite, Yahoo, Yahoo JP, Startpage, and Google (headless Chromium). No API keys required. Returns 10+...
README (SKILL.md)

WebSearch — Multi-Engine Search Aggregator

🔗 GitHub: https://github.com/nirveshdagar/multi-engine-websearch

📦 Git Install:

git clone https://github.com/nirveshdagar/multi-engine-websearch.git

📦 ClawHub Install:

npx clawhub@latest install multi-engine-websearch

A free, local web search skill that queries 6 reliable search engines simultaneously (in parallel), merges results, deduplicates URLs, and ranks by cross-engine frequency.

No API keys required. No paid subscriptions. Runs entirely on your machine.

Requirements

  • Python 3.9+
  • Playwright (pip3 install playwright && python3 -m playwright install chromium)

Playwright is needed for the Google engine (headless Chromium renders JS-based results). All other engines use lightweight HTTP scraping with zero dependencies.

When to Use

Use this skill whenever the user asks you to:

  • Search the web for anything
  • Find recent news, articles, or information
  • Look up a topic, person, product, or event
  • Verify a fact with current web results
  • Research a topic with multiple sources

Command

python3 ~/.openclaw/workspace/skills/websearch/scripts/search.py "your query" --json

Options

Flag Default Description
--json / -j off Output as JSON
--num / -n 10 Results per engine
--max / -m 50 Max total results
--engines / -e all 6 Comma-separated engine list
--list-engines Show available engines

Engines

Engine Method Reliability
DuckDuckGo HTML scrape ⭐⭐⭐⭐⭐
DDG Lite HTML scrape ⭐⭐⭐⭐
Yahoo HTML scrape ⭐⭐⭐⭐
Yahoo JP HTML scrape ⭐⭐⭐⭐
Startpage HTML scrape ⭐⭐⭐⭐
Google Headless Chromium ⭐⭐⭐⭐

All engines run in parallel using ThreadPoolExecutor for maximum speed.

Output Format

{
  "query": "your search",
  "total": 35,
  "engines": {"duckduckgo": 10, "google": 8, "yahoo": 10, ...},
  "results": [
    {
      "title": "Result Title",
      "url": "https://example.com",
      "snippet": "Description...",
      "engines": ["duckduckgo", "google", "yahoo"]
    }
  ]
}

Results appearing in more engines are ranked higher (cross-engine consensus).

Core Rules

  1. Always use --json flag when parsing results programmatically
  2. Summarize top results in natural language for the user
  3. Always cite sources with URLs
  4. If one engine fails, others compensate — the system is resilient
  5. Google engine is slower (~5s) due to headless browser; other engines are fast (~1-2s)
Usage Guidance
This skill appears to do what it says: local scraping of multiple search engines with a Playwright headless Chromium fallback for Google. Before installing, consider: - Privacy: your queries and IP are sent to external search engines; Startpage offers some privacy but other engines will see your requests. - Operational: Playwright will download Chromium (large binary) and the Google scraper uses anti-bot evasion techniques; this may be fragile and could trigger blocking or violate a search engine's terms of service. - Security posture: the Google headless code uses --no-sandbox and navigator.webdriver overrides which are typical for scraping but reduce isolation—avoid running in highly sensitive, privileged environments; prefer a sandboxed VM or container if concerned. - Rate limits: the skill makes parallel requests; avoid heavy automated runs to prevent IP blocking. If these tradeoffs are acceptable, the skill is internally coherent. If you need stronger privacy, run queries through an anonymizing proxy or omit the Google engine.
Capability Assessment
Purpose & Capability
Name/description describe a multi-engine websearch aggregator and the code/README/SKILL.md implement exactly that: HTTP scraping for several engines plus a Playwright-based headless Google scraper. No unrelated credentials, binaries, or config paths are requested.
Instruction Scope
Runtime instructions and code only perform web requests to listed search engines and local Playwright browser launches. They do not read arbitrary local files or environment variables. Note: queries are sent directly to external search engines (your IP and query will be visible to those sites), and the Google engine contains explicit anti-bot evasion steps (navigator.webdriver override, automation flags).
Install Mechanism
There is no built-in install spec, but SKILL.md requires pip install playwright and running 'playwright install chromium', which downloads browser binaries from Playwright's distribution. This is expected for headless Chromium use; the download comes from the Playwright project rather than an unknown personal server.
Credentials
The skill does not request environment variables, secrets, or unrelated credentials. Its network activity (HTTP fetches, Playwright launching Chromium) is proportional to its stated purpose.
Persistence & Privilege
The skill does not require always:true and does not request modifying other skills or system-wide settings. It will run network requests when invoked; default agent autonomy is allowed by platform but not an intrinsic risk here.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install multi-engine-websearch
  3. After installation, invoke the skill by name or use /multi-engine-websearch
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v2.0.2
Added GitHub repo + git clone install command to SKILL.md. Removed debug script.
v2.0.1
Added GitHub repository link and README for easy git clone installation
v2.0.0
6 engines (DuckDuckGo, DDG Lite, Yahoo, Yahoo JP, Startpage, Google headless Chromium). 10 results per engine, parallel execution, cross-engine ranking. No API keys needed.
Metadata
Slug multi-engine-websearch
Version 2.0.2
License MIT-0
All-time Installs 0
Active Installs 0
Total Versions 3
Frequently Asked Questions

What is Websearch?

Multi-engine web search across 6 engines: DuckDuckGo, DDG Lite, Yahoo, Yahoo JP, Startpage, and Google (headless Chromium). No API keys required. Returns 10+... It is an AI Agent Skill for Claude Code / OpenClaw, with 189 downloads so far.

How do I install Websearch?

Run "/install multi-engine-websearch" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is Websearch free?

Yes, Websearch is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does Websearch support?

Websearch is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created Websearch?

It is built and maintained by nirveshdagar (@nirveshdagar); the current version is v2.0.2.

💬 Comments