← 返回 Skills 市场
42
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install firecrawl-crawl
功能描述
Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-...
使用说明 (SKILL.md)
firecrawl crawl
Bulk extract content from a website. Crawls pages following links up to a depth/limit.
When to use
- You need content from many pages on a site (e.g., all
/docs/) - You want to extract an entire site section
- Step 4 in the workflow escalation pattern: search → scrape → map → crawl → interact
Quick start
# Crawl a docs section
firecrawl crawl "\x3Curl>" --include-paths /docs --limit 50 --wait -o .firecrawl/crawl.json
# Full crawl with depth limit
firecrawl crawl "\x3Curl>" --max-depth 3 --wait --progress -o .firecrawl/crawl.json
# Check status of a running crawl
firecrawl crawl \x3Cjob-id>
Options
| Option | Description |
|---|---|
--wait |
Wait for crawl to complete before returning |
--progress |
Show progress while waiting |
--limit \x3Cn> |
Max pages to crawl |
--max-depth \x3Cn> |
Max link depth to follow |
--include-paths \x3Cpaths> |
Only crawl URLs matching these paths |
--exclude-paths \x3Cpaths> |
Skip URLs matching these paths |
--delay \x3Cms> |
Delay between requests |
--max-concurrency \x3Cn> |
Max parallel crawl workers |
--pretty |
Pretty print JSON output |
-o, --output \x3Cpath> |
Output file path |
Tips
- Always use
--waitwhen you need the results immediately. Without it, crawl returns a job ID for async polling. - Use
--include-pathsto scope the crawl — don't crawl an entire site when you only need one section. - Crawl consumes credits per page. Check
firecrawl credit-usagebefore large crawls.
See also
- firecrawl-scrape — scrape individual pages
- firecrawl-map — discover URLs before deciding to crawl
- firecrawl-download — download site to local files (uses map + scrape)
安全使用建议
Install only if you want an agent to crawl and extract website content. When using it, specify the exact domain/path, page limits, and concurrency or budget limits to avoid unnecessary crawling or credit use.
能力评估
Purpose & Capability
The described crawling and bulk extraction behavior fits a website/documentation extraction purpose.
Instruction Scope
The trigger language appears broad enough that a user or agent could invoke it for larger crawls than intended, so requests should be explicit about domain, path, and page limits.
Install Mechanism
No risky installer, obfuscated setup, or package-level abuse signal was provided; VirusTotal telemetry was clean.
Credentials
Network crawling and concurrent extraction can consume API credits and collect more public web content than expected, but that is proportionate when the user asks for bulk site extraction.
Persistence & Privilege
No evidence was provided of persistence, privilege escalation, destructive local changes, or local credential/session harvesting.
如何使用
- 确保已安装 OpenClaw（本地或 Docker 部署）
- 在对话框中输入安装命令：
/install firecrawl-crawl - 安装完成后，直接呼叫该 Skill 的名称或使用
/firecrawl-crawl触发 - 根据 Skill 的参数说明提供必要输入，即可获得结构化输出
版本历史
v1.0.0
- Initial release of firecrawl-crawl: bulk extract content from entire websites or specific site sections.
- Supports crawling pages up to a specified depth, with options for path filtering and concurrency.
- Includes options for limiting pages, setting delays, and exporting results to JSON.
- Provides guidance on when and how to use the skill, including integration with other firecrawl tools.
元数据
常见问题
Firecrawl Crawl 是什么？
Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件，目前累计下载 42 次。
如何安装 Firecrawl Crawl？
在 OpenClaw 或 Claude Code 对话框中运行命令「/install firecrawl-crawl」即可一键安装，无需额外配置。
Firecrawl Crawl 是免费的吗？
是的，Firecrawl Crawl 完全免费，采用 MIT-0 许可证，可自由下载、安装和使用。
Firecrawl Crawl 支持哪些平台？
Firecrawl Crawl 跨平台运行，可在任意部署了 OpenClaw / Claude Code 的环境中使用（cross-platform）。
谁开发了 Firecrawl Crawl？
由 eohmig（@eohmig）开发并维护，当前版本 v1.0.0。
推荐 Skills