← 返回 Skills 市场
1113
总下载
0
收藏
3
当前安装
1
版本数
在 OpenClaw 中安装
/install smart-crawler
功能描述
智能爬虫工具 - 企业级数据采集与反爬虫处理 | Smart Web Crawler - Enterprise data collection with anti-detection
安全使用建议
This package is a normal web crawler and appears coherent with its description, but take usual precautions: install and run in a controlled environment (Playwright will download browser binaries); review any proxy or database connection strings you provide (they can contain credentials); be aware that the tool makes network requests to target URLs you supply (so don't point it at internal or sensitive endpoints without authorization); and audit any config you create for storage backends (MongoDB/MySQL) before entering secrets. If you plan to run it in an automated agent, consider sandboxing network access and limiting where results can be uploaded.
功能分析
Type: OpenClaw Skill
Name: smart-crawler
Version: 1.0.0
The 'smart-crawler' skill bundle is a legitimate web crawling utility providing standard features for data collection, including support for static (requests) and dynamic (Playwright) pages, proxy rotation, and data extraction via XPath/CSS selectors. The code is well-structured, follows the stated purpose in SKILL.md and README.md, and contains no evidence of malicious intent, data exfiltration, or prompt injection.
能力评估
Purpose & Capability
Name/description (enterprise web crawler with anti-detection) aligns with included code, examples, and requirements. The code implements request-based and Playwright-based crawling, proxy support, extraction, batching and dynamic rendering as claimed.
Instruction Scope
SKILL.md and README instruct installing dependencies (pip and playwright) and running tests; runtime instructions and code only perform crawling, extraction, downloading, and optional proxy use. There are no instructions to read unrelated host files, environment variables, or to send data to unexpected endpoints.
Install Mechanism
There is no automated install spec in the registry entry (instruction-only), but SKILL.md tells users to run pip install -r requirements.txt and playwright install. Dependencies are standard public packages; Playwright will download browser binaries when installed — this is expected but worth noting.
Credentials
The skill declares no required env vars or credentials. Code supports optional proxy pools and mentions databases (in README), but no credentials are requested or embedded. Any credential use would come from how a user configures proxies or DB connectors, not from the skill itself.
Persistence & Privilege
Skill is not always-enabled and does not request elevated platform privileges. It does not modify other skills or system-wide agent settings.
如何使用
- 确保已安装 OpenClaw（本地或 Docker 部署）
- 在对话框中输入安装命令：
/install smart-crawler - 安装完成后，直接呼叫该 Skill 的名称或使用
/smart-crawler触发 - 根据 Skill 的参数说明提供必要输入，即可获得结构化输出
版本历史
v1.0.0
Initial release: Enterprise web crawler with anti-detection
元数据
常见问题
Smart Crawler 是什么？
智能爬虫工具 - 企业级数据采集与反爬虫处理 | Smart Web Crawler - Enterprise data collection with anti-detection. 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件，目前累计下载 1113 次。
如何安装 Smart Crawler？
在 OpenClaw 或 Claude Code 对话框中运行命令「/install smart-crawler」即可一键安装，无需额外配置。
Smart Crawler 是免费的吗？
是的，Smart Crawler 完全免费，采用 MIT-0 许可证，可自由下载、安装和使用。
Smart Crawler 支持哪些平台？
Smart Crawler 跨平台运行，可在任意部署了 OpenClaw / Claude Code 的环境中使用（cross-platform）。
谁开发了 Smart Crawler？
由 Lv Lancer（@kaiyuelv）开发并维护，当前版本 v1.0.0。
推荐 Skills