← 返回 Skills 市场
Python Crawler Architect
作者
strong-Cyber
· GitHub ↗
· v1.0.0
· MIT-0
65
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install python-crawler-architect
功能描述
资深Python爬虫与数据工程专家。当用户需要设计网络爬虫系统、构建数据采集管道、设计数据库模型(SQLAlchemy ORM)、实现反爬虫策略（代理池、断点续传、重试机制）、异步并发编程(asyncio/aiohttp)、或进行数据清洗时，使用此技能。关键词：爬虫、crawler、scraper、数据采集、代理...
安全使用建议
This skill is coherent with its stated purpose and doesn't request credentials or install code, but it includes guidance on proxy pools and anti‑scraping evasion. Before using or executing any generated code: 1) review the code yourself (or have a developer review it) and do not run untrusted code in production environments; 2) ensure your scraping activities comply with target site terms of service, local laws, and privacy rules (avoid collecting personal data or bypassing access controls); 3) if deploying, isolate runtime environments, rotate and protect any credentials you supply, and follow responsible rate-limiting and polite crawling practices.
功能分析
Type: OpenClaw Skill
Name: python-crawler-architect
Version: 1.0.0
The skill bundle provides a comprehensive and professional framework for an AI agent to act as a 'Python Crawler Architect'. It contains well-structured SQLAlchemy ORM templates, proxy management logic, rate limiting, and state persistence mechanisms (SKILL.md). The code follows industry best practices (asyncio, type hinting, environment variables) and includes explicit reminders regarding legal compliance and ethical scraping. No indicators of data exfiltration, malicious execution, or prompt injection were found.
能力标签
能力评估
Purpose & Capability
The name and description (Python crawler architect) match the SKILL.md contents: database modeling, asyncio/aiohttp patterns, proxy pools, retry/continuation strategies, SQLAlchemy templates, and project structure. No unrelated credentials, binaries, or install steps are requested.
Instruction Scope
SKILL.md is extensive and stays on-topic (architecture, ORM models, proxy pools, state management, retries, data cleaning, code templates). It also explicitly discusses anti‑scraping countermeasures (proxy pools, evasion strategies). That is coherent with a crawler-architect role but is ethically sensitive — it could be used to help evade site protections. The instructions do not direct reading arbitrary local files, exfiltrating secrets, or contacting unexpected remote endpoints.
Install Mechanism
No install specification or code files are included (instruction-only), so nothing is written to disk or fetched at install time. This is the lowest-risk class of skill in terms of install mechanism.
Credentials
The skill declares no required environment variables, credentials, or config paths. The SKILL.md references using environment variables for sensitive config in general (a best practice) but does not require any specific secrets. No disproportionate credential access is requested.
Persistence & Privilege
Flags show default behavior (always: false, agent-invocable allowed). The skill does not request persistent installation, system-wide changes, or modification of other skill settings.
如何使用
- 确保已安装 OpenClaw（本地或 Docker 部署）
- 在对话框中输入安装命令：
/install python-crawler-architect - 安装完成后，直接呼叫该 Skill 的名称或使用
/python-crawler-architect触发 - 根据 Skill 的参数说明提供必要输入，即可获得结构化输出
版本历史
v1.0.0
python-crawler-architect 1.0.0
- Initial release of the Python 爬虫架构师 skill.
- Defines workflow and best practices for designing large-scale Python web crawlers.
- Includes detailed guidelines for database modeling with SQLAlchemy ORM.
- Provides templates for anti-blocking strategies, proxy pool management, fault tolerance, and data cleaning.
- Specifies technical stack, project structure, and code style norms for robust, production-grade crawler systems.
元数据
常见问题
Python Crawler Architect 是什么？
资深Python爬虫与数据工程专家。当用户需要设计网络爬虫系统、构建数据采集管道、设计数据库模型(SQLAlchemy ORM)、实现反爬虫策略（代理池、断点续传、重试机制）、异步并发编程(asyncio/aiohttp)、或进行数据清洗时，使用此技能。关键词：爬虫、crawler、scraper、数据采集、代理... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件，目前累计下载 65 次。
如何安装 Python Crawler Architect？
在 OpenClaw 或 Claude Code 对话框中运行命令「/install python-crawler-architect」即可一键安装，无需额外配置。
Python Crawler Architect 是免费的吗？
是的，Python Crawler Architect 完全免费，采用 MIT-0 许可证，可自由下载、安装和使用。
Python Crawler Architect 支持哪些平台？
Python Crawler Architect 跨平台运行，可在任意部署了 OpenClaw / Claude Code 的环境中使用（cross-platform）。
谁开发了 Python Crawler Architect？
由 strong-Cyber（@strong-cyber）开发并维护，当前版本 v1.0.0。
推荐 Skills