← 返回 Skills 市场
Robots Ai
作者
sharozdawa
· GitHub ↗
· v1.0.0
· MIT-0
140
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install robotstxt-ai
功能描述
Analyze and generate robots.txt files with AI crawler awareness. Detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) are blocked o...
安全使用建议
This skill appears coherent and safe in intent. Before installing, note that: (1) it will fetch robots.txt from arbitrary URLs you provide — ensure you are comfortable with the agent making outbound requests to those sites and with any logs that may record those URLs; (2) generated recommendations (e.g., 'block all AI' or blocking Googlebot) can have major consequences like removing your site from search/indexing — review generated robots.txt carefully before applying it to production; (3) verify the bot list if you rely on it for compliance, since crawler names and behaviors can change. If you plan to use it on private/internal sites, ensure the agent has appropriate network access and that no sensitive URLs are shared accidentally.
功能分析
Type: OpenClaw Skill
Name: robotstxt-ai
Version: 1.0.0
The skill bundle is a set of instructions for an AI agent to analyze and generate robots.txt files with a focus on AI crawlers. It contains a database of AI user-agents and logical steps for auditing website permissions, with no executable code, network exfiltration, or malicious prompt injection identified in SKILL.md or _meta.json.
能力评估
Purpose & Capability
Name/description (robots.txt analysis/generation with AI-crawler awareness) match the SKILL.md instructions. The skill requires no binaries, credentials, or config paths — appropriate for an instruction-only robots.txt helper.
Instruction Scope
SKILL.md explicitly tells the agent to fetch /robots.txt from arbitrary websites, parse User-agent/Allow/Disallow rules, and produce suggested robots.txt content. That behavior is expected for this purpose, but it implies the agent will perform network fetches of target sites (and may reveal provided site URLs to any runtime network logs). The instructions do not request unrelated files, credentials, or external endpoints beyond the target site's robots.txt.
Install Mechanism
No install spec and no code files are present — lowest-risk instruction-only skill. Nothing is downloaded or written to disk by an installer.
Credentials
The skill declares no required environment variables or credentials. No disproportionate access to secrets or unrelated services is requested.
Persistence & Privilege
always is false and the skill does not request special persistent privileges or modifications to other skills/configs. Autonomous invocation is allowed by default but not excessive here.
如何使用
- 确保已安装 OpenClaw（本地或 Docker 部署）
- 在对话框中输入安装命令：
/install robotstxt-ai - 安装完成后，直接呼叫该 Skill 的名称或使用
/robotstxt-ai触发 - 根据 Skill 的参数说明提供必要输入，即可获得结构化输出
版本历史
v1.0.0
Initial release with AI-focused robots.txt analysis and generation.
- Analyze robots.txt files to detect which AI bots (e.g., GPTBot, ClaudeBot, PerplexityBot) are allowed or blocked.
- Generate custom robots.txt files with easy AI bot toggling and explanatory comments.
- Audit existing robots.txt for completeness, identifying issues and suggesting improvements.
- List 20+ known AI crawlers with details on user-agents, company, and crawler type.
- Output always includes clear formatting and explanations for each section.
元数据
常见问题
Robots Ai 是什么？
Analyze and generate robots.txt files with AI crawler awareness. Detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) are blocked o... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件，目前累计下载 140 次。
如何安装 Robots Ai？
在 OpenClaw 或 Claude Code 对话框中运行命令「/install robotstxt-ai」即可一键安装，无需额外配置。
Robots Ai 是免费的吗？
是的，Robots Ai 完全免费，采用 MIT-0 许可证，可自由下载、安装和使用。
Robots Ai 支持哪些平台？
Robots Ai 跨平台运行，可在任意部署了 OpenClaw / Claude Code 的环境中使用（cross-platform）。
谁开发了 Robots Ai？
由 sharozdawa（@sharozdawa）开发并维护，当前版本 v1.0.0。
推荐 Skills