← 返回 Skills 市场
geoly-geo

Geo Hallucination Checker

作者 GEOLY AI · GitHub ↗ · v0.1.0 · MIT-0
cross-platform ✓ 安全检测通过
281
总下载
0
收藏
0
当前安装
1
版本数
在 OpenClaw 中安装
/install geo-hallucination-checker
功能描述
Detect and annotate hallucinations, unsupported claims, fabricated studies, and incorrect conclusions in text so that AI only cites verifiable, trustworthy c...
使用说明 (SKILL.md)

\r \r

Overview\r

\r The geo-hallucination-checker skill is a hallucination and false-information detection tool.\r It helps you review any piece of content (articles, landing pages, product descriptions, FAQs, GEO-optimized drafts, etc.) and:\r \r

  • Identify unsupported factual claims\r
  • Flag fabricated or suspicious studies, reports, and statistics\r
  • Highlight incorrect or overconfident conclusions\r
  • Suggest safer, evidence-friendly rephrasings\r \r The primary goal is to ensure that AI systems only cite truthful, well-grounded content and clearly mark anything that looks like hallucination risk.\r \r Use this skill aggressively whenever there is any risk that the model might invent data, sources, or conclusions.\r \r

When to use this skill\r

\r Use geo-hallucination-checker whenever:\r \r

  • The user asks you to fact-check, verify, or validate content.\r
  • The task involves medical, financial, legal, scientific, or technical claims.\r
  • A draft includes numbers, percentages, dates, or strong superlatives (e.g., “the best”, “number one”, “guaranteed”, “clinically proven”).\r
  • A text mentions studies, universities, journals, or institutions without clear, verifiable details.\r
  • You are preparing GEO-optimized content that might be quoted by AI models and needs to be extra reliable.\r
  • You are asked to rewrite content to avoid hallucinations or false claims.\r \r If you are unsure whether hallucinations are a concern, assume they are and apply this skill.\r \r

Inputs this skill supports\r

\r This skill can be used on:\r \r

  • A single paragraph or answer\r
  • A long-form article, blog post, or whitepaper\r
  • A product page or landing page draft\r
  • FAQ content or knowledge base articles\r
  • Generated GEO content that will be cited by AI models\r \r The user may also provide:\r \r
  • Explicit sources or references (links, documents, citations)\r
  • Constraints (e.g., “do not use external web search”, “only use these PDFs as ground truth”)\r \r Always respect any constraints the user provides.\r \r

Core workflow\r

\r When using this skill, follow this workflow:\r \r

  1. Clarify the task mode\r
    • If the user only asks to “check for hallucinations” or “verify content”, focus on analysis.\r
    • If the user asks you to “rewrite safely”, “make this citation-safe”, or “fix hallucinations”, perform analysis first, then produce a hallucination-safe rewrite.\r \r
  2. Parse the content and extract claims\r
    • Read the entire text carefully before judging specific parts.\r
    • Break the content into atomic factual claims. A claim is a statement that could, in principle, be checked as true or false.\r
    • Ignore purely stylistic or obviously subjective language unless it is presented as an objective fact.\r \r
  3. Check available evidence\r
    • Prefer explicit sources provided by the user (links, documents, citations).\r
    • If tools are available and allowed, you may use them to consult:\r
      • Official documentation or first-party sources\r
      • Well-known reference material\r
    • If you cannot confidently verify a claim, treat it as unsupported rather than assuming it is true.\r \r
  4. Classify each claim\r For each atomic factual claim, assign:\r \r
    • status:\r
      • Supported – clearly backed by the provided sources or well-established knowledge.\r
      • Unsupported – no clear support; could be true, but you do not see evidence.\r
      • Problematic – exaggerated, misleading, overconfident, or very unlikely without strong evidence.\r
      • Contradicted – clearly conflicts with known facts or given sources.\r
      • Speculative – forward-looking, predictive, or hypothetical, presented without clear caveats.\r \r
    • risk_level:\r
      • Low – unlikely to cause harm or serious misinformation.\r
      • Medium – could mislead, but impact is moderate or limited.\r
      • High – serious risk of harm, legal issues, medical/financial danger, or major reputational damage.\r \r
    • reason:\r
      • A short explanation of why you assigned that status and risk (e.g., “no source for extreme 500% performance claim”).\r \r
    • suggested_fix:\r
      • A concrete recommendation such as:\r
        • “Remove this claim unless you can provide a real citation.”\r
        • “Rephrase as a possibility, not a guarantee.”\r
        • “Add a specific, verifiable source (e.g., link, DOI, report).”\r \r
  5. Look for common hallucination patterns\r \r Pay special attention to:\r \r
    • Fabricated studies and journals\r
      • Vague references like “a 2026 MIT study” or “Journal of Advanced AI Research” with no details.\r
      • Journals or conferences that do not exist or sound suspiciously generic.\r
    • Overconfident medical or scientific claims\r
      • “Clinically proven to cure…”\r
      • “Guaranteed to reduce X by 80%.”\r
    • Overly precise unsourced statistics\r
      • Very specific percentages, sample sizes, or timeframes with no citation.\r
    • Superlatives and absolutes\r
      • “The only solution that…”\r
      • “Best in the world”, “100% safe”, “zero risk”.\r
    • Misuse of authority\r
      • Name-dropping famous institutions or companies without any concrete evidence.\r \r Treat these as high-risk unless there is strong, clear evidence.\r \r
  6. Produce a structured hallucination analysis\r \r Always output a clear, structured analysis with two parts:\r \r
    1. High-level summary\r
      • Briefly describe:\r
        • Overall hallucination risk (low/medium/high)\r
        • The most critical issues to fix before publication or citation\r \r
    2. Claim-level table\r
      • Use a markdown table with the following columns:\r
        • # – sequential index\r
        • claim_text – the exact or paraphrased claim\r
        • status – Supported / Unsupported / Problematic / Contradicted / Speculative\r
        • risk_level – Low / Medium / High\r
        • reason – a short explanation\r
        • suggested_fix – what to do about it\r \r Example structure (illustrative, not prescriptive content):\r \r | # | claim_text | status | risk_level | reason | suggested_fix |\r | - | ---------- | ------ | ---------- | ------ | ------------- |\r | 1 | “Clinically proven to reduce depression by 80% in 2 weeks” | Problematic | High | No specific clinical trial or citation provided; extreme effect size is unlikely without strong evidence. | Add concrete trial details with citation or downgrade to cautious, non-clinical language. |\r \r
  7. (Optional) Hallucination-safe rewrite\r \r If the user explicitly requests a rewrite or safer version, after the table:\r \r
    • Provide a section titled “Hallucination-safe version”.\r
    • Rewrite the original content:\r
      • Remove or soften high-risk claims.\r
      • Replace overconfident language with cautious, transparent wording.\r
      • Explicitly signal uncertainty where facts are not known (e.g., “Some users report…”, “Early results suggest…”).\r
    • Do not invent:\r
      • Study names, DOIs, journal titles, or URLs.\r
      • Exact statistics or dates you cannot justify.\r
    • If a strong claim is important but currently unsupported, suggest a placeholder note such as:\r
      • “[Insert verified statistic with citation here]”\r \r

Constraints and safety rules\r

\r

  • Never invent sources.\r
    • Do not fabricate papers, DOIs, journal names, or institutional reports.\r
    • If you are not sure a source exists, treat the claim as unsupported or problematic.\r \r
  • Err on the side of caution.\r
    • It is better to mark a real claim as “Unsupported” than to let a hallucinated claim pass as fact.\r \r
  • Separate facts from marketing.\r
    • Marketing language is acceptable only if it is not masquerading as hard evidence.\r
    • When in doubt, suggest softer, more honest language and disclose uncertainty.\r \r
  • Respect user constraints about tools and data.\r
    • If the user forbids external web search or asks you to rely only on given documents, follow that rule strictly.\r
    • Under such constraints, label claims based on what you can see, and explain that some might be true but remain “Unsupported” due to limited data.\r \r

How this skill interacts with other GEO skills\r

\r When used together with other GEO-oriented skills (e.g., content optimization, schema generation, or conversion optimization):\r \r

  • Run geo-hallucination-checker after content is drafted but before finalizing output that might be cited.\r
  • Use the hallucination analysis to:\r
    • Remove or soften risky claims.\r
    • Add explicit “needs citation” notes where appropriate.\r
    • Ensure all structured data (e.g., Schema.org fields) does not encode hallucinated facts.\r \r If there is a conflict between persuasive copywriting and factual accuracy, prioritize factual accuracy and safety.\r \r

Output format summary\r

\r Unless the user specifies a different format, always:\r \r

  1. Start with a short summary:\r
    • Overall hallucination risk level.\r
    • 2–5 bullets with the most important issues.\r \r
  2. Provide a markdown table as described in the workflow section.\r \r
  3. If requested, append a “Hallucination-safe version” that rewrites the content according to your analysis.\r \r Aim for clarity and directness so that humans and AI systems can easily see which parts of the text are safe to cite and which require caution or correction.\r \r
安全使用建议
This skill appears coherent and low-risk from a security standpoint: it needs no credentials, installs nothing, and its helper script only runs local pattern matching. The main caveat is functional, not security-related: the provided Python scanner is a lightweight heuristic and will produce false positives and negatives, so for high-stakes medical, legal, or financial claims you should still require human review and authoritative sources. If you plan to let the agent run autonomously, remember autonomous invocation is the platform default (not a special privilege here) — ensure you trust the agent's broader toolset and policies before enabling unattended checks. If you need network-enabled fact-checking (automatic lookups, DOI resolution, or accessing paid databases), expect the skill to require additional, external tooling and credentials; review any future changes that add network calls or secret requirements before installing.
功能分析
Type: OpenClaw Skill Name: geo-hallucination-checker Version: 0.1.0 The geo-hallucination-checker skill is a legitimate tool designed to help AI agents identify and mitigate hallucinations in generated or provided text. The bundle includes a Python script (scripts/hallucination_checker.py) that uses basic regular expressions to score sentences for risk based on suspicious patterns (e.g., 'clinically proven', 'guaranteed') and institution names. The instructions in SKILL.md and references/hallucination_guide.md are well-defined, focusing on factual accuracy, evidence-based classification, and safe rewriting. No evidence of data exfiltration, malicious execution, or harmful prompt injection was found.
能力评估
Purpose & Capability
The name/description (hallucination detection) matches the provided SKILL.md and the included Python helper. No unrelated credentials, binaries, or config paths are requested. The included evals and reference guide support the stated purpose.
Instruction Scope
SKILL.md instructs only to parse text into atomic claims, classify them, and prefer provided sources; it does not request reading unrelated files, environment variables, or sending data to external endpoints. The guidance to use 'tools if available and allowed' is generic and conditional, which is appropriate.
Install Mechanism
No install spec is provided (instruction-only skill). The only code file is a small local Python script that performs deterministic, local text analysis and emits JSON—no downloads, no external package installation, and no extraction from remote URLs.
Credentials
The skill declares no required environment variables, no primary credential, and no config paths. The runtime instructions and script do not access secrets or external credentials.
Persistence & Privilege
always is false and the skill does not request elevated or persistent system presence. disable-model-invocation is false (normal platform default) but that is not combined with other red flags here.
如何使用
  1. 确保已安装 OpenClaw(本地或 Docker 部署)
  2. 在对话框中输入安装命令:/install geo-hallucination-checker
  3. 安装完成后,直接呼叫该 Skill 的名称或使用 /geo-hallucination-checker 触发
  4. 根据 Skill 的参数说明提供必要输入,即可获得结构化输出
版本历史
v0.1.0
Initial release of geo-hallucination-checker skill: - Detects and annotates hallucinations, unsupported claims, fabricated studies, and incorrect conclusions in any text. - Flags vague, unsourced, or overconfident claims, with attention to high-risk areas (medical, financial, scientific, technical). - Provides a structured analysis with claim classification (Supported/Unsupported/Problematic/Contradicted/Speculative), risk levels, reasons, and concrete recommendations. - Outputs a markdown table for easy review, plus a high-level summary of hallucination risk. - Offers hallucination-safe rewrites on request, ensuring content is citation-ready and avoids fabrication. - Prioritizes user-provided sources and enforces strong constraints against inventing information.
元数据
Slug geo-hallucination-checker
版本 0.1.0
许可证 MIT-0
累计安装 0
当前安装数 0
历史版本数 1
常见问题

Geo Hallucination Checker 是什么?

Detect and annotate hallucinations, unsupported claims, fabricated studies, and incorrect conclusions in text so that AI only cites verifiable, trustworthy c... 它是一个面向 Claude Code / OpenClaw 的 AI Agent Skill 插件,目前累计下载 281 次。

如何安装 Geo Hallucination Checker?

在 OpenClaw 或 Claude Code 对话框中运行命令「/install geo-hallucination-checker」即可一键安装,无需额外配置。

Geo Hallucination Checker 是免费的吗?

是的,Geo Hallucination Checker 完全免费,采用 MIT-0 许可证,可自由下载、安装和使用。

Geo Hallucination Checker 支持哪些平台?

Geo Hallucination Checker 跨平台运行,可在任意部署了 OpenClaw / Claude Code 的环境中使用(cross-platform)。

谁开发了 Geo Hallucination Checker?

由 GEOLY AI(@geoly-geo)开发并维护,当前版本 v0.1.0。

💬 留言讨论