← Back to Skills Marketplace
Llm Hallucination Detector
by
ai-gaoqian
· GitHub ↗
· v1.0.0
· MIT-0
43
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install llm-hallucination-detector-ai
Description
检测大型语言模型输出中的幻觉内容。通过事实验证、一致性检查、来源追溯和置信度评估， 帮助用户识别 AI 生成的虚构信息、错误引用和不实陈述，提升 LLM 输出的可信度。
README (SKILL.md)
LLM Hallucination Detector
概述
面向 LLM 输出的幻觉检测系统。对 AI 生成的文本进行多维度审查，标记可能虚构、错误或不可验证的内容。
核心能力
1. 事实验证
- 交叉引用可靠数据源验证事实性声明
- 检测虚构的统计数据、日期和人名
- 识别编造的 URL、DOI、论文标题
- 验证代码 API 是否真实存在
2. 一致性检查
- 检测输出内部的逻辑矛盾
- 识别与已知事实冲突的陈述
- 发现前后不一致的数值和参数
- 评估多轮对话中的记忆连贯性
3. 来源追溯
- 要求 LLM 为每个声明提供来源
- 验证引用的真实性和准确性
- 识别来源不存在或内容不符的情况
- 标记缺乏引用支撑的断言
4. 置信度评估
- 对每句声明进行置信度评分（0-1）
- 标记低置信度段落并给出理由
- 区分"确定知识"与"推测内容"
- 生成风险等级分类报告
5. 领域专项检测
- 医学声明的事实核查（药物、剂量、症状）
- 法律条文的准确性验证
- 金融数据的实时交叉验证
- 代码示例的可运行性检查
使用方式
检测这段 LLM 输出: \x3CAI 生成的文本>
分析对话中的幻觉: \x3C多轮对话记录>
验证技术文档: \x3CAI 生成的文档>
输出格式
- 幻觉检测报告（含逐句评估、风险等级、可信度评分）
- 问题声明列表（含标注原因和纠正建议）
- 整体可信度评分和摘要
数据底座
整合 Wikidata、维基百科、学术数据库、官方文档等 20+ 可信数据源，覆盖科学、医学、法律、技术、历史等 10 大领域的事实核查规则库。
定价
¥0.50 / 次检测
Usage Guidance
Install only if you want ClawHub/Convex staff workflow assistance. Before using it, be aware that some commands can affect production data, users, packages, emails, or share diffs with reviewer CLIs; keep the documented confirmation gates in place and use the autoreview no-yolo option when full-access review is not appropriate.
Capability Assessment
Purpose & Capability
The skills cover code review, ClawHub moderation, PR maintenance, Convex setup, migrations, and performance audits; admin writes, production migrations, and reviewer execution are high-impact but match the stated purposes.
Instruction Scope
Runtime instructions are scoped to named workflows and repeatedly require target selection, reasons, dry runs, verification, backups, or explicit confirmation before sensitive actions.
Install Mechanism
The skill artifacts are markdown/yaml/assets plus one disclosed autoreview helper script; no hidden installer, background worker, or automatic persistence mechanism was found.
Credentials
The skills may use GitHub, Convex, repo admin tooling, package commands, and external reviewer CLIs; the autoreview helper defaults to full-access Codex review but documents opt-out flags and keeps this tied to review workflows.
Persistence & Privilege
No credential harvesting or long-running persistence was found; sensitive authority comes from the user's existing CLI/API sessions and is directed through audited or confirmation-gated commands.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install llm-hallucination-detector-ai - After installation, invoke the skill by name or use
/llm-hallucination-detector-ai - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release of LLM Hallucination Detector:
- Detects hallucinations in LLM outputs by fact-checking, consistency validation, source tracing, and confidence assessment.
- Supports sentence-level confidence scoring, logical consistency checks, and domain-specific verification (medical, legal, finance, code).
- Generates detailed hallucination detection reports with risk levels, reasons, and corrective suggestions.
- Utilizes 20+ reliable data sources across 10 key domains for broad factual verification.
- Simple usage instructions and transparent per-check pricing (¥0.50).
Metadata
Frequently Asked Questions
What is Llm Hallucination Detector?
检测大型语言模型输出中的幻觉内容。通过事实验证、一致性检查、来源追溯和置信度评估， 帮助用户识别 AI 生成的虚构信息、错误引用和不实陈述，提升 LLM 输出的可信度。 It is an AI Agent Skill for Claude Code / OpenClaw, with 43 downloads so far.
How do I install Llm Hallucination Detector?
Run "/install llm-hallucination-detector-ai" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Llm Hallucination Detector free?
Yes, Llm Hallucination Detector is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Llm Hallucination Detector support?
Llm Hallucination Detector is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Llm Hallucination Detector?
It is built and maintained by ai-gaoqian (@ai-gaoqian); the current version is v1.0.0.
More Skills