← Back to Skills Marketplace
yuyonghao-123

Evaluation Suite

by yuyonghao-123 · GitHub ↗ · v0.1.2 · MIT-0
cross-platform ✓ Security Clean
233
Downloads
0
Stars
0
Active Installs
7
Versions
Install in OpenClaw
/install yuyonghao-evaluation-suite
Description
Provides API for evaluating RAG quality, logical reasoning, and detecting hallucinations in AI-generated content with batch support.
Usage Guidance
This package appears coherent and implements simple heuristic evaluators; there is no network exfiltration or secret access. Before installing/using: (1) review the API parameter names — the SKILL.md examples and the module function signatures differ, so adapt your integration to the code (e.g., use { text, sources, query } for hallucination detector and { query, answer, contexts } for RAG). (2) Run npm test and the quick-test in an isolated/sandboxed environment first; package.json lacks dependencies but some scripts reference missing files (benchmarks) and Node ESM/CommonJS mismatches may cause runtime errors (package.json lacks "type":"module"). (3) Because the source and homepage are unknown, audit the code for logic correctness on representative inputs if you plan to use results for evaluation decisions. If you need stronger guarantees, ask the publisher for provenance (source repo, release tags) or a signed/reproducible release.
Capability Assessment
Purpose & Capability
Name/description (RAG, reasoning, hallucination detection) match the shipped JavaScript modules. The bundled files implement the stated functionality and do not require unrelated services or credentials. Minor provenance issues: source/homepage unknown and package author is an alias, but this is metadata not a capability mismatch.
Instruction Scope
SKILL.md describes how to use the API and to run npm install/npm test. However there are several small inconsistencies between docs and code: SKILL.md examples use different parameter names (e.g., generatedText/context/retrievedDocs) than the code expects (text/sources/query, answer/contexts), which can cause integration confusion. SKILL.md asks to npm install even though package.json contains no dependencies. The runtime instructions do not direct reading unrelated files, env vars, or network endpoints — they operate on provided inputs only.
Install Mechanism
No install spec in registry (instruction-only), but project includes package.json and suggests running npm install. package.json declares no dependencies; installing will not pull external packages beyond npm metadata. There are no downloads from untrusted URLs, no extract/install instructions writing additional binaries, and no obfuscated/install-time behavior.
Credentials
The skill requires no environment variables, no credentials, and the code does not read process.env or config paths. Requested privileges are proportional to its stated purpose.
Persistence & Privilege
always:false and no code that modifies agent/system configuration or other skills. The classes are in-process JS modules that emit events but do not persist credentials or alter global agent settings.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install yuyonghao-evaluation-suite
  3. After installation, invoke the skill by name or use /yuyonghao-evaluation-suite
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v0.1.2
Update - 2026-04-01
v1.0.1
Update from local workspace
v1.0.0
Initial release of yuyonghao-evaluation-suite. - Provides evaluation suite for RAG, reasoning, and hallucination detection. - Supports batch evaluation and unified API for multiple evaluation types. - Includes modular evaluators: RAGEvaluator, ReasoningEvaluator, HallucinationDetector. - Offers comprehensive documentation and quick start guides.
v0.3.0
- No changes detected in this version. - The changelog remains the same as the previous version. - Functionality, documentation, and code are unchanged from the prior release.
v0.2.0
Update to v0.2.0
v0.1.1
## v0.1.1 Changelog - No file changes detected in this release. - Documentation and functionality remain unchanged from v0.1.0.
v0.1.0
Initial release of the OpenClaw Evaluation Suite. - Supports RAG evaluation (retrieval quality, answer relevance, context accuracy) - Includes reasoning ability tests and hallucination detection for AI-generated content - Provides batch evaluation and a unified evaluation API - Modular design with dedicated classes for RAG, reasoning, and hallucination evaluation - Simple configuration and usage via JavaScript imports
Metadata
Slug yuyonghao-evaluation-suite
Version 0.1.2
License MIT-0
All-time Installs 0
Active Installs 0
Total Versions 7
Frequently Asked Questions

What is Evaluation Suite?

Provides API for evaluating RAG quality, logical reasoning, and detecting hallucinations in AI-generated content with batch support. It is an AI Agent Skill for Claude Code / OpenClaw, with 233 downloads so far.

How do I install Evaluation Suite?

Run "/install yuyonghao-evaluation-suite" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is Evaluation Suite free?

Yes, Evaluation Suite is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does Evaluation Suite support?

Evaluation Suite is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created Evaluation Suite?

It is built and maintained by yuyonghao-123 (@yuyonghao-123); the current version is v0.1.2.

💬 Comments