Rag Evaluator

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like a ragaai catalyst, python, agentic-ai.

This skill appears coherent and local-only: it stores logs and exports under ~/.local/share/rag-evaluator and does not contact external endpoints or request credentials. Before installing or running it, review the included scripts (scripts/script.sh). Be aware that commands like `prompt`, `configure`, or `evaluate` log whatever you pass — avoid entering secrets or API keys into those entries. Exports and logs are stored on disk (they may grow over time), so consider disk space and file permissions. If you want extra safety, run the script in an isolated environment (container or dedicated user account) or modify DATA_DIR to point to a controlled location. Finally, note the JSON export is implemented naively and may produce invalid JSON for values containing quotes or newlines; treat exported files accordingly.

Type: OpenClaw Skill Name: rag-evaluator Version: 2.0.0 The skill is a local logging utility for RAG (Retrieval-Augmented Generation) evaluation metrics, implemented as a Bash script. It records user-provided strings into categorized log files within `~/.local/share/rag-evaluator/` and provides basic search and export functionality. While the documentation in SKILL.md incorrectly refers to it as a 'Python SDK', the actual script (scripts/script.sh) is transparent, lacks network access, and contains no indicators of malicious intent, data exfiltration, or unauthorized execution.