← Back to Skills Marketplace
146
Downloads
0
Stars
1
Active Installs
1
Versions
Install in OpenClaw
/install agent-survey-corpus
Description
Download a small corpus of open-access arXiv survey/review PDFs about LLM agents and extract text for style learning. **Trigger**: agent survey corpus, ref c...
README (SKILL.md)
Agent Survey Corpus (arXiv PDFs → text extracts)
Goal: create a small, local reference library so you can learn from real agent surveys when refining:
- C2 outline structure (paper-like sectioning)
- C4 tables/claims organization
- C5 writing style and density
This is intentionally not part of the pipeline; it is an optional, repo-level toolkit.
Inputs
ref/agent-surveys/arxiv_ids.txt
Outputs
ref/agent-surveys/pdfs/ref/agent-surveys/text/ref/agent-surveys/STYLE_REPORT.md(tracked; auto-generated summary)
Workflow
- Edit
ref/agent-surveys/arxiv_ids.txt(one arXiv id per line). - Run the downloader to fetch PDFs and extract the first N pages to text.
- Skim the extracted text under
ref/agent-surveys/text/:- look at section counts (H2), subsection granularity (H3), and how they transition between chapters.
- identify repeated rhetorical patterns you want the pipeline writer to imitate.
Script
Quick Start
python scripts/run.py --helppython scripts/run.py --workspace . --max-pages 20
All Options
--workspace \x3Cdir>(use.to write into repo root)--inputs \x3Csemicolon-separated>(default:ref/agent-surveys/arxiv_ids.txt)--max-pages \x3CN>(default: 20)--sleep \x3Cseconds>(default: 1.0)--overwrite(re-download + re-extract)
Examples
- Download/extract into repo root
ref/:python scripts/run.py --workspace . --max-pages 20
- Download/extract into a specific folder (treated as workspace root):
python scripts/run.py --workspace /tmp/surveys --max-pages 30
Troubleshooting
- Download fails / timeout: rerun with a larger
--sleep, or try fewer ids. - Text extract is empty: the PDF may be scanned; try another survey or increase
--max-pages. - Files showing up in git status: PDFs/text are ignored via
.gitignore(ref/**/pdfs/,ref/**/text/).
Usage Guidance
This skill is coherent and limited in scope, but take these practical steps before running: 1) Run it in an explicit workspace directory (e.g., a temp folder) so PDFs/text are confined and not accidentally committed to a repo; SKILL.md notes .gitignore but verify your repo ignores ref/**/pdfs/ and ref/**/text/. 2) Ensure you install required Python packages (PyMuPDF / pymupdf and any YAML libs if you use other tooling files) — the skill does not provide an install step. 3) Confirm network access is acceptable and that downloading the listed arXiv IDs is permitted for your use case (arXiv PDFs are generally open-access but check licenses for reuse). 4) Inspect and control ref/agent-surveys/arxiv_ids.txt before running so you only download expected papers. If you want stricter isolation, run the script inside a disposable container or VM.
Capability Analysis
Type: OpenClaw Skill
Name: agent-survey-corpus
Version: 1.0.0
The agent-survey-corpus skill bundle is a legitimate research utility designed to download arXiv survey PDFs and extract their text for structural analysis. The core logic in `scripts/run.py` uses standard libraries (`urllib`, `xml.etree`) and `PyMuPDF` (`fitz`) to fetch metadata and content from official arXiv endpoints (arxiv.org). The extensive `tooling/` directory provides a comprehensive framework for pipeline execution, quality gating, and research ideation, all of which align with the stated purpose of assisting in academic writing. No indicators of data exfiltration, malicious execution, or prompt injection were found.
Capability Assessment
Purpose & Capability
Name/description (download arXiv survey PDFs and extract text for style analysis) aligns with the files and code. The downloader only targets arxiv.org export API and arxiv.org/pdf URLs and writes outputs under ref/agent-surveys/, which is consistent with the stated purpose.
Instruction Scope
SKILL.md instructs editing ref/agent-surveys/arxiv_ids.txt and running scripts/run.py with workspace and max-pages options; the script reads that id list, fetches metadata, downloads PDFs and extracts the first N pages to text. The instructions do not ask the agent to read unrelated files or secrets.
Install Mechanism
There is no install spec (instruction-only install), which is low risk. However, the Python script uses third-party packages (PyMuPDF as fitz, and other tooling files reference yaml/etc.) but the skill does not declare Python dependencies or installation steps; users must install required Python packages manually before running.
Credentials
The skill requires no environment variables, no credentials, and no privileged config paths. Network access is necessary and explicitly documented; all network calls are to arxiv.org/export.arxiv.org and arxiv.org/pdf only.
Persistence & Privilege
always is false and the skill does not request persistent platform privileges. It writes files to the provided workspace only and does not modify other skills or system-level agent settings.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install agent-survey-corpus - After installation, invoke the skill by name or use
/agent-survey-corpus - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
- Initial release of agent-survey-corpus skill for downloading and extracting text from arXiv survey/review PDFs about LLM agents.
- Provides a toolkit to build a local reference library for analyzing real survey structures and writing styles.
- Supports customizable workspace, page limits, and safe download (arXiv-only) with guardrails to keep large files outside git.
- Includes clear workflow and CLI script for managing PDFs and extracting text for study and style learning.
Metadata
Frequently Asked Questions
What is Agent Survey Corpus?
Download a small corpus of open-access arXiv survey/review PDFs about LLM agents and extract text for style learning. **Trigger**: agent survey corpus, ref c... It is an AI Agent Skill for Claude Code / OpenClaw, with 146 downloads so far.
How do I install Agent Survey Corpus?
Run "/install agent-survey-corpus" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Agent Survey Corpus free?
Yes, Agent Survey Corpus is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Agent Survey Corpus support?
Agent Survey Corpus is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Agent Survey Corpus?
It is built and maintained by WILLOSCAR (@willoscar); the current version is v1.0.0.
More Skills