← Back to Skills Marketplace
525
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install car-scraper
Description
车辆信息采集反爬 Skill - 从大搜车、懂车帝、汽车之家采集二手车/新车数据，输出 OpenClaw 兼容格式。USE FOR: 采集车辆列表、车辆详情、价格行情、商家信息。支持反爬对策: UA轮换、限速退避、Cookie管理、指纹伪装。
README (SKILL.md)
\r \r
万能反爬 Skill\r
\r
能力\r
\r
- 大搜车采集 (
dasouche_scraper.py): 采集 souche.com 二手车列表和详情\r - 懂车帝采集 (
dongchedi_scraper.py): 采集 dongchedi.com 二手车数据（API + SSR 双模式）\r - 汽车之家采集 (
autohome_scraper.py): 采集 che168.com 二手车数据（含字体反爬处理）\r - OpenClaw 导出 (
openclaw_export.py): 统一格式输出 JSON/JSONL/CSV\r \r
使用方式\r
\r
# 单平台采集\r
from dasouche_scraper import DasoucheScraper\r
scraper = DasoucheScraper()\r
result = scraper.scrape(pages=3)\r
\r
# OpenClaw 导出\r
from openclaw_export import export_scrape_result\r
files = export_scrape_result(result, output_format="json")\r
```\r
\r
## 数据模型\r
\r
所有车辆数据统一为 `VehicleInfo` (见 `data_models.py`)，包含:\r
- 品牌/车系/车型/年款\r
- 价格/里程/上牌信息\r
- 发动机/变速箱/驱动/排放等技术参数\r
- 图片/商家/车况描述\r
\r
## 反爬配置\r
\r
编辑 `config.py` 调整请求间隔、代理池、目标页数等参数。\r
Usage Guidance
This skill appears to be what it claims (a multi-site car-data scraper with anti-detection features). Before installing/run it: 1) Be aware it will perform outbound HTTP(S) requests to the target sites and may be used to circumvent anti-scraping measures (UA rotation, header fingerprinting, cookie handling, proxy support). Ensure you have the legal right and comply with the target sites' terms of service and local laws. 2) Run in a controlled environment (sandbox or isolated VM) if you're unsure, since the skill will write output files (config.py creates an output/ and openclaw/ directory inside the package). 3) Inspect and sanitize config.py before use — remove or review any proxy entries (they may contain credentials) and set acceptable rate limits to avoid causing harm. 4) Monitor network activity and logs during initial runs. 5) If you need to avoid evasion capabilities, remove/disable anti_detect features (UA rotation, fingerprinting) so behavior is conservative and transparent.
Capability Analysis
Type: OpenClaw Skill
Name: car-scraper
Version: 1.0.0
The skill bundle is a legitimate and well-structured car information scraping framework targeting major Chinese automotive platforms (Dasouche, Dongchedi, and Autohome). It implements standard scraping techniques, including User-Agent rotation, rate limiting with backoff strategies, and cookie management within 'anti_detect.py' to handle anti-scraping measures. The scrapers in 'dasouche_scraper.py', 'dongchedi_scraper.py', and 'autohome_scraper.py' focus on extracting public vehicle data and exporting it to structured formats (JSON/CSV) via 'openclaw_export.py'. No evidence of malicious intent, data exfiltration, or unauthorized execution was found.
Capability Assessment
Purpose & Capability
Name/description (car data scraping from 大搜车/懂车帝/汽车之家) match the provided Python modules and SKILL.md. The scrapers, data model, and OpenClaw export code correspond to the stated capabilities.
Instruction Scope
SKILL.md instructs the agent to import scrapers and export functions only (no broad file reads). The code will perform network requests to target sites, manage cookies, rotate UAs, use rate limiting and optionally proxies. One side-effect: config.py creates output directories at import time (os.makedirs on package path). The anti-detection logic explicitly aims to evade site protections — functionally coherent but worth noting for policy/ethical review.
Install Mechanism
No install spec; this is instruction + code files only. Dependencies appear to be standard Python libs (requests, bs4) referenced in requirements.txt — no unknown remote download or extract steps detected.
Credentials
The skill does not request environment variables, credentials, or external config paths. It contains an (empty) proxy list and configurable headers in config.py; no secrets are required by default. If you add proxies with credentials, that would raise additional risk.
Persistence & Privilege
always:false and no code that attempts to modify other skills or global agent configuration. The only persistent filesystem action is creating output directories within the package path and writing scraped output (OpenClaw exports), which is expected for this purpose.
How to Use
- Make sure OpenClaw is installed (local or Docker)
- Run the install command in chat:
/install car-scraper - After installation, invoke the skill by name or use
/car-scraper - Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
car-scraper v1.0.0
- Initial release with support for scraping used/new car data from Dasouche, Dongchedi, and Autohome.
- Provides anti-crawling strategies: user-agent rotation, rate limiting, cookie management, and fingerprint spoofing.
- Outputs data in OpenClaw-compatible formats (JSON, JSONL, CSV) with a unified VehicleInfo data model.
- Allows configuration of scraping behavior (delays, proxy pool, target pages) via config file.
Metadata
Frequently Asked Questions
What is Car Scraper?
车辆信息采集反爬 Skill - 从大搜车、懂车帝、汽车之家采集二手车/新车数据，输出 OpenClaw 兼容格式。USE FOR: 采集车辆列表、车辆详情、价格行情、商家信息。支持反爬对策: UA轮换、限速退避、Cookie管理、指纹伪装。 It is an AI Agent Skill for Claude Code / OpenClaw, with 525 downloads so far.
How do I install Car Scraper?
Run "/install car-scraper" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.
Is Car Scraper free?
Yes, Car Scraper is completely free, licensed under MIT-0. You can download, install and use it at no cost.
Which platforms does Car Scraper support?
Car Scraper is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).
Who created Car Scraper?
It is built and maintained by Strue (@jackiezhao-eng); the current version is v1.0.0.
More Skills