Real Estate Spider

专业爬取中国房产中介网站（安居客、搜房网、贝壳找房、链家）数据的通用爬虫技能，包含反爬虫策略和自动数据提取功能

This skill appears to do what it claims (crawler + anti‑bot workarounds), but it contains steps that handle and store sensitive session cookies, recommends using proxies and third‑party CAPTCHA‑solving services, and writes session/cookie files to disk. Before installing or running it: 1) Review the shell scripts and Python code line‑by‑line (especially any code that saves or loads session files, or performs network uploads). 2) Do not paste real authentication cookies or API keys into the scripts unless you understand the risks; prefer manual CAPTCHA handling. 3) Run initially in an isolated environment (VM/container) and with non‑privileged user account. 4) Replace example proxy endpoints and CAPTCHA service URLs with vetted providers only if necessary, and store API keys in a secure place (and add explicit env var support). 5) Verify legality and website terms of service for scraping target sites in your jurisdiction. If you are not comfortable auditing the code, treat this skill as high‑risk and avoid providing real credentials or cookies.

Type: OpenClaw Skill Name: real-estate-spider Version: 1.0.0 This bundle is a functional real estate data crawler designed for Chinese platforms such as Lianjia, Beike, and Anjuke. It utilizes standard Python scraping libraries (requests, BeautifulSoup) and the OpenClaw agent-browser tool to extract property details while managing anti-bot measures like User-Agent rotation, random delays, and session persistence. The code logic in main.py and the scripts (e.g., real_estate_crawler.py) is transparently aligned with the stated purpose, and no evidence of data exfiltration, credential theft, or unauthorized system access was found.