📦 Anti-Crawler Evasion — 技能工具
v1.0.0防止被反爬虫机制识别和封禁。当用户需要进行网页爬取、数据采集、API访问,或询问如何绕过反爬、避免IP封禁、隐藏爬虫身份时使用。触发词包括:反爬、反爬虫、绕过反爬、避免封禁、爬虫伪装、隐身爬取。
详细分析 ▾
- legal and ethical risk—bypassing site protections can violate terms of service and laws; (
- do not supply browser cookies, proxy credentials, or API keys to an untrusted skill—those can expose your sessions and accounts; (
- the skill omits required binaries and env vars, so you would need to install packages and drivers yourself—avoid copy/pasting unknown install commands; (
- prefer using sanctioned APIs or obtaining permission from target sites; (
- if you must test, run in an isolated sandbox with no real credentials and disable autonomous invocation so the agent cannot act without your explicit approval. Ask the publisher for a clear list of required packages, exact env vars, and a justification for any operation that reads local cookies or system devices before proceeding.
运行时依赖
版本
Initial release of anti-crawler-evasion skill. - Provides practical strategies for bypassing anti-crawling detection and bans, including user-agent rotation, proxy/IP rotation, and request header completeness. - Includes rate limiting techniques and adaptive delays to control request frequency and avoid bans. - Offers browser fingerprint randomization, cookie/session management, and JavaScript rendering challenge handling (with Selenium/Playwright). - Covers automated CAPTCHA solving via 2Captcha integration. - Details distributed crawling architecture and human-like behavior simulation for advanced evasion. - Lists common anti-crawler scenarios and countermeasures, and provides recommended tools for implementation.