Favicon of scrapling

scrapling Skill

AI Agent SkillPythonOpen source

Web scraping with Scrapling - HTTP fetching, stealth browser automation, Cloudflare bypass, and spider crawling via CLI and Python. Published by NousResearch in hermes-agent.

What is scrapling Skill?

Web scraping with Scrapling - HTTP fetching, stealth browser automation, Cloudflare bypass, and spider crawling via CLI and Python. Published by NousResearch in hermes-agent. This profile combines repository metadata with install, compatibility, and usage signals so developers can quickly decide whether it fits their agent workflow before opening the source repository.

Trust signal
95/100
Maintenance signal
90/100
Adoption signal
100/100

Automated repository signals based on public metadata such as recency, license, installation evidence, and adoption. These are not a security audit or endorsement.

Key capabilities

  • Includes SKILL.md support
  • Reusable instructions support
  • Browser automation
  • Data analysis
  • Research
  • Browser automation use cases
  • Data analysis use cases

Technical details

Copy skill directory
  • Install or run with Copy skill directory

When to use scrapling Skill

  • Use it for browser automation.
  • Use it for data analysis.
  • Use it for research.

Built with

PythonCopy skill directory

Editorial notes

Source

  • Creator: NousResearch
  • Repository: NousResearch/hermes-agent
  • Skill file: optional-skills/research/scrapling/SKILL.md

What it does

Web scraping with Scrapling - HTTP fetching, stealth browser automation, Cloudflare bypass, and spider crawling via CLI and Python.

Skill instructions

Scrapling Scrapling is a web scraping framework with anti-bot bypass, stealth browser automation, and a spider framework. It provides three fetching strategies (HTTP, dynamic JS, stealth/Cloudflare) and a full CLI. This skill is for educational and research purposes only. Users must comply with local/international data scraping laws and respect website Terms of Service. When to Use - Scraping static HTML pages (faster than browser tools) - Scraping JS-rendered pages that need a real browser - Bypassing Cloudflare Turnstile or bot detection - Crawling multiple pages with a spider - When the built-in webextract tool does not return the data you need Installation bash pip install "scrapling[all]" scrapling install Minimal install (HTTP only, no browser): bash pip install scrapling With browser automation only: bash pip install "scrapling[fetchers]" scrapling install Quick Reference | Approach | Class | Use When | |----------|-------|----------| | HTTP | Fetcher / FetcherSession | Static p

Explore related resources

Frequently asked questions

What is scrapling?

scrapling is a open-source AI agent skill with Copy skill directory. Web scraping with Scrapling - HTTP fetching, stealth browser automation, Cloudflare bypass, and spider crawling via CLI and Python.

Who is scrapling best for?

scrapling is best for reusing agent instructions, scripts, and references, browser automation workflows, data analysis workflows, research workflows.

How do I install scrapling?

Install or run scrapling using Copy skill directory. Check scrapling for the latest setup command.

Is scrapling actively maintained?

scrapling may need a closer maintenance check before production use.

Share:

Stars
214,436
Forks
39,858
Last commit
9 days ago
Repository age
1 year
License
MIT

Auto-fetched from GitHub.

Similar to scrapling