AI Plugin Indextavily-crawl vs scrape
tavily-crawl and scrape are both browser automation skills. scrape scores higher (87 vs 40 out of 100). scrape has more GitHub stars (33k), and scrape was updated more recently (4 days ago). The table compares them side by side.
| tavily-crawl | scrape | |
|---|---|---|
| Score | 40 / 100 | 87 / 100 |
| What it does | Collect content from many pages on the same site. Use when the user wants to crawl, download docs, extract a whole section such as /docs, bulk-extract pages, or says "get all the pages" or "extract everything under". | Scrape any webpage as clean markdown via Bright Data Web Unlocker API. Bypasses bot detection and CAPTCHA. Requires BRIGHTDATA_API_KEY and BRIGHTDATA_UNLOCKER_ZONE environment variables. |
| Publisher | Community: CognitionAI | Community: davila7 |
| Grades | Maintenance A, Licence A, Quality C | Maintenance A, Licence A, Quality A |
| npm downloads a week | Not on npm | Not on npm |
| Runs | Skill | Skill |
| Works with | Claude Code, Claude apps | Claude Code, Claude apps |
| GitHub stars | 12 | 32,775 |
| Last commit | 16 Oct 2026 | 20 Oct 2026 |
| Licence | MIT | MIT |
| Listed since | 19 Oct 2026 | 20 Oct 2026 |
| Install tavily-crawl | Install scrape |
Questions
Is tavily-crawl or scrape more popular?
scrape has more GitHub stars: 32,775.
Can I use tavily-crawl and scrape together?
Yes. AI assistants can load several skills at once. Install both and the assistant picks the right one for each task.