← all repositories

scraperai/scraperai

AI-powered web scraping tool that uses LLMs to extract data and generate reusable scraping configurations.

410 stars HTML Data Tooling
scraperai
Velocity · 7d
+0.4
★ / day
Trend
steady
star history

ScraperAI is an open-source web scraping tool that leverages Large Language Models like ChatGPT to extract structured data from web pages. It provides automatic detection of page types, XPATHs, pagination patterns, and generates reusable scraping recipes. The tool supports custom LLMs through LangChain integration and can work with Selenium for dynamic content.

heatdrop uses Google Analytics to see which pages get read — nothing else. Your call. How we handle data.