★ 26,431Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript1,759 forks6 min read
★ 16,113The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.
TypeScript452 forks4 min read
★ 9,668Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Python832 forks5 min read
★ 2,668Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.
TypeScript277 forks7 min read
★ 2,498Collection of Apify agent skills
Python281 forks5 min read
★ 1,101A universal CLI client for MCP. mcpc supports persistent sessions, stdio/HTTP, OAuth 2.1, tasks, JSON output for code mode, proxy for AI sandboxes, x402, and more.
TypeScript109 forks8 min read
★ 1,058TypeScript/Node.js implementation of a proxy server (think Squid) with support for SSL, HTTP/HTTPS, SOCKS5, authentication, and upstream proxy chaining.
TypeScript170 forks6 min read
★ 777HTTP client made for scraping based on got.
TypeScript62 forks6 min read
★ 640impit | rust library for browser impersonation
Rust52 forks8 min read