Scrapling 🕷️

@Scrapling_dev

Scrapling is an adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl by @D4Vinci1 Follow for daily tips & tricks.

scrapling.readthedocs.io/en/latest/

Дата регистрации: апрель 2025 г.

Закреплено
Scrapling 🕷️
@Scrapling_dev
23 авг.
Important 🚨
Karim Shoair
@D4Vinci1
23 авг.
Scrapling v0.4.15 is out, and it's one of the biggest releases this year 🚀 🤖 The MCP server is reworked from the ground up. Tools are now split into one-shot tools and session tools, so your AI agent's session settings never get silently overwritten again. The new make_request
Scrapling 🕷️
@Scrapling_dev
11 ч
🕷️ Scrapling tip: SitemapSpider can start from robots.txt. It finds the listed sitemaps, follows nested sitemap indexes, and sends page responses to your parse() method. Discover pages without writing link or XML traversal code ⚡
Scrapling 🕷️
@Scrapling_dev
29 сент.
A big clap to our new Platinum Partner @proxylane_dev 👏
Платное партнерство
Scrapling 🕷️
@Scrapling_dev
29 сент.
🕷️ Scrapling tip: page_action can load an infinite-scroll page before Scrapling reads its HTML. Scroll, wait for new items, then use .css() on the final response. This demo gets all 100 quotes instead of the first 10 in one fetch() call. ⚡
Scrapling 🕷️
@Scrapling_dev
28 сент.
🕷️ Scrapling tip: page_setup lets you capture live WebSocket messages. Attach a framereceived listener before the page loads, then collect raw data as it arrives. Useful for live feeds whose data is missing from the HTML. ⚡