From c07522717f5c7362f4534a31623a1fec5236e115 Mon Sep 17 00:00:00 2001 From: Muhammad Zain ul abidin Date: Fri, 13 Mar 2026 11:00:23 +0500 Subject: [PATCH] Add crawl4ai to web scraping libraries list Crawl4AI correct url --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 0d876101..1316cb99 100644 --- a/README.md +++ b/README.md @@ -1144,6 +1144,7 @@ _Libraries to automate web scraping._ - [browser-use](https://github.com/browser-use/browser-use) - Make websites accessible for AI agents with easy browser automation. - [feedparser](https://github.com/kurtmckee/feedparser) - Universal feed parser. +- [crawl4ai](https://github.com/unclecode/crawl4ai) - An open-source, LLM-friendly web crawler that provides lightning-fast, structured data extraction specifically designed for AI agents. - [grab](https://github.com/lorien/grab) - Site scraping framework. - [mechanicalsoup](https://github.com/MechanicalSoup/MechanicalSoup) - A Python library for automating interaction with websites. - [scrapy](https://github.com/scrapy/scrapy) - A fast high-level screen scraping and web crawling framework.