Add crawl4ai to web scraping libraries list

Crawl4AI correct url
This commit is contained in:
Muhammad Zain ul abidin
2026-03-13 11:00:23 +05:00
committed by GitHub
parent 6c1fa49291
commit c07522717f

View File

@@ -1144,6 +1144,7 @@ _Libraries to automate web scraping._
- [browser-use](https://github.com/browser-use/browser-use) - Make websites accessible for AI agents with easy browser automation.
- [feedparser](https://github.com/kurtmckee/feedparser) - Universal feed parser.
- [crawl4ai](https://github.com/unclecode/crawl4ai) - An open-source, LLM-friendly web crawler that provides lightning-fast, structured data extraction specifically designed for AI agents.
- [grab](https://github.com/lorien/grab) - Site scraping framework.
- [mechanicalsoup](https://github.com/MechanicalSoup/MechanicalSoup) - A Python library for automating interaction with websites.
- [scrapy](https://github.com/scrapy/scrapy) - A fast high-level screen scraping and web crawling framework.