mirror of
https://github.com/vinta/awesome-python.git
synced 2026-03-23 13:56:43 +08:00
Add crawl4ai to web scraping libraries list
Crawl4AI correct url
This commit is contained in:
committed by
GitHub
parent
6c1fa49291
commit
c07522717f
@@ -1144,6 +1144,7 @@ _Libraries to automate web scraping._
|
||||
|
||||
- [browser-use](https://github.com/browser-use/browser-use) - Make websites accessible for AI agents with easy browser automation.
|
||||
- [feedparser](https://github.com/kurtmckee/feedparser) - Universal feed parser.
|
||||
- [crawl4ai](https://github.com/unclecode/crawl4ai) - An open-source, LLM-friendly web crawler that provides lightning-fast, structured data extraction specifically designed for AI agents.
|
||||
- [grab](https://github.com/lorien/grab) - Site scraping framework.
|
||||
- [mechanicalsoup](https://github.com/MechanicalSoup/MechanicalSoup) - A Python library for automating interaction with websites.
|
||||
- [scrapy](https://github.com/scrapy/scrapy) - A fast high-level screen scraping and web crawling framework.
|
||||
|
||||
Reference in New Issue
Block a user