diff --git a/README.md b/README.md index 0d876101..77eda819 100644 --- a/README.md +++ b/README.md @@ -1143,6 +1143,7 @@ _Libraries for extracting web contents._ _Libraries to automate web scraping._ - [browser-use](https://github.com/browser-use/browser-use) - Make websites accessible for AI agents with easy browser automation. +- [crawl4ai](https://github.com/unclecode/crawl4ai) - An open-source, LLM-friendly web crawler that provides lightning-fast, structured data extraction specifically designed for AI agents. - [feedparser](https://github.com/kurtmckee/feedparser) - Universal feed parser. - [grab](https://github.com/lorien/grab) - Site scraping framework. - [mechanicalsoup](https://github.com/MechanicalSoup/MechanicalSoup) - A Python library for automating interaction with websites.