Skip to content

jryebread/terrarium

Repository files navigation

Crawlee + PlaywrightCrawler + LangChain AI Agent

AI Agent web crawlers!

Warning: Code is very messy currently, sorry. More changes coming.

I made some updates from the existing video, It now pulls the text from the current page as well, so that information is also provided to the agent, and It can more reliably find things like pricing information on a companies page.

to run the crawler

npm install & npm start

About

AI agent webscrapers

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published