Hi.
I am quite impressed with what you've managed to achieve here - I wanted to flag a major gap. Especially for JS-heavy sites or ones that have search engines or multi-step landing or a combination of any of those, it would be good (rather necessary! IMO) to have an agent that has been supplied with a detailed prompt to navigate the search-engine/JS-heavy text box and then eventually arrive at a target page and then scrape and crawl it or use one of your in-house model sot fetch contents from it. A tool that is similar in capability to: https://docs.scrapegraphai.com/services/agenticscraper.
Hi.
I am quite impressed with what you've managed to achieve here - I wanted to flag a major gap. Especially for JS-heavy sites or ones that have search engines or multi-step landing or a combination of any of those, it would be good (rather necessary! IMO) to have an agent that has been supplied with a detailed prompt to navigate the search-engine/JS-heavy text box and then eventually arrive at a target page and then scrape and crawl it or use one of your in-house model sot fetch contents from it. A tool that is similar in capability to: https://docs.scrapegraphai.com/services/agenticscraper.