Share your use case

[ziflex]

Hello folks!

I would like to ask you to share your use cases of using Ferret in order to better understand in which direction the project should move.

[ziflex]

Thanks for sharing!
Is there something you would want to add to Ferret in the future?

[ziflex]

Speaking of GUI, there is Dashboard UI for Ferret Server, it's still WIP, but you are welcome to contribute.

[ap0]

We are using it to scrape home showing data for our company’s real estate listings because they provide no API to access it. Overall it’s been a pretty solid solution save for issues where the sites we scrape are slow to load or have issues due to lots of SSO redirection. A nice to have feature would be something like “navigate to a URL and wait for it to get to this other URL after a series of redirections”

[ziflex]

@ap0 thank you for sharing!
Hmm, this is definitely something we need to think about. Thanks for the idea!

[ziflex]

@ap0 how did you integrate it? Are you using it via script as a CLI or embedded into your scraping system?

[ap0]

@ap0 how did you integrate it? Are you using it via script as a CLI or embedded into your scraping system?

We embed it into the scraping system.

[hubitor]

I would like to extract data from a each row of a given listing. Extract the links if they exist in the rows, follow these links, extract content form these pages. This must be done for all pages of the listing.

I personally would be very happy for any direction that would make scraping fast and mostly automatized.