failure on the scrape

[mrman486]

Loving degoog so far so I thought I would give the mcp a go.

the search works, however when the llm tries to go deeper I am seeing this

example from the log

degoog-mcp-1 | 2026-06-26 09:30:19 [INFO ] search: q="ASX200 index today June 26 2026" type="web" page=1 time="" lang="" engines=[] max=5
degoog-mcp-1 | 2026-06-26 09:30:20 [INFO ] degoog: ok q="ASX200 index today June 26 2026" type="web" engines=0 hits=5 capped=10 took=1003ms
degoog-mcp-1 | 2026-06-26 09:38:45 [INFO ] scrape: dispatching 1 url(s)
degoog-mcp-1 | 2026-06-26 09:38:46 [WARN ] scraper: fetch url=https://www.asx200.com/search?q=ASX200: Get "https://www.asx200.com/search?q=ASX200": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2026-06-26T09:38:46Z is after 2024-07-16T23:59:59Z
degoog-mcp-1 | 2026-06-26 09:38:46 [WARN ] scraper: failed url=https://www.asx200.com/search?q=ASX200 reason=fetch: Get "https://www.asx200.com/search?q=ASX200": tls: failed to verify certificate: x509: certificate has expired or is not yet valid: current time 2026-06-26T09:38:46Z is after 2024-07-16T23:59:59Z

Seems the date is wrong from somewhere. I am connected to llama.cpp so I am unsure if that is pushing the wrong date or the mcp docker is wrong.

Thank you

[fccview]

Hey, thank you for using drgoog ❤️ this looks like the target site’s TLS certificate is expired rather than llama.cpp or the MCP container having the wrong date..

The cert for that URL shows this:

notBefore=Apr 17 00:00:00 2024 GMT
notAfter=Jul 16 23:59:59 2024 GMT
subject=CN=55pandas.com
issuer=cPanel, Inc.

The mcp will rightfully refuse to scrape non https sites, I suppose I could add a flag to allow it, but it'd be a fairly dodgy choice..

Has this happened on any other search tests?

[mrman486]

Well that makes a lot of sense. Thank you for the insight on this. No doubt the asx200 site has not been updated properly hence causing the issues.

I tried a direct request to scrape a page and it worked ok so this could be a one off. Typical first thing I tried I got this error

degoog-mcp-1 | 2026-06-26 10:16:25 [INFO ] scraper: ok url=https://www.abc.net.au/news/2026-06-26/asx-markets-business-news-live-updates-friday-26-june/106843954 title="ASX gains ground, ACCC announces anti-price gouging law — as it happened" bytes=11999

Thanks again for the great work on degoog, it's my goto now for all my searches.