google.com/goto: Google's anti-scraping update(autom.dev)
671 points by 1e1a 45 days ago | 536 comments
tl;dr: Google Search now wraps organic result links in `google.com/goto?url=...` with an opaque, non-decodable blob instead of the previous plaintext `google.com/url?q=` format, forcing scrapers to make an extra request to Google (reading the `Location` header) just to resolve each destination URL. The change, rolled out broadly to logged-out and private sessions by late August 2026, is part of Google's escalating anti-scraping efforts alongside removing `&num=100` and tightening BotGuard/SearchGuard.
HN Discussion:
  • ↑Google has been declining for years and users are switching to alternatives like Yandex, DuckDuckGo, or Mojeek
  • ↑URL obfuscation is a longstanding anti-user pattern that breaks web norms and locks out small players
  • ↑Google is hypocritical for blocking scrapers while scraping the entire web themselves
  • ↓This change doesn't affect regular users and outrage is just reflexive Google-hate
  • •Technical curiosity about the implementation details or alternatives like self-hosted search indexes