Updated ETGet the DI Daily by Email

Technology news for e-commerce professionals, with our take on why it matters.

Ongoing coverage: Retailers pick sides on outside AI shopping agents

Google tells sites how to let its AI agent past firewalls, lists six reasons it fails

Google tells sites how to let its AI agent past firewalls, lists six reasons it fails
Image: PPC Land

The guide asks sites to skip CAPTCHAs for verified Google-Agent traffic and warns that many users' requests share the same Google IP addresses.

Source: PPC Land

Google published a guide titled "Allow Google-Agent traffic" on November 17, 2026, telling website operators and their CDN, firewall and bot-detection vendors how to let its AI agent through, PPC Land reported. The guide sets four rules: confirm the User-Agent header contains Google-Agent, confirm the IP address is in Google's user-triggered-agents.json file, verify a Web Bot Auth signature if one is provided, and skip bot challenges for requests that pass.

The guide lists six checks for when legitimate requests are still blocked, including rule priority, interactive challenges and per-IP rate limits. Google says concurrent requests from multiple users share the same egress pool, and that broad data center blocks, managed bot rules or category-level AI agent block policies can override an allow rule. Its list of in-journey actions includes on-site search, filtering, add-to-cart and booking. Google's fetcher page says such user-triggered fetchers generally ignore robots.txt rules, and only a subset of Google-Agent requests is signed.

PPC Land noted the guide gives no volume figures, names no vendors or Google products that use the agent, and does not explain how to block it. The outlet cited Blend's audit, which found bot protection blocked its AI shopping agent at 29 of 200 UK and US retailers. Separately, PPC Land reported that Google made Gemini's task mode, which can compare products and check out, free in six countries the same day.

Read the full article at PPC Land

Our take

Allowing Google-Agent means exempting a shared pool of Google addresses from the rate limits and challenges that protect your checkout, so you rely on Google's own traffic controls, which the guide does not describe.

  • Decide whether you want agent orders from Google before your bot vendor's defaults decide for you.
  • Ask that vendor whether it verifies Google-Agent and where AI agent block policies sit in rule order.

Was our take useful?

Key takeaways

  1. Google's guide asks sites to skip bot challenges for verified Google-Agent traffic
  2. Google says many users' agent requests share the same egress IP pool
  3. Blend found bot protection blocked its shopping agent at 29 of 200 retailers

More on this topic

Illustration for Retailers pick sides on outside AI shopping agents
Illustration: Digital Influence

Ongoing story21 postsUpdated Nov 18

Retailers pick sides on outside AI shopping agents

The largest retailers and marketplaces are splitting over whether third-party AI agents can shop their stores.