Skip to content

ArtificialInfluenceBot

We fetch a small number of public pages to analyse sources that AI engines cite, and to audit customers’ own websites.

  • Identifies itself honestly: ArtificialInfluenceBot/1.0 with this page’s address and a contact email.
  • Obeys robots.txt on every request and redirect, including Crawl-delay.
  • Makes at most one request per second per site, caches pages and uses conditional requests.
  • Never logs in, never bypasses paywalls or CAPTCHAs, and honours noindex, noai and X-Robots-Tag.
  • Stores structure and a short excerpt (300 characters at most), never a copy of your page.

Opt out

Add this to your robots.txt:

User-agent: ArtificialInfluenceBot
Disallow: /

Or email crawler@artificialinfluence.example from an address at your domain. Opt-outs take effect immediately.