ArtificialInfluenceBot
We fetch a small number of public pages to analyse sources that AI engines cite, and to audit customers’ own websites.
- Identifies itself honestly:
ArtificialInfluenceBot/1.0with this page’s address and a contact email. - Obeys robots.txt on every request and redirect, including
Crawl-delay. - Makes at most one request per second per site, caches pages and uses conditional requests.
- Never logs in, never bypasses paywalls or CAPTCHAs, and honours
noindex,noaiandX-Robots-Tag. - Stores structure and a short excerpt (300 characters at most), never a copy of your page.
Opt out
Add this to your robots.txt:
User-agent: ArtificialInfluenceBot Disallow: /
Or email crawler@artificialinfluence.example from an address at your domain. Opt-outs take effect immediately.