Une carte des fetchers IA, des agents et des contrôles, appuyée par des sources.
Ce répertoire sépare les crawlers automatiques, les fetchers déclenchés par l'utilisateur et les jetons de contrôle des éditeurs en utilisant la documentation actuelle du fournisseur. Il s'agit d'une référence pour interpréter le trafic potentiel des agents IA et la politique des crawlers — et non une affirmation que chaque identité répertoriée a visité votre vitrine.
Une chaîne d'agent utilisateur n'est pas une preuve d'identité, et le comportement du fournisseur peut changer. Vérifiez les requêtes en utilisant l'adresse IP, le DNS ou les directives d'authentification actuelles du fournisseur lorsque disponibles. L'absence d'une identité listée ne prouve pas le trafic humain.
Entrées documentées
16
Opérateurs représentés
7
Sources vérifiées
Aug 29, 2026
Fetchers et agents déclenchés par l'utilisateur
5 entries- user triggered fetcher
ChatGPT-User
OpenAI
User-triggered fetcher used for certain actions in ChatGPT and Custom GPTs; it is not an automatic web crawler.
ChatGPT-User/1.0- Comportement des robots
- OpenAI says robots.txt rules may not apply because these requests are user-initiated.
- Preuves d'identité
- OpenAI publishes IP ranges for ChatGPT-User requests; the user-agent string remains spoofable.
- user triggered fetcher
Claude-User
Anthropic
Retrieves web content in response to user-initiated Claude requests.
Claude-User- Comportement des robots
- Anthropic says its bots honor robots.txt directives, including Claude-User.
- Preuves d'identité
- Anthropic's crawler guidance links a current source-IP list; do not trust the token alone.
- user triggered fetcher
Perplexity-User
Perplexity
User-triggered fetcher that may visit a page to help answer a Perplexity user's question; it is not used for web crawling or foundation-model training.
Perplexity-User/1.0- Comportement des robots
- Perplexity says this fetcher generally ignores robots.txt because the request was initiated by a user.
- Preuves d'identité
- Perplexity publishes IP ranges for Perplexity-User; combine the token and source IP rather than trusting the token alone.
- user triggered fetcher
Google-Agent
Google
Used by agents hosted on Google infrastructure to navigate the web and perform actions upon user request.
Google-Agent (browser-style user-agent string)- Comportement des robots
- Google says user-triggered fetchers generally ignore robots.txt rules because the fetch was requested by a user.
- Preuves d'identité
- Google publishes user-triggered-agent IP ranges and is experimenting with Web Bot Auth for the agent.bot.goog identity.
- user triggered fetcher
Amzn-User
Amazon
Supports user actions such as fetching current web information to answer Alexa queries on a user's behalf; Amazon says it is not used for generative-AI model training.
Amzn-User/0.1- Comportement des robots
- Amazon says because Amzn-User actions can be user-initiated, it may not follow all robots.txt directives.
- Preuves d'identité
- Amazon publishes IP addresses for Amzn-User; use source verification in addition to the token.
Robots d'exploration de recherche automatiques
5 entries- search crawler
OAI-SearchBot
OpenAI
Automatic crawler used to surface websites in ChatGPT search results.
OAI-SearchBot/1.4 (documented example; version may change)- Comportement des robots
- Managed with the OAI-SearchBot token in robots.txt.
- Preuves d'identité
- Match the token with OpenAI's published SearchBot IP ranges; a user-agent string alone is not proof.
- search crawler
Claude-SearchBot
Anthropic
Navigates the web to improve the relevance and accuracy of Claude search responses.
Claude-SearchBot- Comportement des robots
- Anthropic says its bots honor robots.txt directives.
- Preuves d'identité
- Anthropic's crawler guidance links a current source-IP list; do not trust the token alone.
- search crawler
PerplexityBot
Perplexity
Automatic crawler designed to surface and link websites in Perplexity search results; Perplexity says it is not used to crawl content for foundation-model training.
PerplexityBot/1.0- Comportement des robots
- Perplexity recommends managing PerplexityBot through robots.txt.
- Preuves d'identité
- Perplexity publishes IP ranges for PerplexityBot; combine the token and source IP rather than trusting the token alone.
- search crawler
Applebot
Apple
Apple web crawler used for search experiences including Spotlight, Siri, and Safari; Apple says crawled data may also support foundation-model training and current-content context for AI outputs.
Applebot/<version> within Apple's documented browser-style user-agent format- Comportement des robots
- Applebot respects standard robots.txt directives in general search crawls.
- Preuves d'identité
- Apple documents reverse-DNS verification under *.applebot.apple.com and publishes Applebot IP CIDR ranges.
- search crawler
Amzn-SearchBot
Amazon
Amazon search crawler used to improve search experiences in Amazon products and services, including eligibility for experiences such as Alexa; Amazon says it is not used for generative-AI model training.
Amzn-SearchBot/0.1- Comportement des robots
- Amazon documents robots.txt allow/disallow support for its crawlers.
- Preuves d'identité
- Amazon publishes IP addresses for Amzn-SearchBot; use source verification in addition to the token.
Robots d'exploration pour le développement de modèles
2 entries- model development crawler
GPTBot
OpenAI
Automatic crawler for content that may be used to train OpenAI generative AI foundation models.
GPTBot/1.4 (documented example; version may change)- Comportement des robots
- Managed separately with the GPTBot token in robots.txt.
- Preuves d'identité
- Match the token with OpenAI's published GPTBot IP ranges; a user-agent string alone is not proof.
- model development crawler
ClaudeBot
Anthropic
Collects public web content that could potentially contribute to Anthropic model training.
ClaudeBot- Comportement des robots
- Anthropic says its bots honor robots.txt directives.
- Preuves d'identité
- Anthropic's crawler guidance links a current source-IP list; do not trust the token alone.
Robots d'exploration de fournisseurs généraux
1 entry- general crawler
Amazonbot
Amazon
Amazon crawler used to improve products and services; Amazon says collected content may also be used to train Amazon AI models.
Amazonbot/0.1- Comportement des robots
- Amazon documents robots.txt allow/disallow support for its crawlers.
- Preuves d'identité
- Amazon publishes IP addresses for Amazonbot; use source verification in addition to the token.
Jetons de contrôle de l'éditeur
2 entries- control token
Google-Extended
Google
Publisher control for whether Google-crawled content may be used for future Gemini model training and specified grounding uses.
robots.txt token; no separate HTTP request user-agent- Comportement des robots
- Google-Extended is a robots.txt product-control token and does not affect Google Search inclusion or ranking.
- Preuves d'identité
- Not a request identity. Do not look for Google-Extended as a standalone HTTP user-agent in traffic logs.
- control token
Applebot-Extended
Apple
Publisher control for whether Applebot-crawled content may be used to train Apple's general-purpose foundation models.
robots.txt control token; does not crawl webpages- Comportement des robots
- Applebot-Extended is configured in robots.txt but does not itself crawl webpages.
- Preuves d'identité
- Not a request identity. Traffic should be attributed to Applebot, not Applebot-Extended.
Robots d'exploration du corpus web ouvert
1 entry- web corpus crawler
CCBot
Common Crawl
Automated crawler that collects public web data for Common Crawl's open web-crawl repository.
CCBot/2.0- Comportement des robots
- Common Crawl documents robots.txt support for CCBot.
- Preuves d'identité
- Common Crawl publishes dedicated IP ranges and reverse-DNS guidance; the project also warns that clients can falsely claim the CCBot user-agent.
Trois classes ne devraient pas être regroupées sous une seule étiquette « bot ».
Robots d'exploration automatiques
Search and model-development crawlers operate automatically and are generally managed through provider-specific robots.txt policy.
Récupérateurs déclenchés par l'utilisateur
These requests happen because a user or agent asked a provider to retrieve or act on a page. Robots behavior can differ materially from automatic crawlers.
Tokens de contrôle
Google-Extended and Applebot-Extended are publisher controls, not standalone HTTP crawler identities. They should not be treated as traffic labels.
Ce que cet annuaire établit — et ce qu'il n'établit pas.
- Il enregistre les identités et les contrôles documentés par les fournisseurs nommés lors de l'examen de cette page.
- Cela n'établit pas qu'une requête portant l'une de ces chaînes est légitime ; les chaînes peuvent être falsifiées.
- Cela n'établit pas que le trafic non reconnu est humain.
- Cela n'établit pas ce qu'un modèle d'IA externe a conclu, préféré, recommandé, comparé ou décidé.
Documentation du fournisseur vérifiée 2026-08-29 · Revérifier la source primaire liée avant l'application opérationnelle
Cartograph est construit autour de preuves, pas de la confiance des agents utilisateurs.
La couche de preuve prévue est destinée à séparer l'identité déclarée, les preuves de vérification, l'activité observée de la vitrine et les inconnues. Cartograph n'est pas un bloqueur de robots, un WAF ou un outil de contrôle du trafic.