ClaudeBot
Anthropic’s crawler, which reads public pages for Claude. Like the others it identifies itself and follows robots.txt.
Related terms
Token
The unit an AI reads and writes in — roughly three quarters of a word. Models are priced and limited by tokens, which is why very long documents cost more and sometimes get truncated.
Content Negotiation
When the same URL serves different formats depending on what the visitor asks for — HTML for a browser, Markdown for an assistant. It lets one address serve people and machines without either getting a compromise.
User-Agent
The name a browser or bot gives when it requests a page. It is how a server tells Googlebot from ChatGPT from a person, and how robots.txt rules are addressed to one and not another.
Predictive Analytics
Using historical data to estimate what will happen next: which customers will lapse, which stock will run out. Useful precisely to the degree that the past resembles the future.
Inference
The moment an AI actually answers, as opposed to when it was trained. Training happens once and costs a fortune; inference happens every time somebody asks, and is what you pay for per use.
Rich Result
A search listing with something extra — stars, prices, an image, an FAQ dropdown. Rich results come from structured data, and they take up more of the screen than a plain blue link.