Applebot-Extended
Apple’s equivalent, governing whether your content feeds Apple Intelligence. Ordinary Applebot, which powers Siri and Spotlight, is controlled separately.
Related terms
llms.txt
An emerging convention: a plain-text file at your site root that gives AI systems a clean map of what is on it. It saves an assistant from crawling around to work out what your site contains.
AI Referral Traffic
Visitors who arrive from an AI assistant rather than a search engine. Usually small in number and unusually well-qualified, because they clicked after reading a recommendation.
robots.txt
A plain text file at the root of a site listing which bots may read what. It is a request rather than a lock — well-behaved crawlers obey it, and all the major AI crawlers do.
JSON-LD
The format Google and the AI assistants prefer for structured data — a block of machine-readable facts tucked into the page. It states plainly what prose only implies: this is the business, this is the address, this is the price.
PerplexityBot
Perplexity’s crawler. Perplexity cites its sources prominently, so being readable by it is one of the more direct routes to a visible citation.
Context Window
How much text a model can hold in mind at once, counted in tokens. Anything beyond it is forgotten, which is why very long conversations start to lose earlier details.