Applebot-Extended
Apple’s equivalent, governing whether your content feeds Apple Intelligence. Ordinary Applebot, which powers Siri and Spotlight, is controlled separately.
Related terms
Review Schema
Markup for ratings and reviews, including who wrote them. It feeds the star ratings in search results, and gives an assistant something concrete to cite about your reputation.
robots.txt
A plain text file at the root of a site listing which bots may read what. It is a request rather than a lock — well-behaved crawlers obey it, and all the major AI crawlers do.
PerplexityBot
Perplexity’s crawler. Perplexity cites its sources prominently, so being readable by it is one of the more direct routes to a visible citation.
LLM (Large Language Model)
The kind of AI behind ChatGPT, Claude and Gemini. It is trained on an enormous amount of text and predicts what should come next, which is enough to answer questions, summarise, translate and write.
Prompt
The instruction or question you give an AI. The wording matters more than people expect: the same request phrased two ways can produce noticeably different answers.
Training Data
The text, images or code a model learned from. It shapes everything the model knows and every bias it carries, and it is why what your website said two years ago may still be what an assistant repeats.

