Applebot-Extended
Apple’s equivalent, governing whether your content feeds Apple Intelligence. Ordinary Applebot, which powers Siri and Spotlight, is controlled separately.
Related terms
Guardrails
The limits placed on what an AI may say or do — refusing certain requests, staying on topic, never inventing a price. Essential on anything customer-facing.
OAI-SearchBot
The crawler OpenAI uses to answer live searches in ChatGPT, separate from GPTBot. Blocking one does not block the other, so a site can be absent from ChatGPT search while still being read for training.
Neural Network
A system of simple connected units, loosely inspired by the brain, that learns patterns from examples rather than following rules somebody wrote. Nearly all modern AI is built on one.
Topical Authority
Being recognised as a reliable source on a subject rather than on a single keyword, usually by covering it thoroughly and consistently. It is what makes a small site beat a bigger one in a narrow field.
User-Agent
The name a browser or bot gives when it requests a page. It is how a server tells Googlebot from ChatGPT from a person, and how robots.txt rules are addressed to one and not another.
Tool Use
An AI reaching outside itself to do something it cannot do alone: run a search, do arithmetic reliably, read a live page. Nearly every useful assistant depends on it.