A search crawler indexes you. An agent reads you.
A crawler fetches pages and stores signals. An agent fetches pages and tries to do something with them: answer a question, complete a task, or write code against your API. It reads the whole page in one or two requests, counts tokens, and decides whether the content fits its context window. If it does not fit, it may silently truncate it, skip it, or fall back on assumptions and invent something.