Token budgets, llms.txt and turning pages into context a model can read.
Write the file that tells a language model what your site is and which pages matter, in the shape the convention asks for.