File instructing search crawlers which paths they may access.
Misconfiguration can deindex entire adviser sites. Always audit after migrations, especially when moving to headless or Jamstack stacks.