seo
robots.txt
File instructing search crawlers which paths they may access.
Misconfiguration can deindex entire adviser sites. Always audit after migrations, especially when moving to headless or Jamstack stacks.
File instructing search crawlers which paths they may access.
Misconfiguration can deindex entire adviser sites. Always audit after migrations, especially when moving to headless or Jamstack stacks.