Exposure · Check
robots.txt empty — at minimum, declare a Sitemap
An empty robots.txt is functionally the same as no file. At a minimum, declare your sitemap location (`Sitemap: https://yourdomain.com/sitemap.xml`) so search engines find it without having to guess.
Real-world risk
An empty 200 response is ambiguous; some agents treat it like a blank policy while others ignore it.
Fix steps (in order)
- Add explicit directives (even Allow: /) or return 404 if you intentionally have no policy file.
Verify the fix in 30 seconds
Run a Scorifya scan on the affected host after deploy. The same finding id (robots_txt_empty) clears once the externally-observable signal is in place.