[BUG] Sitemap Invisible to Search Engines + no robots.txt

[DeepanshKhurana]

Bug Report

Describe the bug
The sitemap is not accessible to search engines and there is no robots.txt file present to declare the sitemap location. This may prevent proper indexing of site content. Additionally, the robots.txt path redirects to the default 404 page.

To Reproduce
Steps to reproduce the behavior:

1. Navigate to https://demo.ode.dimwit.me/sitemap.xml: visible
2. Attempt to access via automated crawler or search engine bot: fails
3. Check https://demo.ode.dimwit.me/robots.txt: fails / redirects to 404 page

Expected behavior

1. The sitemap should return HTTP 200 consistently for crawlers and browsers.
2. A robots.txt file should exist at the root (/robots.txt) and include a line declaring the sitemap:

Sitemap: <host>/sitemap.xml

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
The sitemap appears accessible via some direct curl requests but fails with some automated tools probably because of the robots.txt missing and redirecting. This is a hunch.