Skip to content

Add robots.txt#1

Merged
Manaiakalani merged 1 commit intomainfrom
add-robots-txt
Jan 25, 2026
Merged

Add robots.txt#1
Manaiakalani merged 1 commit intomainfrom
add-robots-txt

Conversation

@Manaiakalani
Copy link
Owner

This PR adds a robots.txt file that:

  • Allows major search engines (Google, Bing, DuckDuckGo)
  • Blocks AI training crawlers (GPTBot, CCBot, Google-Extended, etc.)
  • Blocks aggressive SEO bots (Ahrefs, Semrush, etc.)

@github-actions
Copy link

Azure Static Web Apps: Your stage site is ready! Visit it here: https://ambitious-forest-06068521e-1.westus2.azurestaticapps.net

@Manaiakalani Manaiakalani merged commit 9f3585e into main Jan 25, 2026
2 checks passed
@Manaiakalani Manaiakalani deleted the add-robots-txt branch January 25, 2026 06:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant