help: disable bots for specific domain

[bjarnef]

📚 What are you trying to do?

By default bots are disallowed for non production environments:
https://nuxtseo.com/docs/robots/getting-started/introduction#production-only-indexing

However when having a test domain on production, can this disallow bots?

Perhaps something like this in route rules?
https://nuxtseo.com/docs/robots/guides/route-rules

🔍 What have you tried?

No response

ℹ️ Additional context

No response

[harlan-zw]

Hi, you can use NUXT_SITE_ENV="staging", which is still deployed as a production site but is marked as non-production for Nuxt SEO. This is a bit hidden in the docs, I need to make it clearer.

Alternatively using nuxt config.

export default defineNuxtConfig({
  site: {
    env: 'staging' // example
  }
})

Or use the nitro hooks https://nuxtseo.com/docs/site-config/guides/runtime-site-config#plu

[bjarnef]

@harlan-zw thanks 😎

Regarding the first I am not sure this a possible as the "test" hostname is target the same as production domain.

In traditional ASP.NET MVC project one can have something like this to set no index:

@if (Context.Request.GetDisplayUrl().Contains("test.io")  ||  Model.NoIndex)
{
    <meta name="robots" content="noindex, nofollow" />
}

In this specific use case the site is static generated, so this should be same file:

test.temp-domain.com/robots.txt
mydomain.com/robots.txt

[harlan-zw]

Hmm, i'm not too sure I understand, you're comparing a SSR app to a static site 🤔

You can set the site env variable as part of the CI that generates the test static build, and it will make everything noindex

[bjarnef]

Is it possible to handle on prerender in e.g. Nuxt Config via hooks?
https://nuxtseo.com/docs/robots/api/nuxt-hooks

E.g. set site indexable to false based on a condition?
https://nuxtseo.com/docs/robots/guides/disable-indexing

[GerryWilko]

@harlan-zw I think he may be asking is there a way to programmatically disable indexing at the site level? As in at runtime rather than via an environment variable.