How to disable indexing of certain pages, tags and series.

[mrdanielmartins]

Hello all 👋,

I can see in Google Search Console that several tags were indexed.

Is there a way to configure and disable indexing on certain pages, tags and series so that search engines ignore and do not index them?

For example, blocking search engines from indexing https://example.example/categories/ so it does not appear in search results.

I don't mind the Tags page being indexed - I don't want tags I've created to be indexed.

I see a variable of robotsNoIndex, but not sure how I would apply that to the pages and ant tags.

Many thanks,

Dan

[mrdanielmartins]

Right, I see how to block the indexing of particular pages by creating layouts/robots.txt file, and doing something like this:

User-agent: *
Disallow: /search
Sitemap: https://www.example.example

I guess to block indexing of the tag page and tags themselves, I would need to add something like this:

Disallow: /tags/
Disallow: /tags/*

Hopefully this is on the right track.