-
-
Notifications
You must be signed in to change notification settings - Fork 56
Sitemap for Large sites with filter date/year #649
Copy link
Copy link
Open
Labels
[Component] Sitemap[Impact] GrowthChanges helping the plugin grow, not necessarily helping the current users.Changes helping the plugin grow, not necessarily helping the current users.[Type] FeatureSomething new we need to write from the ground up.Something new we need to write from the ground up.
Description
Hello, The sitemap feature can be optimized a little more.
It takes over 30 seconds to generate.
For large websites, like news websites which host a lot of old data, the sitemap generation can take a lot of processing power and waste resources.
I have seen this approach from metro.co.uk/sitemap.xml
They have developed https://github.com/Automattic/msm-sitemap in collaboration with automatic.
With this approach, you are hitting two issues.
- Your crawl budget is optimized as Crawling takes place with only the newer or updated sitemaps.
- Generation of new sitemaps is faster as it ads only the sitemap with a newer date, month, year. As per your setup.
Reactions are currently unavailable
Metadata
Metadata
Labels
[Component] Sitemap[Impact] GrowthChanges helping the plugin grow, not necessarily helping the current users.Changes helping the plugin grow, not necessarily helping the current users.[Type] FeatureSomething new we need to write from the ground up.Something new we need to write from the ground up.