feat(robots.txt): add guide for extending robots.txt functionality #1988
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
BrocksiNet
commented
Oct 31, 2025
BrocksiNet
commented
- Introduce a new guide on how to extend robots.txt in Shopware, including event handling for custom validation and dynamic directives.
- Update the SEO index to reference the new robots.txt guide.
* Introduce a new guide on how to extend robots.txt in Shopware, including event handling for custom validation and dynamic directives. * Update the SEO index to reference the new robots.txt guide.
5 tasks
mitelg
reviewed
Oct 31, 2025
…ocumentation * Update titles and references to 'robots.txt file' for consistency. * Improve phrasing and formatting in the overview and directive sections for better readability. * Ensure proper inline code formatting for 'robots.txt' throughout the documentation.
* Change title references from 'robots.txt file' to 'robots configuration' for consistency. * Update version references from 6.7.4 to 6.7.5 in the guide. * Add a new example subscriber for validating sitemap directives and crawl-delay values. * Improve overall structure and readability of the robots configuration documentation.
* Add tabs for better organization of code examples related to custom directive subscribers and service registration. * Include a complete XML service definition for the CustomDirectiveSubscriber. * Improve overall structure and readability of the documentation.
Contributor
There was a problem hiding this comment.
Pull Request Overview
This PR adds comprehensive documentation for extending Shopware's robots.txt configuration functionality. The changes introduce a new guide that explains how to programmatically customize robots.txt behavior through events, alongside updates to the main SEO documentation page to organize content into clear sections.
- Added new guide "Extend robots configuration" with detailed examples for handling robots.txt directives
- Restructured the main SEO index page to organize content into SEO URLs and Robots configuration sections
- Documented three key extensibility patterns: modifying parsed directives, handling custom directives, and managing parse issues
Reviewed Changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.
| File | Description |
|---|---|
| guides/plugins/plugins/content/seo/index.md | Reorganized content into structured sections with subsections for SEO URLs and Robots configuration |
| guides/plugins/plugins/content/seo/extend-robots-txt.md | New comprehensive guide with code examples for extending robots.txt functionality through events |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
Isengo1989
reviewed
Oct 31, 2025
* Change title from 'Extend robots configuration' to 'Extend robots.txt configuration' for improved specificity and consistency.
Contributor
There was a problem hiding this comment.
Pull Request Overview
Copilot reviewed 3 out of 3 changed files in this pull request and generated no new comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
…on guide * Change code block syntax from lowercase to uppercase for PHP and XML examples for consistency and improved readability. * Ensure uniformity in formatting across all code examples in the documentation.
Contributor
There was a problem hiding this comment.
Pull Request Overview
Copilot reviewed 3 out of 3 changed files in this pull request and generated no new comments.
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
mitelg
requested changes
Nov 3, 2025
…bots.txt extension guide * Replace references to 'EventSubscriber' with 'EventListener' for consistency in terminology. * Update code examples to reflect the new naming conventions and improve clarity. * Add validation checks for conflicting Allow/Disallow directives in the robots.txt parsing process. * Enhance overall structure and readability of the documentation.
mitelg
approved these changes
Nov 4, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.