Adds agent guidelines documentation

Introduces a comprehensive guide for developers acting as AI agents working on the Foundatio.Lucene library.

This document outlines the project's architecture, coding standards, testing methodologies, and best practices to ensure high-quality, maintainable code. It emphasizes a craftsman mindset, visitor-based extensibility, and thorough validation to promote backward compatibility, performance, and reliability.

Author: niemyjski