feat: enhance algolia-mcp skill with evals and improved docs 🔬#5
Merged
leonardocuco merged 1 commit intomainfrom Mar 18, 2026
Merged
Conversation
…tent Add evaluation framework and improve SKILL.md by surfacing critical details from reference files into the main skill body for more robust behavior. Changes to SKILL.md: - Surface filter syntax (facetFilters OR/AND, numericFilters strings) - Surface clickAnalytics: true guidance with supported tools list - Surface recommendation thresholds (50/60/75) and model parameter table - Add analytics interpretation benchmarks (no-results rate, click positions) - Add Common Workflows (Search Quality Audit, Recommendation Setup Check) - Add algolia-cli cross-reference for write operations Evals (5 scenarios, 100% with-skill vs 27% baseline): - Search with filters (facetFilters + numericFilters + facet values) - Analytics report (tool selection + clickAnalytics + date params) - Recommendations (model params + threshold + trending-items) - Multi-step investigation (diagnose no-results + CTR comparison) - Date filtering (Unix timestamps + pagination + combined filters) Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Key improvements to SKILL.md
clickAnalytics: trueguidance with which tools support it, data delay warningEval results
The skill's value is overwhelmingly about MCP tool interface knowledge — every baseline fabricated wrong tool names, skipped the discovery step, and missed
clickAnalytics: true.Test plan
🤖 Generated with Claude Code