Skip to content

Comments

refactor: restructure langsmith-evaluator skill with 3 core components#11

Open
xuro-langchain wants to merge 1 commit intomainfrom
update-langsmith-evaluator-skill
Open

refactor: restructure langsmith-evaluator skill with 3 core components#11
xuro-langchain wants to merge 1 commit intomainfrom
update-langsmith-evaluator-skill

Conversation

@xuro-langchain
Copy link
Collaborator

@xuro-langchain xuro-langchain commented Feb 23, 2026

Summary

  • Add "Defining Run Functions" as new core section for trajectory capture
  • Move trajectory capture guidance from evaluators to run_functions section
  • Add guidance for both LangChain OSS and custom agents
  • Condense example_workflow and running_evaluations to reduce duplication

Test plan

  • Verified skill structure is clear and organized
  • Confirmed all examples are preserved

🤖 Generated with Claude Code

- Add "Defining Run Functions" as new core section for trajectory capture
- Move trajectory capture guidance from evaluators to run_functions section
- Add guidance for both LangChain OSS and custom agents
- Condense example_workflow and running_evaluations to reduce duplication
- Remove trajectory as separate evaluator type (it's custom code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant