TrustyAI

TrustyAI integration with LLM Evaluation #45

Closed

ruivieira started this conversation in Ideas

ruivieira
Oct 1, 2024
Maintainer

Initial discussion: Integration with TrustyAI service foundation-model-stack/fms-lm-eval-service#20
Development branch: https://github.com/trustyai-explainability/trustyai-service-operator/tree/dev/lm-eval
Planning: TrustyAI planning (view)

Replies: 2 comments

ruivieira
Oct 22, 2024
Maintainer Author

LM-Eval support is now available in the latest images.

Initial documentation available at https://trustyai-explainability.github.io/trustyai-site/main/lm-eval-tutorial.html

0 replies

ruivieira
Feb 19, 2025
Maintainer Author

Closing this discussion as more specific/scoped LMEval topics can be opened.

0 replies

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment