Using Batch API for AI Evaluations #6929
Unanswered
PramodValavala-MSFT
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I am looking to use the AI Evaluation libraries, and I see that all the evaluators are designed to use a ChatClient, with the internal prompt and metric extraction hidden within each.
I was wondering evaluations would be a perfect use case for leveraging the Batch API to run weekly jobs where continuous evaluation may not be necessary (say for insight generation, summaries, etc.)
Is there a way I can do this that I might be missing, or perhaps on the roadmap to support?
Beta Was this translation helpful? Give feedback.
All reactions