Multiple backends

[alilee]

This is awesome - congrats.

Architecturally, it would be great if you could specify one or more backends and use async to process input that has come back from any of them. Do you think this is how it would be done? Or should you put each llm chat in a discrete async context? In any case, a parallel pattern would be very useful for evals.

Also, do you think it would be possible to make this usable from wasm?

[graniet]

Thank you for your issue,

This branch adds an evaluator for different LLM models (does this match your request?): #3

As for the async part, a feature will be coming soon!

[alilee]

Very nice. It would be easy to hit the llms in parallel with async. I am going to play with it for a while.. thanks.