File tree Expand file tree Collapse file tree 1 file changed +10
-3
lines changed
Expand file tree Collapse file tree 1 file changed +10
-3
lines changed Original file line number Diff line number Diff line change @@ -129,10 +129,17 @@ <h3>2️⃣ Inference from CLI</h3>
129129--generation-kwargs '{"do_sample": false, "top_p": 0.95}'</ code > </ pre >
130130
131131 < h3 > 3️⃣ Evaluation API (Python)</ h3 >
132- < pre > < code > from llmsql import LLMSQLEvaluator
132+ < pre > < code > from llmsql import evaluate
133133
134- evaluator = LLMSQLEvaluator()
135- report = evaluator.evaluate(outputs_path="path_to_your_outputs.jsonl")
134+ report =evaluate(outputs="path_to_your_outputs.jsonl")
135+ print(report)
136+ </ code > </ pre >
137+ < p > Or with ther results from the infernece:</ p >
138+ < pre > < code > from llmsql import evaluate
139+
140+ # results = inference_transformers(...) or infernce_vllm(...)
141+
142+ report =evaluate(outputs=results)
136143print(report)
137144</ code > </ pre >
138145
You can’t perform that action at this time.
0 commit comments