Skip to content

Commit d6d7f37

Browse files
authored
Skip testing flaky evals example (#2518)
1 parent 5968775 commit d6d7f37

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

docs/evals.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -313,7 +313,7 @@ _(This example is complete, it can be run "as is")_
313313

314314
You can control concurrency during evaluation (this might be useful to prevent exceeding a rate limit):
315315

316-
```python {title="parallel_evaluation_example.py" line_length="100"}
316+
```python {title="parallel_evaluation_example.py" line_length="100" test="skip"}
317317
import asyncio
318318
import time
319319

@@ -341,8 +341,8 @@ async def double_number(input_value: int) -> int:
341341
# Run evaluation with unlimited concurrency
342342
t0 = time.time()
343343
report_default = dataset.evaluate_sync(double_number)
344-
print(f'Evaluation took less than 1s: {time.time() - t0 < 1}')
345-
#> Evaluation took less than 1s: True
344+
print(f'Evaluation took less than 0.5s: {time.time() - t0 < 0.5}')
345+
#> Evaluation took less than 0.5s: True
346346

347347
report_default.print(include_input=True, include_output=True, include_durations=False) # (1)!
348348
"""

0 commit comments

Comments
 (0)