Skip to content

test(sdk): add benchmark regression sleep#2359

Open
Eugene Yurtsev (eyurtsev) wants to merge 3 commits intomainfrom
eugene/benchmark-sleep-regression
Open

test(sdk): add benchmark regression sleep#2359
Eugene Yurtsev (eyurtsev) wants to merge 3 commits intomainfrom
eugene/benchmark-sleep-regression

Conversation

@eyurtsev
Copy link
Copy Markdown
Collaborator

Adds an intentional sleep(1) inside create_deep_agent() so benchmark CI should flag the regression path we want to validate.

Created with Deep Agents CLI using gpt-5.4 (provider: openai).

@github-actions github-actions bot added deepagents Related to the `deepagents` SDK / agent harness internal User is a member of the `langchain-ai` GitHub organization size: XS < 50 LOC tests Adding tests or correcting existing labels Mar 31, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Mar 31, 2026

Merging this PR will not alter performance

✅ 32 untouched benchmarks
⏩ 15 skipped benchmarks1


Comparing eugene/benchmark-sleep-regression (d2e5cf8) with main (f3a19e9)

Open in CodSpeed

Footnotes

  1. 15 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@mdrxy Mason Daugherty (mdrxy) marked this pull request as ready for review April 1, 2026 19:00
Copilot AI review requested due to automatic review settings April 1, 2026 19:00
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR intentionally injects a fixed delay into create_deep_agent() to trigger benchmark regression detection in CI.

Changes:

  • Import sleep from time.
  • Add an unconditional sleep(0.1) at the start of create_deep_agent().

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

deepagents Related to the `deepagents` SDK / agent harness internal User is a member of the `langchain-ai` GitHub organization size: XS < 50 LOC tests Adding tests or correcting existing

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants