Skip to content

Conversation

@dependabot
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Dec 30, 2025

⚠️ Dependabot is rebasing this PR ⚠️

Rebasing might not happen immediately, so don't worry if this takes some time.

Note: if you make any changes to this PR yourself, they will take precedence over the rebase.


⚠️ Dependabot is rebasing this PR ⚠️

Rebasing might not happen immediately, so don't worry if this takes some time.

Note: if you make any changes to this PR yourself, they will take precedence over the rebase.


Bumps deepeval from 2.9.7 to 3.7.7.

Release notes

Sourced from deepeval's releases.

🎉 Metrics for AI agents, multi-turn synthetic data generation, and more!

Full support for agentic evals :)

If you're building agents, DeepEval can now analyze and give you metric scores based on the trace of your LLM app.

🎯 1. Task Completion

Evaluate whether an agent actually completes the intended task, not just whether its final output “looks correct.”

Captures:

  • Goal completion
  • Intermediate step correctness
  • Error recovery
  • Procedural accuracy

Docs: https://deepeval.com/docs/metrics-task-completion


🔧 2. Tool Correctness

Evaluates whether tools were invoked correctly, meaningfully, and in the right order.

Captures:

  • Correct tool usage
  • Correct argument formatting
  • Avoiding hallucinated tools
  • Using tools only when needed

Docs: https://deepeval.com/docs/metrics-tool-correctness


🧩 3. Argument Correctness

Evaluates whether the agent’s arguments to tools are valid, structured, and aligned to the task.

Captures:

  • Correct parameter selection
  • Type/format adherence
  • Logical argument formation
  • Avoiding semantically incorrect inputs

Docs: https://deepeval.com/docs/metrics-argument-correctness


⚡ 4. Step Efficiency

Measures how efficiently an agent completes a task — rewarding fewer unnecessary steps and penalizing detours.

Captures:

  • Optimality of step count
  • Redundant tool calls

... (truncated)

Commits

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

@dependabot dependabot bot added dependencies Pull requests that update a dependency file python Pull requests that update python code labels Dec 30, 2025
@coderabbitai
Copy link

coderabbitai bot commented Dec 30, 2025

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.


Comment @coderabbitai help to get the list of available commands and usage tips.

@dependabot dependabot bot force-pushed the dependabot/pip/deepeval-3.7.7 branch from f647812 to cf839ff Compare January 15, 2026 14:24
Bumps [deepeval](https://github.com/confident-ai/deepeval) from 2.9.7 to 3.7.7.
- [Release notes](https://github.com/confident-ai/deepeval/releases)
- [Commits](https://github.com/confident-ai/deepeval/commits/v3.7.7)

---
updated-dependencies:
- dependency-name: deepeval
  dependency-version: 3.7.7
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot force-pushed the dependabot/pip/deepeval-3.7.7 branch from cf839ff to d098542 Compare January 15, 2026 15:26
@galshubeli
Copy link
Contributor

@dependabot recreate

@galshubeli
Copy link
Contributor

@dependabot resolve conflict

@galshubeli
Copy link
Contributor

@dependabot recreate

@galshubeli galshubeli closed this Jan 18, 2026
@dependabot @github
Copy link
Contributor Author

dependabot bot commented on behalf of github Jan 18, 2026

OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting @dependabot ignore this major version or @dependabot ignore this minor version. You can also ignore all major, minor, or patch releases for a dependency by adding an ignore condition with the desired update_types to your config file.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.

@dependabot dependabot bot deleted the dependabot/pip/deepeval-3.7.7 branch January 18, 2026 13:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update python code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants