Skip to content

Conversation

@dependabot
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Dec 29, 2025

Bumps deepeval from 2.9.7 to 3.7.6.

Release notes

Sourced from deepeval's releases.

🎉 Metrics for AI agents, multi-turn synthetic data generation, and more!

Full support for agentic evals :)

If you're building agents, DeepEval can now analyze and give you metric scores based on the trace of your LLM app.

🎯 1. Task Completion

Evaluate whether an agent actually completes the intended task, not just whether its final output “looks correct.”

Captures:

  • Goal completion
  • Intermediate step correctness
  • Error recovery
  • Procedural accuracy

Docs: https://deepeval.com/docs/metrics-task-completion


🔧 2. Tool Correctness

Evaluates whether tools were invoked correctly, meaningfully, and in the right order.

Captures:

  • Correct tool usage
  • Correct argument formatting
  • Avoiding hallucinated tools
  • Using tools only when needed

Docs: https://deepeval.com/docs/metrics-tool-correctness


🧩 3. Argument Correctness

Evaluates whether the agent’s arguments to tools are valid, structured, and aligned to the task.

Captures:

  • Correct parameter selection
  • Type/format adherence
  • Logical argument formation
  • Avoiding semantically incorrect inputs

Docs: https://deepeval.com/docs/metrics-argument-correctness


⚡ 4. Step Efficiency

Measures how efficiently an agent completes a task — rewarding fewer unnecessary steps and penalizing detours.

Captures:

  • Optimality of step count
  • Redundant tool calls

... (truncated)

Commits

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [deepeval](https://github.com/confident-ai/deepeval) from 2.9.7 to 3.7.6.
- [Release notes](https://github.com/confident-ai/deepeval/releases)
- [Commits](https://github.com/confident-ai/deepeval/commits/v3.7.6)

---
updated-dependencies:
- dependency-name: deepeval
  dependency-version: 3.7.6
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added dependencies Pull requests that update a dependency file python Pull requests that update python code labels Dec 29, 2025
@coderabbitai
Copy link

coderabbitai bot commented Dec 29, 2025

Important

Review skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.


Comment @coderabbitai help to get the list of available commands and usage tips.

@dependabot @github
Copy link
Contributor Author

dependabot bot commented on behalf of github Dec 30, 2025

Superseded by #156.

@dependabot dependabot bot closed this Dec 30, 2025
@dependabot dependabot bot deleted the dependabot/pip/deepeval-3.7.6 branch December 30, 2025 03:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update python code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant