Search results

Add OpenRouter Integration for Metrics Evaluation

Status: Open.

#2626 In confident-ai/deepeval;

· Djalal-H opened on Apr 22, 2026

Contextual Precision over-penalizes overlapping chunks in financial-document RAG

Status: Open.

#2594 In confident-ai/deepeval;

· Ruthwik-Data opened on Apr 2, 2026

Clarvia MCP: Tool quality scoring for DeepEval benchmarking pipelines

Status: Open.

#2587 In confident-ai/deepeval;

· digitamaz opened on Mar 31, 2026

Trust scoring as an evaluation metric — source tier and provenance

Status: Open.

#2586 In confident-ai/deepeval;

· HMAKT99 opened on Mar 31, 2026

Feature Request: Multilingual RAG Evaluation Support (Non-Latin Scripts, Low-Resource Languages)

Status: Open.

#2578 In confident-ai/deepeval;

· rajantripathi opened on Mar 27, 2026

The RAGAS metrics is not working

Status: Open.

#2562 In confident-ai/deepeval;

· L-Shier opened on Mar 19, 2026

'NoneType' object has no attribute 'find'

Status: Open.

#2554 In confident-ai/deepeval;

· nicolablago opened on Mar 16, 2026

Proposal: ship WFGY 16-problem RAG failure taxonomy as a built-in tag set

Status: Open.

#2517 In confident-ai/deepeval;

· onestardao opened on Feb 28, 2026

Support PDF in LLMTestCase input for agentic evaluation

Status: Open.

#2511 In confident-ai/deepeval;

· anuar12 opened on Feb 26, 2026

ConfidentInstrumentationSettings with pydantic-ai: tools_called, expected_tools, and actual_output are all None when using OpenAIResponsesModel

Status: Open.

#2508 In confident-ai/deepeval;

· anuar12 opened on Feb 26, 2026

Security: deepeval hijacks global OpenTelemetry TracerProvider, exfiltrating host application trace data to third-party endpoints

Status: Open.

#2497 In confident-ai/deepeval;

· ajainvivek opened on Feb 18, 2026

Conversation Completeness does not return fractional completion

awaiting release

Status: Open.

#2469 In confident-ai/deepeval;

· dhruvkb opened on Feb 2, 2026