Search results

configureAiSdkTracing(): singleton pattern causes stale threadId/userId on long-lived servers

Status: Open.

#2500 In confident-ai/deepeval;

· young-mini-thomas opened on Feb 20, 2026

openAI Batch API Integration

Status: Open.

#2499 In confident-ai/deepeval;

· nikkumix opened on Feb 19, 2026

Security: deepeval hijacks global OpenTelemetry TracerProvider, exfiltrating host application trace data to third-party endpoints

Status: Open.

#2497 In confident-ai/deepeval;

· ajainvivek opened on Feb 18, 2026

Knowledge Retention metric not working

Status: Open.

#2472 In confident-ai/deepeval;

· tasneem200 opened on Feb 3, 2026

Conversation Completeness does not return fractional completion

awaiting release

Status: Open.

#2469 In confident-ai/deepeval;

· dhruvkb opened on Feb 2, 2026

An issue: <code>collection.count()</code> returns the number of chunks, not tokens.

Status: Open.

#2467 In confident-ai/deepeval;

· phungpx opened on Feb 2, 2026

Chat Transcript Not Showing Up

Status: Open.

#2458 In confident-ai/deepeval;

· JordanPropertyWise opened on Jan 27, 2026

Change cache folder path

awaiting release

Status: Open.

#2443 In confident-ai/deepeval;

· vection opened on Jan 19, 2026

Deepeval AzureOpenAI requires an api_key even when key based auth is disabled

awaiting clarification

Status: Open.

#2431 In confident-ai/deepeval;

· DeterjoSimon opened on Jan 13, 2026

Feat request: optional user-defined prompt builder for synthesizer

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#2396 In confident-ai/deepeval;

· dchou1618 opened on Dec 26, 2025

ARC benchmark should have several "modes" per question

Status: Open.

#2352 In confident-ai/deepeval;

· edoardocontente opened on Dec 3, 2025

ConversationRelevancyMetric Removed in DeepEval 3.7.x, Need Official Replacement &amp; Clarification

awaiting clarification

Status: Open.

#2321 In confident-ai/deepeval;

· sacjha-star opened on Nov 24, 2025