How to filter multiple userids in the evaluator?

[qa-ailabs]

Describe your question

How to filter multiple userids in the evaluator? It seems that this is not supported at present.

Langfuse Cloud or Self-Hosted?

Self-Hosted

If Self-Hosted

v3.137.0

If Langfuse Cloud

No response

SDK and integration versions

No response

Pre-Submission Checklist

• I have checked for existing issues/discussions and consulted Langfuse AI.

[inkeep-ai-assistant[bot]]

Based on the available documentation, the current filter system in Langfuse evaluators only supports AND operations between filter conditions(1). There isn't a built-in OR option for combining multiple User IDs directly in the evaluator setup UI(2).

To filter for multiple User IDs, you would need to use a workaround by applying common attributes (like tags or other metadata) that are shared across the traces you want to evaluate(2). If you need to evaluate traces from a specific list of User IDs, you might need to tag those traces first or use other shared attributes as filter criteria(2).

The filter builder in the evaluator configuration uses InlineFilterBuilder which applies filters with AND logic(1). This is a known limitation of the current filtering system.

📚 Sources:

1. langfuse/langfuse/web/src/features/evals/components/inner-evaluator-form.tsx
2. Issues when running an evaluator on existing traces

---

Have another question? Just tag @inkeep.

[jannikmaierhoefer]

Hi @qa-ailabs, thanks. We have support for OR filters on our roadmap.