Skip to content

Support session tracking for LLM request #633

New issue
New issue
Open
#1353
Open
Support session tracking for LLM request#633
#1353
Assignees
SleepyLGodhappyandslow
Labels
area/gatewayarea/inference-enginehelp wantedExtra attention is neededkind/featureCategorizes issue or PR as related to a new feature.priority/important-soonMust be staffed and worked on either currently, or very soon, ideally in time for the next release.
@Jeffwan

Description

@Jeffwan
Jeffwan
opened on Feb 5, 2025

🚀 Feature Description and Motivation

RAG and Agent patterns are all multi-thread programs, those application information should be exposed to underneath system to leverage for better colocation etc.

Use Case

No response

Proposed Solution

No response

Metadata

Metadata

Assignees

Labels

area/gatewayarea/inference-enginehelp wantedExtra attention is neededkind/featureCategorizes issue or PR as related to a new feature.priority/important-soonMust be staffed and worked on either currently, or very soon, ideally in time for the next release.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions