[WIP] Fix for TTFT bug#264

Merged

cnewell merged 5 commits intomainfrom

chrisn/ttft_logging_bug

Apr 8, 2025

Commits on Apr 7, 2025

Commits on Apr 8, 2025

Removing new inference.failure log, gating inference.timing log on first_ns instead of finish_reason
cnewell
committed
Merge branch 'main' into chrisn/ttft_logging_bug
cnewell
committed
Update src/message/create_message_service.py

cnewell
and
Sam Skjonsberg
authored