Skip to content
This repository was archived by the owner on Jul 22, 2025. It is now read-only.

Conversation

@SamSaffron
Copy link
Member

@SamSaffron SamSaffron commented Jan 22, 2025

Tracks duration_msec (milliseconds) for all AI LLM completions.

This assists in debugging performance issues with LLMs

@SamSaffron SamSaffron merged commit 8bf3502 into main Jan 23, 2025
6 checks passed
@SamSaffron SamSaffron deleted the predict_output branch January 23, 2025 00:32
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Development

Successfully merging this pull request may close these issues.

3 participants