Rework Backend to Native HTTP Requests and Enhance API Compatibility & Performance#91

Merged

markurtz merged 18 commits intomainfrom

openai_backend_fixes

Mar 12, 2025

Commits on Mar 8, 2025

Adds aiohttp backend

anmarques
authored and
markurtz
committed
Add mean and percentile info as computed_field properties such that they become serializable

anmarques
authored and
markurtz
committed
quality fixes

anmarques
authored and
markurtz
committed
quality fix

anmarques
authored and
markurtz
committed
Quality fixes

anmarques
authored and
markurtz
committed
Ignore EOS

anmarques
authored and
markurtz
committed
Ignore EOS

anmarques
authored and
markurtz
committed
Refactor generate_benchmark_report function to set default parameter values

anmarques
authored and
markurtz
committed
Add mean and percentile info as computed_field properties such that they become serializable

anmarques
authored and
markurtz
committed
quality fixes

anmarques
authored and
markurtz
committed
Quality fixes

anmarques
authored and
markurtz
committed
Ignore EOS

anmarques
authored and
markurtz
committed
Ignore EOS

anmarques
authored and
markurtz
committed
Rework for OpenAI backend to use native http requests with httpx and http/2 support. Additionally, add in support for multi modal requests (needs further enablement in the rest of the system for fu…
markurtz
committed
Ensure core, request, and utils tests are all passing
markurtz
committed
Finalize implementation, fix bugs, and ensure unit tests are passing / in place
markurtz
committed
Rebase on latest main
markurtz
committed
Fix pre-commit checks not passing
markurtz
committed