- Added example code to demonstrate the usage of the
scheduledecorator - Added json monkey patch for httpx
- The environment variable
JSON_LIBcan be used to control whether to useujsonororjson
- The environment variable
- Utilized httpx hooks to add support for custom paths
- Added
patch_openaito maintain compatibility with custom embedding interface return formats
- Updated the default value of
hedged_request_proportion
- Added unit test code
- Removed
speed_up_retry, replaced withschedule - Removed the
custom_urlparameter from embedding-related interfaces
- Added
OpenAIChatProxyManagerclass for proxy management - Added keepalive configuration compatible with multiple HTTP frameworks
- Added retry logic
- Added transport configuration to
RewardServiceProxy - Added openai proxy functionality
- Added reward service client
- Optimized
speed_up_retryfunctionality - Introduced aiolimiter for faster task processing (2x+ performance improvement over version 0.1.0)
- Semaphore controls global concurrency, aiolimiter precisely controls concurrent context
- Concurrency control via semaphore (supporting both large batch and small batch task processing)
- Updated reward service interface parameters, usage methods and examples
- Updated examples and project dependencies
- Added unit test coverage (internal version code coverage: 91.56%)
- Other code formatting improvements