v0.2.10
What's Changed
- Add Exception handling test for Async LitAPI Loops by @bhimrazy in #483
- Save references for async tasks to prevent tasks disappearing mid execution by @bhimrazy in #482
- Add tests for async loop processing by @bhimrazy in #485
- fix inference process termination by @aniketmaurya in #486
- Fix: CLI entry point to use lightning_sdk directly by @aniketmaurya in #487
- Remove asyncio.sleep and run in threadpool by @aniketmaurya in #489
- Enable true concurrency in async streaming loop and add tests by @bhimrazy in #488
Full Changelog: v0.2.9...v0.2.10