✨Deepsparse Backend implementation#29

Closed

parfeniukink wants to merge 24 commits intomainfrom

parfeniukink/features/deepsparse-backend

Commits on Aug 22, 2024

WIP
Dmytro Parfeniuk
committed
✅ Tests are fixed
Dmytro Parfeniuk
committed
📌 deepsparse is added to dependencies
Dmytro Parfeniuk
committed
✨ deepsparse backend integration is added
Dmytro Parfeniuk
committed

Commits on Aug 26, 2024

deepsparse package limitations are applied
Dmytro Parfeniuk
committed

Commits on Aug 27, 2024

⚰️ removed `pytest.mark.asyncio()` due to pytest-asyncio module
Dmytro Parfeniuk
committed
📝 fixed class example
Dmytro Parfeniuk
committed

Commits on Aug 28, 2024

🧵 rollback `pytest.mark.asyncio` fixtures
Dmytro Parfeniuk
committed
✨ Deepsparse Backend integration first implementation
Dmytro Parfeniuk
committed
code quality is provided
Dmytro Parfeniuk
committed
Merge branch 'main' into parfeniukink/features/deepsparse-backend
Dmytro Parfeniuk
committed
fit Deepsparse Backend to work with new Backend abstraction
Dmytro Parfeniuk
committed

Commits on Aug 29, 2024

🔧 `GUIDELLM__LLM_MODEL` shared across all the backends
Dmytro Parfeniuk
committed
Test emulated data source constant -> settings value
Dmytro Parfeniuk
committed
💄 mdformat is happy
Dmytro Parfeniuk
committed
Merge branch 'main' into parfeniukink/features/deepsparse-backend
Dmytro Parfeniuk
committed
✅ Tests are fixed according to a new Backend base implementation
Dmytro Parfeniuk
committed

Commits on Aug 30, 2024

🔨 tox tests include `deepsparse` dependency
Dmytro Parfeniuk
committed
🏷️ Type annotations are added
Dmytro Parfeniuk
committed
🐛 Assert with config values instead of constants
Dmytro Parfeniuk
committed
📌 .[deepsparse] dependency is skipped if Python>3.11
Dmytro Parfeniuk
committed
🚚 DeepsparseBackend is moved to a another module
Dmytro Parfeniuk
committed
✅ Deepsparse tests are ignored if Python>=3.12
Dmytro Parfeniuk
committed
💚 Linters are happy
Dmytro Parfeniuk
committed