[AutoDeploy][Feature]: Basic LorA Support #8741
Description
🚀 The feature, motivation and pitch
Support LorA in AutoDeploy. Minimum requirements are:
- Single LorA adapter
- No sharding.
- No performance tuning.
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.
Metadata
Metadata
Assignees
Labels
Type
Projects
Status