[GenAI] Use BitsAndBytes for 4bit quantization.#7406
Open
LittleLittleCloud wants to merge 8 commits intodotnet:mainfrom
Open
[GenAI] Use BitsAndBytes for 4bit quantization.#7406LittleLittleCloud wants to merge 8 commits intodotnet:mainfrom
LittleLittleCloud wants to merge 8 commits intodotnet:mainfrom