support for 1 bit llm bitNet?

[akashAD98]

Checked

• I searched existing ideas and did not find a similar one
• I added a very descriptive title
• I've clearly described the feature request and motivation for it

Feature request

github : https://github.com/microsoft/BitNet

bitnet.cpp is the official inference framework for 1-bit LLMs (e.g., BitNet b1.58). It offers a suite of optimized kernels, that support fast and lossless inference of 1.58-bit models on CPU (with NPU and GPU support coming next).

Motivation

we can using like other llm providers such as ollam,openai etc

Proposal (If applicable)

No response

[NiloufarAb]

Yes, pleas! It's much needed.

[LuisMoralesAlonso]

Definitely, much much needed