Support bitnet models

[mvafin]

What does this PR do?

Add support for bitnet models.

Fixes # (issue)

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you make sure to update the documentation with your changes?
• Did you write any new necessary tests?

[echarlaix]

@bot /style

[github-actions]

Style fixes have been applied. View the workflow run here.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[mvafin]

@IlyasMoutawwakil could you help with testing this? I wanted to use awq or gptq models as reference, but are they tested?
I see the test tests/openvino/test_modeling.py::OVModelForCausalLMIntegrationTest::test_compare_to_transformers, but it fails for me locally, does it work in regular validation?

[IlyasMoutawwakil]

does it work in regular validation?

yes the awq/gptq tests pass usually.

[mvafin]

@IlyasMoutawwakil Thanks for confirmation, I had issues with package versions locally.

[mvafin]

@bot /style

[nikita-savelyevv]

@bot /style

[github-actions]

Style bot fixed some files and pushed the changes.

[IlyasMoutawwakil]

I see that the bitnet test are conditioned on an openvino version that's still not released, did it work with nightly ?

[mvafin]

@IlyasMoutawwakil It succeeds for me locally, can we run tests on nightly for CI? If I remember correctly there is a flag for this

[IlyasMoutawwakil]

@mvafin yes they are currently running

[mvafin]

bitnet support on CPU is still WIP.

[mvafin]

@IlyasMoutawwakil could you start tests here? Bitnet should work now with nightly openvino

[nikita-savelyevv]

@mvafin OpenVINO 2025.3 is installed in tests by default, you can temporarily update the https://github.com/huggingface/optimum-intel/blob/main/.github/workflows/test_openvino.yml workflow to install openvino-nightly

[mvafin]

@mvafin OpenVINO 2025.3 is installed in tests by default, you can temporarily update the https://github.com/huggingface/optimum-intel/blob/main/.github/workflows/test_openvino.yml workflow to install openvino-nightly

@nikita-savelyevv Is openvino-test label no longer works for such purpose?

[nikita-savelyevv]

@mvafin OpenVINO 2025.3 is installed in tests by default, you can temporarily update the https://github.com/huggingface/optimum-intel/blob/main/.github/workflows/test_openvino.yml workflow to install openvino-nightly

@nikita-savelyevv Is openvino-test label no longer works for such purpose?

There is openvino-nightly label for that now. It will run on a larger scope though, potentially resulting in possible issues with connection to HF hub (too many requests at the same time from the same CI token). But we can try.

[nikita-savelyevv]

@bot /style

[github-actions]

Style fix is beginning .... View the workflow run here.

[mvafin]

@nikita-savelyevv @IlyasMoutawwakil The failures doesn't seem to be connected with changes.