Bump bitsandbytes from 0.44.1 to 0.49.2

[dependabot]

Bumps bitsandbytes from 0.44.1 to 0.49.2.

Release notes

Sourced from bitsandbytes's releases.

0.49.2

Highlights

• The default blocksize of 64 for 4bit quantization is now supported on ROCm. Previously the default was 128, which was a mismatch from the default for other devices.
• ROCm 7.2 build is now included.

What's Changed

• bug: fix 8bitoptim support with fsdp by @​ved1beta in bitsandbytes-foundation/bitsandbytes#1840
• Fix xpu 4bit kernel by @​jiqing-feng in bitsandbytes-foundation/bitsandbytes#1839
• ROCm 7.2 build and doc changes by @​sstamenk in bitsandbytes-foundation/bitsandbytes#1845
• Add CUDA kernel support for 4-bit quantization with blocksize=32 by @​Abdennacer-Badaoui in bitsandbytes-foundation/bitsandbytes#1854
• Add blocksize=64 4-bit quantization support for ROCm CDNA (warp64) GPUs by @​Abdennacer-Badaoui in bitsandbytes-foundation/bitsandbytes#1856
• [Docs Update] QLoRA 4-bit Support on ROCm by @​Abdennacer-Badaoui in bitsandbytes-foundation/bitsandbytes#1857
• [ROCm] Make blocksize=64 default for 4bit by @​matthewdouglas in bitsandbytes-foundation/bitsandbytes#1873
• Handle non-contiguous tensors in quantize/dequantize ops by @​TimDettmers in bitsandbytes-foundation/bitsandbytes#1859
• Fix AdEMAMix scheduler guard and add state_dict round-trip test by @​TimDettmers in bitsandbytes-foundation/bitsandbytes#1861

New Contributors

• @​Abdennacer-Badaoui made their first contribution in bitsandbytes-foundation/bitsandbytes#1854

Full Changelog: bitsandbytes-foundation/bitsandbytes@0.49.1...0.49.2

0.49.1

What's Changed

• Update AMD targets by @​sstamenk in bitsandbytes-foundation/bitsandbytes#1832
• add guard for self.weight.quant_state attribute by @​winglian in bitsandbytes-foundation/bitsandbytes#1837

Full Changelog: bitsandbytes-foundation/bitsandbytes@0.49.0...0.49.1

0.49.0

Highlights

x86-64 CPU Improvements

CPU performance for 4bit is significantly improved on x86-64, with optimized kernel paths for CPUs that have AVX512 or AVX512BF16 support.

AMD ROCm Experimental Wheels

• Experimental support for AMD devices is now included in our PyPI wheels on Linux x86-64.
• We've added additional GPU target devices as outlined in our docs.
• Support for using the default blocksize of 64 for 4bit was added for RDNA GPUs in #1748.

macOS 14+ Wheels

• We're now publishing wheels for macOS 14+!
• The 4bit and 8bit quantization features are supported on MPS by slow implementations. We plan to enable Metal kernels with improved performance in the future.

🚨 Breaking Changes

• Dropped support for Python 3.9.
• Dropped compilation support for Maxwell GPUs in the CUDA backend.

What's Changed

• [ROCm] Update build targets by @​matthewdouglas in bitsandbytes-foundation/bitsandbytes#1788

... (truncated)

Changelog

Sourced from bitsandbytes's changelog.

v0.45.1

Improvements:

• Compatibility for triton>=3.2.0
• Moved package configuration to pyproject.toml
• Build system: initial support for NVIDIA Blackwell B100 GPUs, RTX 50 Blackwell series GPUs and Jetson Thor Blackwell.
  • Note: Binaries built for these platforms are not included in this release. They will be included in future releases upon the availability of the upcoming CUDA Toolkit 12.7 and 12.8.

Bug Fixes:

• Packaging: wheels will no longer include unit tests. (#1478)

Dependencies:

• Sets the minimum PyTorch version to 2.0.0.

0.45.0

This is a significant release, bringing support for LLM.int8() to NVIDIA Hopper GPUs such as the H100.

As part of the compatibility enhancements, we've rebuilt much of the LLM.int8() code in order to simplify for future compatibility and maintenance. We no longer use the col32 or architecture-specific tensor layout formats while maintaining backwards compatibility. We additionally bring performance improvements targeted for inference scenarios.

Performance Improvements

This release includes broad performance improvements for a wide variety of inference scenarios. See this X thread for a detailed explanation.

Breaking Changes

🤗PEFT users wishing to merge adapters with 8-bit weights will need to upgrade to peft>=0.14.0.

Packaging Improvements

• The size of our wheel has been reduced by ~43.5% from 122.4 MB to 69.1 MB! This results in an on-disk size decrease from ~396MB to ~224MB.
• Binaries built with CUDA Toolkit 12.6.2 are now included in the PyPI distribution.
• The CUDA 12.5.0 build has been updated to CUDA Toolkit 12.5.1.

Deprecations

• A number of public API functions have been marked for deprecation and will emit FutureWarning when used. These functions will become unavailable in future releases. This should have minimal impact on most end-users.
• The k-bit quantization features are deprecated in favor of blockwise quantization. For all optimizers, using block_wise=False is not recommended and support will be removed in a future release.
• As part of the refactoring process, we've implemented many new 8bit operations. These operations no longer use specialized data layouts.

Full Changelog

• refine docs for multi-backend alpha release by @​Titus-von-Koeller in #1380
• README: Replace special Unicode text symbols with regular characters by @​akx in #1385
• Update CI tools & fix typos by @​akx in #1386
• Fix invalid escape sequence warning in Python 3.12 by @​oshiteku in #1420
• [Build] Add CUDA 12.6.2 build; update 12.5.0 to 12.5.1 by @​matthewdouglas in #1431
• LLM.int8() Refactoring: Part 1 by @​matthewdouglas in #1401

Commits

• f0e6ca3 Release 0.49.2
• cace65c Fix AdEMAMix scheduler guard and add state_dict round-trip test (#1861)
• 505a00a Handle non-contiguous tensors in quantize/dequantize ops (#1859)
• c2ae381 [ROCm] Make blocksize=64 default for 4bit (#1873)
• 943e42d Skip typo check on agent markdown files
• b075afc update docs (#1857)
• de89ff7 docs: Add PR review posting guide, agent reference docs, and lint fixes
• a2c92f7 docs: Add human+agent issue triage workflow guide
• 252e6ff docs: Update issue patterns from 43 recently closed issues
• 88c6c71 style: Fix ruff format violation in test_linear4bit.py
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)