Upgrade data mixer, deps, and scripts (#221)

* Fix unit test

* Fix chat template tests

* Remove deprecated test

* up

* Clean up

* Refactor to the max

* foo

* Fix

* Make orpo work

* Fix CAI

* Fix README

* Fix slurm launcher

* Fix configs

* Fix smollm

* Fix smollm1 and smollm2

* Fix tests

* Fix stachat

* Fix gemma

* Fix mixtral

* Fix

* Fix tests

* Update recipes with published checkpoints

* Update news date in README

🤖 Generated with [Claude Code](https://claude.ai/code)

Co-Authored-By: Claude <[email protected]>

---------

Co-authored-by: cmpatino <[email protected]>
Co-authored-by: Claude <[email protected]>

Author: 3 people

.github/workflows/build_documentation.yml

@@ -26,6 +26,6 @@ jobs:
       - name: Install dependencies
         run: |
           python -m pip install --upgrade pip
-          python -m pip install ".[dev, torch]"
+          python -m pip install ".[dev]"
       - name: Run unit tests
         run: HF_TOKEN=$HF_TOKEN pytest -sv tests/

.github/workflows/build_pr_documentation.yml

@@ -26,4 +26,4 @@ authors:
     family-names: Wolf
 repository-code: 'https://github.com/huggingface/alignment-handbook'
 license: Apache-2.0
-version: 0.3.0.dev0
+version: 0.4.0.dev0

.github/workflows/tests.yml

@@ -19,6 +19,7 @@ However, we know from the [InstructGPT](https://huggingface.co/papers/2203.02155
 The Alignment Handbook aims to fill that gap by providing the community with a series of robust training recipes that span the whole pipeline.
 
 ## News 🗞️
+* **July 24, 2025**: We release the full [post-training recipe](recipes/smollm2/README.md) behind SmolLM3-3B: a state-of-the-art hybrid reasoning model 💭
 * **November 21, 2024**: We release the [recipe](recipes/smollm2/README.md) for fine-tuning SmolLM2-Instruct.
 * **August 18, 2024**: We release SmolLM-Instruct v0.2, along with the [recipe](recipes/smollm/README.md)  to fine-tuning small LLMs 💻
 * **April 12, 2024**: We release Zephyr 141B (A35B), in collaboration with Argilla and Kaist AI, along with the recipe to fine-tune Mixtral 8x22B with ORPO 🪁
@@ -60,32 +61,35 @@ The initial release of the handbook will focus on the following techniques:
 
 ## Installation instructions
 
-To run the code in this project, first, create a Python virtual environment using e.g. Conda:
+To run the code in this project, first, create a Python virtual environment using e.g. `uv`:
 
 ```shell
-conda create -n handbook python=3.10 && conda activate handbook
+uv venv handbook --python 3.11 && source handbook/bin/activate && uv pip install --upgrade pip
 ```
 
-Next, install PyTorch `v2.1.2` - the precise version is important for reproducibility! Since this is hardware-dependent, we
-direct you to the [PyTorch Installation Page](https://pytorch.org/get-started/locally/).
+> [!TIP]
+> To install `uv`, follow the [UV Installation Guide](https://docs.astral.sh/uv/getting-started/installation/).
+
+Next, install PyTorch `v2.6.0` 
+
+```shell
+uv pip install torch==2.6.0 --index-url https://download.pytorch.org/whl/cu126
+```
+
+Note that the precise version is important for reproducibility! Since this is hardware-dependent, we also direct you to the [PyTorch Installation Page](https://pytorch.org/get-started/locally/).
 
 You can then install the remaining package dependencies as follows:
 
 ```shell
-git clone https://github.com/huggingface/alignment-handbook.git
-cd ./alignment-handbook/
-python -m pip install .
+uv pip install .
 ```
 
 You will also need Flash Attention 2 installed, which can be done by running:
 
 ```shell
-python -m pip install flash-attn --no-build-isolation
+uv pip install "flash-attn==2.7.4.post1" --no-build-isolation
 ```
 
-> **Note**
-> If your machine has less than 96GB of RAM and many CPU cores, reduce the `MAX_JOBS` arguments, e.g. `MAX_JOBS=4 pip install flash-attn --no-build-isolation`
-
 Next, log into your Hugging Face account as follows:
 
 ```shell
@@ -106,7 +110,6 @@ You can now check out the `scripts` and `recipes` directories for instructions o
 ├── LICENSE
 ├── Makefile                    <- Makefile with commands like `make style`
 ├── README.md                   <- The top-level README for developers using this project
-├── chapters                    <- Educational content to render on hf.co/learn
 ├── recipes                     <- Recipe configs, accelerate configs, slurm scripts
 ├── scripts                     <- Scripts to train and evaluate chat models
 ├── setup.cfg                   <- Installation config (mostly used for configuring code quality & tests)
@@ -121,10 +124,10 @@ If you find the content of this repo useful in your work, please cite it as foll
 
 ```bibtex
 @software{Tunstall_The_Alignment_Handbook,
-  author = {Tunstall, Lewis and Beeching, Edward and Lambert, Nathan and Rajani, Nazneen and Huang, Shengyi and Rasul, Kashif and Bartolome, Alvaro and M. Rush, Alexander and Wolf, Thomas},
+  author = {Tunstall, Lewis and Beeching, Edward and Lambert, Nathan and Rajani, Nazneen and Huang, Shengyi and Rasul, Kashif and Bartolome, Alvaro, and Patiño, M. Carlos and M. Rush, Alexander and Wolf, Thomas},
   license = {Apache-2.0},
   title = {{The Alignment Handbook}},
   url = {https://github.com/huggingface/alignment-handbook},
-  version = {0.3.0.dev0}
+  version = {0.4.0.dev0}
 }
 ```