Skip to content

Commit 304cc84

Browse files
committed
Fixing nits
Signed-off-by: Vladimir Suvorov <[email protected]>
1 parent e1158b3 commit 304cc84

File tree

3 files changed

+4
-39
lines changed

3 files changed

+4
-39
lines changed
File renamed without changes.

src/MaxText/examples/install_tunix_vllm_requirement.sh

Lines changed: 0 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -19,15 +19,7 @@
1919
set -e
2020
set -x
2121

22-
<<<<<<< HEAD
23-
<<<<<<< HEAD
2422
uv pip uninstall jax jaxlib libtpu
25-
=======
26-
yes | uv pip uninstall jax jaxlib libtpu
27-
>>>>>>> 08e2cdb19 (Add GSPO and small fixes)
28-
=======
29-
uv pip uninstall jax jaxlib libtpu
30-
>>>>>>> de8d3d1ce (Fix)
3123

3224
uv pip install aiohttp==3.12.15
3325

src/MaxText/examples/sft_llama3_demo.ipynb

Lines changed: 4 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -17,34 +17,7 @@
1717
"\n",
1818
"This notebook can run on **TPU v5e-8** or **v5p-8**\n",
1919
"\n",
20-
"This notebook demonstrates how to perform Supervised Fine-Tuning (SFT) on Llama3.1-8B-Instruct using the Hugging Face ultrachat_200k dataset with MaxText and Tunix integration for efficient training.\n",
21-
"\n",
22-
"## Dataset Overview\n",
23-
"\n",
24-
"**Dataset Link:** https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k\n",
25-
"\n",
26-
"### Dataset Information:\n",
27-
"- **Name:** HuggingFaceH4/ultrachat_200k\n",
28-
"- **Type:** Supervised Fine-Tuning dataset\n",
29-
"- **Size:** ~200k conversations\n",
30-
"- **Format:** Chat conversations with human-AI pairs\n",
31-
"- **Splits:** train_sft, test_sft\n",
32-
"- **Data columns:** ['messages']\n",
33-
"\n",
34-
"### Dataset Structure:\n",
35-
"Each example contains a 'messages' field with:\n",
36-
"- **role:** 'user' or 'assistant'\n",
37-
"- **content:** The actual message text\n",
38-
"\n",
39-
"### Example data format:\n",
40-
"```json\n",
41-
"{\n",
42-
" \"messages\": [\n",
43-
" {\"role\": \"user\", \"content\": \"What is the capital of France?\"},\n",
44-
" {\"role\": \"assistant\", \"content\": \"The capital of France is Paris.\"}\n",
45-
" ]\n",
46-
"}\n",
47-
"```\n"
20+
"This notebook demonstrates how to perform Supervised Fine-Tuning (SFT) on Llama3.1-8B-Instruct using the Hugging Face ultrachat_200k dataset with MaxText and Tunix integration for efficient training.\n"
4821
]
4922
},
5023
{
@@ -84,7 +57,7 @@
8457
"\n",
8558
"**Follow these steps to store your token:**\n",
8659
"\n",
87-
"Just put your token in the line below"
60+
"Just put your token in the cell below"
8861
]
8962
},
9063
{
@@ -100,7 +73,7 @@
10073
"cell_type": "markdown",
10174
"metadata": {},
10275
"source": [
103-
"Install maxtext and dependencies\n",
76+
"### Install\n",
10477
"\n",
10578
"https://maxtext.readthedocs.io/en/latest/tutorials/sft.html#install-dependencies"
10679
]
@@ -118,7 +91,7 @@
11891
"metadata": {},
11992
"outputs": [],
12093
"source": [
121-
"!cd ~/maxtext/src/ # This is the path to the maxtext folder"
94+
"!cd ~/maxtext/src/ # make sure we are in the right directory"
12295
]
12396
},
12497
{

0 commit comments

Comments
 (0)