Skip to content

Commit 25e5c6b

Browse files
FIX Missing device map for facebook/opt-125m (#2675)
Fixes the failing EETQ test in the nighly multi device CI. In #2612, fixed device_maps were added for multi-GPU training as we could not rely on device_map="auto". While doing this change, one device_map was missing, namely for facebook/opt-125m, which is used in the EETQ multi device test. This device_map was now added. This makes the test pass locally.
1 parent 5e00266 commit 25e5c6b

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

tests/test_gpu_examples.py

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -143,6 +143,24 @@
143143
"model.decoder.layers.31": 1,
144144
"lm_head": 0, # tied with embed_tokens
145145
},
146+
"facebook/opt-125m": {
147+
"model.decoder.embed_tokens": 0,
148+
"model.decoder.embed_positions": 0,
149+
"model.decoder.final_layer_norm": 1,
150+
"model.decoder.layers.0": 0,
151+
"model.decoder.layers.1": 0,
152+
"model.decoder.layers.2": 0,
153+
"model.decoder.layers.3": 0,
154+
"model.decoder.layers.4": 0,
155+
"model.decoder.layers.5": 0,
156+
"model.decoder.layers.6": 1,
157+
"model.decoder.layers.7": 1,
158+
"model.decoder.layers.8": 1,
159+
"model.decoder.layers.9": 1,
160+
"model.decoder.layers.10": 1,
161+
"model.decoder.layers.11": 1,
162+
"lm_head": 0,
163+
},
146164
"marcsun13/opt-350m-gptq-4bit": {
147165
"model.decoder.embed_tokens": 0,
148166
"model.decoder.embed_positions": 0,

0 commit comments

Comments
 (0)