File tree Expand file tree Collapse file tree 3 files changed +1
-4
lines changed
src/axolotl/integrations/cut_cross_entropy Expand file tree Collapse file tree 3 files changed +1
-4
lines changed Original file line number Diff line number Diff line change @@ -10,7 +10,6 @@ plugins:
10
10
liger_glu_activation : true
11
11
liger_rms_norm : true
12
12
liger_layer_norm : true
13
- cut_cross_entropy : true
14
13
15
14
llama4_linearized_experts : true # needed with custom linearized experts model
16
15
load_in_4bit : true
Original file line number Diff line number Diff line change @@ -27,8 +27,6 @@ pip3 uninstall -y cut-cross-entropy && pip3 install "cut-cross-entropy[transform
27
27
``` yaml
28
28
plugins :
29
29
- axolotl.integrations.cut_cross_entropy.CutCrossEntropyPlugin
30
-
31
- cut_cross_entropy : true
32
30
` ` `
33
31
34
32
## Supported Models
Original file line number Diff line number Diff line change @@ -28,7 +28,7 @@ class CutCrossEntropyArgs(BaseModel):
28
28
Input args for Cut Cross Entropy.
29
29
"""
30
30
31
- cut_cross_entropy : Optional [bool ] = None
31
+ cut_cross_entropy : Optional [bool ] = True
32
32
33
33
@model_validator (mode = "before" )
34
34
@classmethod
You can’t perform that action at this time.
0 commit comments