Pre-commit autofixes

Author: CoolCat467

.github/ISSUE_TEMPLATE/feature-request.yml

@@ -27,4 +27,4 @@ body:
       description: |
         How can you contribute to this feature? For example, could you help by submitting a PR?
     validations:
-      required: true
+      required: true

README.md

@@ -50,7 +50,7 @@ dataset = load_dataset("HuggingFaceFW/fineweb-edu", name="sample-100BT", num_pro
 ## Training Recipes
 
 Here's an example of training a 340M FLA Transformer model with a LLaMA-like architecture from scratch on a 100BT subset of the Fineweb-edu corpus ~~in streaming mode~~. (Do not use streaming mode if you are concerned about resuming training.)
- 
+
 > [!WARNING]
 > If the dataset is not downloaded beforehand, the streaming mode will attempt to fetch it from a remote server and download it on-the-fly, which can be highly unstable during training due to network issues.  
 > For stable training, ensure the dataset is downloaded locally (see [**Dataset Preparation**](#dataset-preparation)). Otherwise, we assume you are only testing the new corpus.

configs/delta_net_1B.json

@@ -26,4 +26,4 @@
     "use_gate": false,
     "use_output_norm": true,
     "use_short_conv": true
-}
+}

configs/delta_net_340M.json

@@ -23,4 +23,4 @@
     "use_gate": false,
     "use_output_norm": true,
     "use_short_conv": true
-}
+}

configs/gated_deltanet_1B.json

@@ -19,4 +19,4 @@
     "use_cache": true,
     "use_gate": true,
     "use_short_conv": true
-}
+}

configs/gated_deltanet_340M.json

@@ -19,4 +19,4 @@
     "use_cache": true,
     "use_gate": true,
     "use_short_conv": true
-}
+}

configs/gla_340M.json

@@ -21,4 +21,4 @@
   "use_gk": true,
   "use_gv": false,
   "vocab_size": 32000
-}
+}

configs/gla_7B.json

@@ -22,4 +22,4 @@
     "use_gv": false,
     "use_output_gate": true,
     "use_short_conv": false
-}
+}

configs/gsa_340M.json

@@ -26,4 +26,4 @@
     "use_output_gate": true,
     "use_rope": false,
     "use_short_conv": false
-}
+}

configs/hgrn2_340M.json

@@ -17,4 +17,4 @@
     "tie_word_embeddings": false,
     "use_cache": true,
     "vocab_size": 32000
-}
+}