EFL: Fix save_steps not work bug (#577)

* "add mlm params to dygraph ernie1.0"

* finish p-tuning v1.0

* mend

* delete unused coment

* add label_normalized

* P-tuning: support Chid task of FewCLUE

* 1. decouple evaluate and train

* 1.add FewCLUE datasets(9/9)
2.implement p-tuning strategy by transform_function
3.unify train_script beteween `chid` task and other 8 tasks of FewCLUE

* add README.md

* update FewCLUE data

* add predict.py for FewCLUE

* update README

* update README.md

* add FewCLUE 9 datasets

* update dataset Name

* Tiny fix

* finish EFL for iflytek task

* finish EFL for FewCLUE 9 tasks

* add EFL README.md

* fix save_steps have no effect bug

Author: tianxin

examples/few_shot/efl/train.py

@@ -232,6 +232,14 @@ def do_train():
                        10 / (time.time() - tic_train)))
                 tic_train = time.time()
 
+            if global_step % args.save_steps == 0 and rank == 0:
+                save_dir = os.path.join(args.save_dir, "model_%d" % global_step)
+                if not os.path.exists(save_dir):
+                    os.makedirs(save_dir)
+                save_param_path = os.path.join(save_dir, 'model_state.pdparams')
+                paddle.save(model.state_dict(), save_param_path)
+                tokenizer.save_pretrained(save_dir)
+
             loss.backward()
             optimizer.step()
             lr_scheduler.step()
@@ -268,4 +276,4 @@ def do_train():
 
 if __name__ == "__main__":
     args = parse_args()
-    do_train()
+    do_train()