[megatron] fix: respect use_distributed_optimizer in config (#4392)
#11
| Job | Run time |
|---|---|
| -1s | |
| 5s | |
| -1s | |
| -1s | |
| 2s |
use_distributed_optimizer in config (#4392)
#11
| Job | Run time |
|---|---|
| -1s | |
| 5s | |
| -1s | |
| -1s | |
| 2s |