https://github.com/BaguaSys/bagua/blob/8707188d294044c6b5da5365a3e74863c1514efb/bagua/torch_api/algorithms/async_model_average.py#L84-L89 --- ###### This issue was generated by [todo](https://todo.jasonet.co) based on a `TODO` comment in 8707188d294044c6b5da5365a3e74863c1514efb. It's been assigned to @wangraying because they committed the code.