From a2dcb7b0c2accb7e40d614e7f639a8f60159c24d Mon Sep 17 00:00:00 2001 From: Yuanhao Ji Date: Tue, 3 Dec 2024 11:20:28 +0800 Subject: [PATCH 1/9] Improve docs --- CONTRIBUTING.md | 4 ++++ README.md | 6 +++++- 2 files changed, 9 insertions(+), 1 deletion(-) create mode 100644 CONTRIBUTING.md diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md new file mode 100644 index 0000000..a4506e0 --- /dev/null +++ b/CONTRIBUTING.md @@ -0,0 +1,4 @@ +# Contributing to PyTorch Ouf-of-tree TestInfra + +We want to make contributing to this project as easy and transparent as possible. + diff --git a/README.md b/README.md index 6699136..7243293 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,4 @@ -# PyTorch Integration Tests +# PyTorch Out-of-tree TestInfra Welcome to the `pytorch-integration-tests` repository! This repository is designed to facilitate the integration testing of different accelerators with @@ -167,6 +167,10 @@ compatibility and performance of PyTorch on various devices. If you encounter any issues while using the workflows or integrating a device, please report them via the [Issues](https://github.com/cosdt/pytorch-integration-tests/issues) tab. +## Roadmap + + + ## License This project is licensed under BSD-3-Clause license. See the [LICENSE](LICENSE) From d81b897165c2053162473e187329897908f1590a Mon Sep 17 00:00:00 2001 From: Yuanhao Ji Date: Tue, 3 Dec 2024 14:12:04 +0800 Subject: [PATCH 2/9] update --- CONTRIBUTING.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md index a4506e0..b21a548 100644 --- a/CONTRIBUTING.md +++ b/CONTRIBUTING.md @@ -2,3 +2,13 @@ We want to make contributing to this project as easy and transparent as possible. +## Pull Requests + +We actively welcome your pull requests. + +1. Fork the repo and create your branch from main. +2. If you've added code that should be tested, add tests. +3. If you've changed APIs, update the documentation. +4. Ensure the test suite passes. +5. Make sure your code lints. + From 7637aa1802e8a5deff4fd605b66d068515385e23 Mon Sep 17 00:00:00 2001 From: Yuanhao Ji Date: Wed, 4 Dec 2024 15:06:26 +0800 Subject: [PATCH 3/9] tmp --- README.md | 127 ++++++++++-------------------------------------------- 1 file changed, 22 insertions(+), 105 deletions(-) diff --git a/README.md b/README.md index 7243293..334210c 100644 --- a/README.md +++ b/README.md @@ -13,111 +13,28 @@ across various devices by running comprehensive GitHub workflows. -| | [torch_npu][1] | -|---------------------------------|----------------| -| simple_gpt | ❌ | -| detectron2_fasterrcnn_r_50_dc5 | ❌ | -| LearningToPaint | ✅ | -| hf_GPT2_large | ✅ | -| dcgan | ✅ | -| nanogpt | ✅ | -| fastNLP_Bert | ✅ | -| moondream | ❌ | -| mobilenet_v2_quantized_qat | ❌ | -| functorch_dp_cifar10 | ✅ | -| simple_gpt_tp_manual | ❌ | -| speech_transformer | ✅ | -| yolov3 | ✅ | -| resnet50_quantized_qat | ❌ | -| sam_fast | ❌ | -| alexnet | ✅ | -| timm_efficientnet | ✅ | -| pyhpc_isoneutral_mixing | ✅ | -| basic_gnn_edgecnn | ✅ | -| nvidia_deeprecommender | ❌ | -| opacus_cifar10 | ✅ | -| dlrm | ✅ | -| hf_Bert | ✅ | -| hf_T5_generate | ✅ | -| resnet50 | ✅ | -| hf_BigBird | ✅ | -| resnext50_32x4d | ✅ | -| pyhpc_turbulent_kinetic_energy | ✅ | -| llama | ✅ | -| detectron2_maskrcnn_r_50_c4 | ❌ | -| Super_SloMo | ✅ | -| moco | ❌ | -| stable_diffusion_unet | ❌ | -| microbench_unbacked_tolist_sum | ✅ | -| detectron2_maskrcnn_r_101_c4 | ❌ | -| hf_distil_whisper | ✅ | -| mnasnet1_0 | ✅ | -| detectron2_fasterrcnn_r_50_fpn | ❌ | -| timm_resnest | ✅ | -| hf_GPT2 | ✅ | -| squeezenet1_1 | ✅ | -| basic_gnn_gin | ✅ | -| hf_clip | ✅ | -| mobilenet_v2 | ✅ | -| drq | ✅ | -| hf_Roberta_base | ✅ | -| detectron2_maskrcnn_r_50_fpn | ❌ | -| timm_nfnet | ✅ | -| timm_vovnet | ✅ | -| doctr_det_predictor | ✅ | -| sam | ✅ | -| hf_T5_large | ✅ | -| mobilenet_v3_large | ✅ | -| detectron2_fcos_r_50_fpn | ❌ | -| soft_actor_critic | ✅ | -| llava | ❌ | -| timm_regnet | ✅ | -| functorch_maml_omniglot | ✅ | -| detectron2_fasterrcnn_r_101_c4 | ❌ | -| hf_DistilBert | ✅ | -| tts_angular | ✅ | -| detectron2_maskrcnn | ❌ | -| basic_gnn_sage | ✅ | -| tacotron2 | ❌ | -| detectron2_maskrcnn_r_101_fpn | ❌ | -| lennard_jones | ✅ | -| pytorch_unet | ✅ | -| vgg16 | ✅ | -| BERT_pytorch | ✅ | -| timm_efficientdet | ❌ | -| pyhpc_equation_of_state | ✅ | -| maml | ✅ | -| detectron2_fasterrcnn_r_50_c4 | ❌ | -| resnet152 | ✅ | -| phlippe_densenet | ✅ | -| maml_omniglot | ✅ | -| phlippe_resnet | ✅ | -| pytorch_CycleGAN_and_pix2pix | ✅ | -| hf_Whisper | ✅ | -| hf_T5 | ✅ | -| densenet121 | ✅ | -| cm3leon_generate | ✅ | -| detectron2_fasterrcnn_r_101_fpn | ❌ | -| hf_Bert_large | ✅ | -| stable_diffusion_text_encoder | ❌ | -| hf_Reformer | ❌ | -| detectron2_fasterrcnn_r_101_dc5 | ❌ | -| demucs | ✅ | -| pytorch_stargan | ✅ | -| hf_T5_base | ✅ | -| torch_multimodal_clip | ✅ | -| vision_maskrcnn | ❌ | -| timm_vision_transformer_large | ✅ | -| hf_Bart | ✅ | -| shufflenet_v2_x1_0 | ✅ | -| llama_v2_7b_16h | ❌ | -| basic_gnn_gcn | ✅ | -| resnet18 | ✅ | -| Background_Matting | ✅ | -| doctr_reco_predictor | ✅ | -| timm_vision_transformer | ✅ | -| hf_Albert | ✅ | -| hf_Longformer | ✅ | +| | Ascend NPU | Intel Gaudi | +|------------------------|------------|-------------| +| alexnet | ✅ | ✅ | +| BERT_pytorch | ✅ | ✅ | +| dcgan | ✅ | ✅ | +| hf_clip | ✅ | ✅ | +| hf_GPT2 | ✅ | ✅ | +| hf_GPT2_large | ✅ | ✅ | +| hf_Reformer | ⚠️ | ✅ | +| hf_Whisper | ✅ | ✅ | +| llama | ✅ | ✅ | +| llama_v2_7b_16h | ❌ | ❌ | +| llava | ⚠️ | ✅ | +| moondream | ❌ | ❌ | +| nanogpt | ✅ | ✅ | +| nvidia_deeprecommender | ❌ | ❌ | +| opacus_cifar10 | ✅ | ✅ | +| resnet152 | ✅ | ✅ | +| resnet18 | ✅ | ✅ | +| resnet50 | ✅ | ✅ | +| vgg16 | ✅ | ✅ | +| yolov3 | ✅ | ✅ | [1]: https://github.com/ascend/pytorch From 35845a90f8eac4f06fe5f07aba13e7e5356e06ad Mon Sep 17 00:00:00 2001 From: Yuanhao Ji Date: Wed, 4 Dec 2024 16:32:34 +0800 Subject: [PATCH 4/9] Revert "tmp" This reverts commit 89c2167023a76c14139ae11d224de6a0936b22af. --- README.md | 127 ++++++++++++++++++++++++++++++++++++++++++++---------- 1 file changed, 105 insertions(+), 22 deletions(-) diff --git a/README.md b/README.md index 334210c..7243293 100644 --- a/README.md +++ b/README.md @@ -13,28 +13,111 @@ across various devices by running comprehensive GitHub workflows. -| | Ascend NPU | Intel Gaudi | -|------------------------|------------|-------------| -| alexnet | ✅ | ✅ | -| BERT_pytorch | ✅ | ✅ | -| dcgan | ✅ | ✅ | -| hf_clip | ✅ | ✅ | -| hf_GPT2 | ✅ | ✅ | -| hf_GPT2_large | ✅ | ✅ | -| hf_Reformer | ⚠️ | ✅ | -| hf_Whisper | ✅ | ✅ | -| llama | ✅ | ✅ | -| llama_v2_7b_16h | ❌ | ❌ | -| llava | ⚠️ | ✅ | -| moondream | ❌ | ❌ | -| nanogpt | ✅ | ✅ | -| nvidia_deeprecommender | ❌ | ❌ | -| opacus_cifar10 | ✅ | ✅ | -| resnet152 | ✅ | ✅ | -| resnet18 | ✅ | ✅ | -| resnet50 | ✅ | ✅ | -| vgg16 | ✅ | ✅ | -| yolov3 | ✅ | ✅ | +| | [torch_npu][1] | +|---------------------------------|----------------| +| simple_gpt | ❌ | +| detectron2_fasterrcnn_r_50_dc5 | ❌ | +| LearningToPaint | ✅ | +| hf_GPT2_large | ✅ | +| dcgan | ✅ | +| nanogpt | ✅ | +| fastNLP_Bert | ✅ | +| moondream | ❌ | +| mobilenet_v2_quantized_qat | ❌ | +| functorch_dp_cifar10 | ✅ | +| simple_gpt_tp_manual | ❌ | +| speech_transformer | ✅ | +| yolov3 | ✅ | +| resnet50_quantized_qat | ❌ | +| sam_fast | ❌ | +| alexnet | ✅ | +| timm_efficientnet | ✅ | +| pyhpc_isoneutral_mixing | ✅ | +| basic_gnn_edgecnn | ✅ | +| nvidia_deeprecommender | ❌ | +| opacus_cifar10 | ✅ | +| dlrm | ✅ | +| hf_Bert | ✅ | +| hf_T5_generate | ✅ | +| resnet50 | ✅ | +| hf_BigBird | ✅ | +| resnext50_32x4d | ✅ | +| pyhpc_turbulent_kinetic_energy | ✅ | +| llama | ✅ | +| detectron2_maskrcnn_r_50_c4 | ❌ | +| Super_SloMo | ✅ | +| moco | ❌ | +| stable_diffusion_unet | ❌ | +| microbench_unbacked_tolist_sum | ✅ | +| detectron2_maskrcnn_r_101_c4 | ❌ | +| hf_distil_whisper | ✅ | +| mnasnet1_0 | ✅ | +| detectron2_fasterrcnn_r_50_fpn | ❌ | +| timm_resnest | ✅ | +| hf_GPT2 | ✅ | +| squeezenet1_1 | ✅ | +| basic_gnn_gin | ✅ | +| hf_clip | ✅ | +| mobilenet_v2 | ✅ | +| drq | ✅ | +| hf_Roberta_base | ✅ | +| detectron2_maskrcnn_r_50_fpn | ❌ | +| timm_nfnet | ✅ | +| timm_vovnet | ✅ | +| doctr_det_predictor | ✅ | +| sam | ✅ | +| hf_T5_large | ✅ | +| mobilenet_v3_large | ✅ | +| detectron2_fcos_r_50_fpn | ❌ | +| soft_actor_critic | ✅ | +| llava | ❌ | +| timm_regnet | ✅ | +| functorch_maml_omniglot | ✅ | +| detectron2_fasterrcnn_r_101_c4 | ❌ | +| hf_DistilBert | ✅ | +| tts_angular | ✅ | +| detectron2_maskrcnn | ❌ | +| basic_gnn_sage | ✅ | +| tacotron2 | ❌ | +| detectron2_maskrcnn_r_101_fpn | ❌ | +| lennard_jones | ✅ | +| pytorch_unet | ✅ | +| vgg16 | ✅ | +| BERT_pytorch | ✅ | +| timm_efficientdet | ❌ | +| pyhpc_equation_of_state | ✅ | +| maml | ✅ | +| detectron2_fasterrcnn_r_50_c4 | ❌ | +| resnet152 | ✅ | +| phlippe_densenet | ✅ | +| maml_omniglot | ✅ | +| phlippe_resnet | ✅ | +| pytorch_CycleGAN_and_pix2pix | ✅ | +| hf_Whisper | ✅ | +| hf_T5 | ✅ | +| densenet121 | ✅ | +| cm3leon_generate | ✅ | +| detectron2_fasterrcnn_r_101_fpn | ❌ | +| hf_Bert_large | ✅ | +| stable_diffusion_text_encoder | ❌ | +| hf_Reformer | ❌ | +| detectron2_fasterrcnn_r_101_dc5 | ❌ | +| demucs | ✅ | +| pytorch_stargan | ✅ | +| hf_T5_base | ✅ | +| torch_multimodal_clip | ✅ | +| vision_maskrcnn | ❌ | +| timm_vision_transformer_large | ✅ | +| hf_Bart | ✅ | +| shufflenet_v2_x1_0 | ✅ | +| llama_v2_7b_16h | ❌ | +| basic_gnn_gcn | ✅ | +| resnet18 | ✅ | +| Background_Matting | ✅ | +| doctr_reco_predictor | ✅ | +| timm_vision_transformer | ✅ | +| hf_Albert | ✅ | +| hf_Longformer | ✅ | [1]: https://github.com/ascend/pytorch From 6c476a8143de5e9eb333f1fbb4dcb947e44e2a3b Mon Sep 17 00:00:00 2001 From: Yuanhao Ji Date: Fri, 6 Dec 2024 11:06:35 +0800 Subject: [PATCH 5/9] update --- .github/workflows/_ascend_npu_benchmark.yml | 10 +++++++++ .github/workflows/_ascend_npu_build.yml | 24 ++++++++++++++++++--- .github/workflows/_ascend_npu_ut.yml | 15 ++++++++++--- 3 files changed, 43 insertions(+), 6 deletions(-) diff --git a/.github/workflows/_ascend_npu_benchmark.yml b/.github/workflows/_ascend_npu_benchmark.yml index 710d5a3..e2e6b95 100644 --- a/.github/workflows/_ascend_npu_benchmark.yml +++ b/.github/workflows/_ascend_npu_benchmark.yml @@ -73,6 +73,11 @@ jobs: git gcc g++ make cmake ninja-build curl \ libgl1 libglib2.0-0 libsndfile1 + # See: https://github.com/actions/checkout/issues/363#issuecomment-1915075699 + - name: Config git + run: | + git config --global --add safe.directory "$GITHUB_WORKSPACE" + - name: Checkout uses: actions/checkout@v4 @@ -141,6 +146,11 @@ jobs: id: update-readme run: | python .ci/benchmark.py --update-readme --path benchmark/ascend_npu_benchmark.json + if git diff --quiet README.md; then + echo "changed=false" >> $GITHUB_OUTPUT + else + echo "changed=true" >> $GITHUB_OUTPUT + fi # https://github.com/peter-evans/create-pull-request - name: Create a pull request for changes to README.md diff --git a/.github/workflows/_ascend_npu_build.yml b/.github/workflows/_ascend_npu_build.yml index 249fbc2..2816551 100644 --- a/.github/workflows/_ascend_npu_build.yml +++ b/.github/workflows/_ascend_npu_build.yml @@ -39,12 +39,21 @@ jobs: outputs: dist_name: ${{ steps.list-dist.outputs.dist_name }} steps: + - name: Config mirrors + run: | + sed -i 's|ports.ubuntu.com|mirrors.tuna.tsinghua.edu.cn|g' /etc/apt/sources.list + pip config set global.index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple + # TODO(shink): Should we add these dependencies to the image? - name: Install system dependencies run: | - sed -i 's|ports.ubuntu.com|mirrors.tuna.tsinghua.edu.cn|g' /etc/apt/sources.list - apt update - apt install --no-install-recommends -y git gcc g++ make cmake ninja-build + apt-get update + apt-get install -y git gcc g++ make cmake ninja-build + + # See: https://github.com/actions/checkout/issues/363#issuecomment-1915075699 + - name: Config git + run: | + git config --global --add safe.directory "$GITHUB_WORKSPACE" - name: Checkout uses: actions/checkout@v4 @@ -60,6 +69,15 @@ jobs: submodules: recursive path: torch_npu + - name: Tmp + run: | + set -x + pwd + ls -al . + echo $GITHUB_WORKSPACE + git status + git diff --quiet README.md + - name: Install pip dependencies working-directory: torch_npu run: | diff --git a/.github/workflows/_ascend_npu_ut.yml b/.github/workflows/_ascend_npu_ut.yml index 13b1e1b..22d78be 100644 --- a/.github/workflows/_ascend_npu_ut.yml +++ b/.github/workflows/_ascend_npu_ut.yml @@ -55,11 +55,20 @@ jobs: run: | npu-smi info - - name: Install system dependencies + - name: Config mirrors run: | sed -i 's|ports.ubuntu.com|mirrors.tuna.tsinghua.edu.cn|g' /etc/apt/sources.list - apt update - apt install --no-install-recommends -y git gcc g++ make cmake ninja-build + pip config set global.index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple + + - name: Install system dependencies + run: | + apt-get update + apt-get install -y git gcc g++ make cmake ninja-build + + # See: https://github.com/actions/checkout/issues/363#issuecomment-1915075699 + - name: Config git + run: | + git config --global --add safe.directory "$GITHUB_WORKSPACE" - name: Checkout uses: actions/checkout@v4 From c260f909b49ab4188bd6f86c9c60257565afd322 Mon Sep 17 00:00:00 2001 From: Yuanhao Ji Date: Fri, 6 Dec 2024 11:16:26 +0800 Subject: [PATCH 6/9] update --- .github/workflows/_ascend_npu_benchmark.yml | 6 ++++-- .github/workflows/_ascend_npu_build.yml | 9 --------- 2 files changed, 4 insertions(+), 11 deletions(-) diff --git a/.github/workflows/_ascend_npu_benchmark.yml b/.github/workflows/_ascend_npu_benchmark.yml index e2e6b95..67c46b0 100644 --- a/.github/workflows/_ascend_npu_benchmark.yml +++ b/.github/workflows/_ascend_npu_benchmark.yml @@ -104,6 +104,7 @@ jobs: curl -fsSL -O https://raw.githubusercontent.com/Ascend/pytorch/refs/heads/master/requirements.txt pip install -r requirements.txt + # TODO: We must use numpy 1.x - name: Install benchmark dependencies run: | pip install -r benchmark/requirements.txt --constraint ascend_npu/requirements.txt "numpy==1.*" @@ -135,7 +136,6 @@ jobs: path: benchmark/ascend_npu_benchmark.json if-no-files-found: error retention-days: 1 - overwrite: true - name: Write to workflow job summary run: | @@ -147,12 +147,14 @@ jobs: run: | python .ci/benchmark.py --update-readme --path benchmark/ascend_npu_benchmark.json if git diff --quiet README.md; then + echo "README.md not changed" echo "changed=false" >> $GITHUB_OUTPUT else + echo "README.md changed" echo "changed=true" >> $GITHUB_OUTPUT fi - # https://github.com/peter-evans/create-pull-request + # See: https://github.com/peter-evans/create-pull-request - name: Create a pull request for changes to README.md if: ${{ steps.update-readme.outputs.changed == 'true' }} uses: peter-evans/create-pull-request@v7 diff --git a/.github/workflows/_ascend_npu_build.yml b/.github/workflows/_ascend_npu_build.yml index 2816551..1f2ee52 100644 --- a/.github/workflows/_ascend_npu_build.yml +++ b/.github/workflows/_ascend_npu_build.yml @@ -69,15 +69,6 @@ jobs: submodules: recursive path: torch_npu - - name: Tmp - run: | - set -x - pwd - ls -al . - echo $GITHUB_WORKSPACE - git status - git diff --quiet README.md - - name: Install pip dependencies working-directory: torch_npu run: | From 6a955158e93f6143febb52b44a869fc56226d461 Mon Sep 17 00:00:00 2001 From: Yuanhao Ji Date: Fri, 6 Dec 2024 14:35:04 +0800 Subject: [PATCH 7/9] update --- CONTRIBUTING.md | 3 +-- README.md | 14 ++++++++------ 2 files changed, 9 insertions(+), 8 deletions(-) diff --git a/CONTRIBUTING.md b/CONTRIBUTING.md index b21a548..f68380d 100644 --- a/CONTRIBUTING.md +++ b/CONTRIBUTING.md @@ -1,4 +1,4 @@ -# Contributing to PyTorch Ouf-of-tree TestInfra +# Contributing to PyTorch Ouf-of-tree Accelerator TestInfra We want to make contributing to this project as easy and transparent as possible. @@ -11,4 +11,3 @@ We actively welcome your pull requests. 3. If you've changed APIs, update the documentation. 4. Ensure the test suite passes. 5. Make sure your code lints. - diff --git a/README.md b/README.md index 7243293..d602fc6 100644 --- a/README.md +++ b/README.md @@ -1,4 +1,4 @@ -# PyTorch Out-of-tree TestInfra +# PyTorch Out-of-tree Accelerator TestInfra Welcome to the `pytorch-integration-tests` repository! This repository is designed to facilitate the integration testing of different accelerators with @@ -9,7 +9,7 @@ across various devices by running comprehensive GitHub workflows.
-Torchbenchmark statistics report +Click here to view the torchbenchmark report @@ -156,6 +156,12 @@ The workflows are designed to be flexible. You can customize the parameters such as the target branch, runner, and loop time by modifying the inputs in the workflow files. +## Roadmap + +See our [roadmap project][101] for more details. + +[101]: https://github.com/orgs/cosdt/projects/7 + ## Contributing We welcome contributions to enhance the integration testing process. Feel free @@ -167,10 +173,6 @@ compatibility and performance of PyTorch on various devices. If you encounter any issues while using the workflows or integrating a device, please report them via the [Issues](https://github.com/cosdt/pytorch-integration-tests/issues) tab. -## Roadmap - - - ## License This project is licensed under BSD-3-Clause license. See the [LICENSE](LICENSE) From b2e5baf77419e193932b1cd5ac362d27950185fd Mon Sep 17 00:00:00 2001 From: Yuanhao Ji Date: Fri, 6 Dec 2024 14:37:28 +0800 Subject: [PATCH 8/9] tmp --- .github/workflows/_ascend_npu_benchmark.yml | 1 - 1 file changed, 1 deletion(-) diff --git a/.github/workflows/_ascend_npu_benchmark.yml b/.github/workflows/_ascend_npu_benchmark.yml index 67c46b0..d403d71 100644 --- a/.github/workflows/_ascend_npu_benchmark.yml +++ b/.github/workflows/_ascend_npu_benchmark.yml @@ -142,7 +142,6 @@ jobs: python .ci/benchmark.py --write-gh-job-summary --path benchmark/ascend_npu_benchmark.json - name: Update README.md - if: ${{ github.event_name == 'push' || github.event_name == 'schedule' || github.event_name == 'workflow_dispatch' }} id: update-readme run: | python .ci/benchmark.py --update-readme --path benchmark/ascend_npu_benchmark.json From 9d18c54cbffca4712eb81cff2f7ecf6523a2abab Mon Sep 17 00:00:00 2001 From: Yuanhao Ji Date: Fri, 6 Dec 2024 17:28:19 +0800 Subject: [PATCH 9/9] update [skip ci] --- .github/workflows/_ascend_npu_benchmark.yml | 1 + 1 file changed, 1 insertion(+) diff --git a/.github/workflows/_ascend_npu_benchmark.yml b/.github/workflows/_ascend_npu_benchmark.yml index d403d71..67c46b0 100644 --- a/.github/workflows/_ascend_npu_benchmark.yml +++ b/.github/workflows/_ascend_npu_benchmark.yml @@ -142,6 +142,7 @@ jobs: python .ci/benchmark.py --write-gh-job-summary --path benchmark/ascend_npu_benchmark.json - name: Update README.md + if: ${{ github.event_name == 'push' || github.event_name == 'schedule' || github.event_name == 'workflow_dispatch' }} id: update-readme run: | python .ci/benchmark.py --update-readme --path benchmark/ascend_npu_benchmark.json