Skip to content

Commit 2533e2f

Browse files
authored
ci: pin HF datasets package version to 3.6.0 in Transformers tests (#1921)
Transformers tests regressed due to unpinned HF datasets package version which got updated to use new torchcodec package. The latter was not installed. We need to start tracking datasets version to avoid such regressions in the future. Pinning the version to `3.6.0` which is known to pass. Signed-off-by: Dmitry Rogozhkin <[email protected]>
1 parent 2d6a5c6 commit 2533e2f

File tree

1 file changed

+10
-2
lines changed

1 file changed

+10
-2
lines changed

.github/workflows/_linux_transformers.yml

Lines changed: 10 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -38,6 +38,11 @@ on:
3838
type: string
3939
default: 'v1.7.0'
4040
description: Accelerate version
41+
datasets:
42+
required: false
43+
type: string
44+
default: 'v3.6.0'
45+
description: Accelerate version
4146
transformers:
4247
required: false
4348
type: string
@@ -57,6 +62,7 @@ env:
5762
DisableScratchPages: ${{ inputs.driver == 'rolling' && '1' || '0' }}
5863
python: ${{ inputs.python != '' && inputs.python || '3.10' }}
5964
accelerate: ${{ inputs.accelerate != '' && inputs.accelerate || 'v1.7.0'}}
65+
datasets: ${{ inputs.datasets != '' && inputs.datasets || 'v3.6.0'}}
6066
transformers: ${{ inputs.transformers != '' && inputs.transformers || 'v4.51.3' }}
6167
PACKAGES: |
6268
espeak-ng
@@ -271,7 +277,9 @@ jobs:
271277
pwd
272278
source activate $CONDA_ENV_NAME
273279
cd transformers
274-
pip install accelerate==${{ env.accelerate }}
280+
pip install \
281+
accelerate==${{ env.accelerate }} \
282+
datasets==${{ env.datasets }}
275283
pip install -e .
276284
pip install -e ".[dev-torch,testing,video]"
277285
rm -rf logs && mkdir -p logs
@@ -313,7 +321,7 @@ jobs:
313321
uses: ./torch-xpu-ops/.github/actions/print-environment
314322
with:
315323
conda: $CONDA_ENV_NAME
316-
pip_packages: 'accelerate transformers'
324+
pip_packages: 'accelerate datasets transformers'
317325
to: 'transformers/logs/environment-$TEST_CASE.md'
318326
- name: Clean up
319327
if: ${{ always() }}

0 commit comments

Comments
 (0)