Skip to content

fix: Lambda GPU image OSS compliance and builder consistency#5739

Merged
junpuf merged 4 commits intomainfrom
fix-lambda-oss-compliance
Mar 13, 2026
Merged

fix: Lambda GPU image OSS compliance and builder consistency#5739
junpuf merged 4 commits intomainfrom
fix-lambda-oss-compliance

Conversation

@junpuf
Copy link
Contributor

@junpuf junpuf commented Mar 13, 2026

Description

Changes

docker/lambda/Dockerfile

  • pytorch-py3 stage: Add FFmpeg 6.1 to BUILD_FROM_SOURCE_PACKAGES_LICENCES and THIRD_PARTY_SOURCE_CODE_URLS after setup_oss_compliance.sh runs — FFmpeg and ffprobe were previously untracked binaries in the OSS compliance report
  • builder-base-py3 stage: Add uv pip check and __pycache__/.pyc/.pyo cleanup to match builder-cupy-py3 and builder-pytorch-py3

test/sanity/scripts/upload_oss_source.py

  • Add tarball download support (curl + tar) for .tar.gz/.tar.xz/.tar.bz2/.tgz URLs alongside existing git clone path, so THIRD_PARTY_SOURCE_CODE_URLS can reference the exact source archive used during the build

- Add FFmpeg 6.1 to BUILD_FROM_SOURCE_PACKAGES_LICENCES and
  THIRD_PARTY_SOURCE_CODE_URLS in pytorch-py3 stage after
  setup_oss_compliance.sh runs
- Add uv pip check and __pycache__/pyc cleanup to builder-base-py3
  to match builder-cupy-py3 and builder-pytorch-py3 stages

Signed-off-by: Junpu Fan <junpu@amazon.com>
@aws-deep-learning-containers-ci aws-deep-learning-containers-ci bot added authorized Size:XS Determines the size of the PR labels Mar 13, 2026
junpuf added 2 commits March 12, 2026 19:00
Signed-off-by: Junpu Fan <junpu@amazon.com>
…ball URL

upload_oss_source.py previously only supported git clone. Add tarball
download support (curl + tar extract) for .tar.gz/.tar.xz/.tar.bz2/.tgz
URLs, so THIRD_PARTY_SOURCE_CODE_URLS can reference the exact source
archive used during the build.

Revert FFmpeg URL back to https://ffmpeg.org/releases/ffmpeg-6.1.tar.xz
to match the actual source used in the ffmpeg-builder stage.

Signed-off-by: Junpu Fan <junpu@amazon.com>
@aws-deep-learning-containers-ci aws-deep-learning-containers-ci bot added sanity Size:S Determines the size of the PR test Reflects file change in test folder labels Mar 13, 2026
@junpuf junpuf changed the title fix: add FFmpeg OSS attribution and uv pip check to builder-base-py3 fix: Lambda GPU image OSS compliance and builder consistency Mar 13, 2026
@junpuf junpuf enabled auto-merge (squash) March 13, 2026 03:43
@junpuf junpuf merged commit 13c246e into main Mar 13, 2026
25 checks passed
@zhuofuAMZ zhuofuAMZ deleted the fix-lambda-oss-compliance branch March 13, 2026 16:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

authorized sanity Size:S Determines the size of the PR Size:XS Determines the size of the PR test Reflects file change in test folder

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants