Skip to content

Commit 53bef61

Browse files
HCharlieHCharlie
authored
Merge branch 'master' into MLX-1269
2 parents 3112627 + 7c49f5d commit 53bef61

File tree

189 files changed

+6088
-1016
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

189 files changed

+6088
-1016
lines changed

‎.github/workflows/codebuild-ci-health.yml

Lines changed: 1 addition & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -81,17 +81,4 @@ jobs:
8181
- name: Run Local Mode Tests
8282
uses: aws-actions/aws-codebuild-run-build@v1
8383
with:
84-
project-name: sagemaker-python-sdk-ci-health-localmode-tests
85-
notebook-tests:
86-
runs-on: ubuntu-latest
87-
steps:
88-
- name: Configure AWS Credentials
89-
uses: aws-actions/configure-aws-credentials@v4
90-
with:
91-
role-to-assume: ${{ secrets.CI_AWS_ROLE_ARN }}
92-
aws-region: us-west-2
93-
role-duration-seconds: 10800
94-
- name: Run Notebook Tests
95-
uses: aws-actions/aws-codebuild-run-build@v1
96-
with:
97-
project-name: sagemaker-python-sdk-ci-health-notebook-tests
84+
project-name: sagemaker-python-sdk-ci-health-localmode-tests

‎.github/workflows/codebuild-ci.yml

Lines changed: 52 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,8 @@
11
name: PR Checks
22
on:
33
pull_request_target:
4+
branches:
5+
- "master*"
46

57
concurrency:
68
group: ${{ github.workflow }}-${{ github.event.pull_request.number || github.head_ref }}
@@ -10,9 +12,40 @@ permissions:
1012
id-token: write # This is required for requesting the JWT
1113

1214
jobs:
13-
codestyle-doc-tests:
15+
collab-check:
16+
runs-on: ubuntu-latest
17+
outputs:
18+
approval-env: ${{ steps.collab-check.outputs.result }}
19+
steps:
20+
- name: Collaborator Check
21+
uses: actions/github-script@v7
22+
id: collab-check
23+
with:
24+
github-token: ${{ secrets.COLLAB_CHECK_TOKEN }}
25+
result-encoding: string
26+
script: |
27+
try {
28+
const res = await github.rest.repos.checkCollaborator({
29+
owner: context.repo.owner,
30+
repo: context.repo.repo,
31+
username: "${{ github.event.pull_request.user.login }}",
32+
});
33+
console.log("Verifed ${{ github.event.pull_request.user.login }} is a repo collaborator. Auto Approving PR Checks.")
34+
return res.status == "204" ? "auto-approve" : "manual-approval"
35+
} catch (error) {
36+
console.log("${{ github.event.pull_request.user.login }} is not a collaborator. Requiring Manual Approval to run PR Checks.")
37+
return "manual-approval"
38+
}
39+
wait-for-approval:
1440
runs-on: ubuntu-latest
41+
needs: [collab-check]
42+
environment: ${{ needs.collab-check.outputs.approval-env }}
1543
steps:
44+
- run: echo "Workflow Approved! Starting PR Checks."
45+
codestyle-doc-tests:
46+
runs-on: ubuntu-latest
47+
needs: [wait-for-approval]
48+
steps:
1649
- name: Configure AWS Credentials
1750
uses: aws-actions/configure-aws-credentials@v4
1851
with:
@@ -23,9 +56,10 @@ jobs:
2356
uses: aws-actions/aws-codebuild-run-build@v1
2457
with:
2558
project-name: sagemaker-python-sdk-ci-codestyle-doc-tests
26-
source-version-override: 'pr/${{ github.event.pull_request.number }}'
59+
source-version-override: 'refs/pull/${{ github.event.pull_request.number }}/head^{${{ github.event.pull_request.head.sha }}}'
2760
unit-tests:
2861
runs-on: ubuntu-latest
62+
needs: [wait-for-approval]
2963
strategy:
3064
fail-fast: false
3165
matrix:
@@ -41,8 +75,23 @@ jobs:
4175
uses: aws-actions/aws-codebuild-run-build@v1
4276
with:
4377
project-name: sagemaker-python-sdk-ci-unit-tests
44-
source-version-override: 'pr/${{ github.event.pull_request.number }}'
78+
source-version-override: 'refs/pull/${{ github.event.pull_request.number }}/head^{${{ github.event.pull_request.head.sha }}}'
4579
env-vars-for-codebuild: |
4680
PY_VERSION
4781
env:
4882
PY_VERSION: ${{ matrix.python-version }}
83+
integ-tests:
84+
runs-on: ubuntu-latest
85+
needs: [wait-for-approval]
86+
steps:
87+
- name: Configure AWS Credentials
88+
uses: aws-actions/configure-aws-credentials@v4
89+
with:
90+
role-to-assume: ${{ secrets.CI_AWS_ROLE_ARN }}
91+
aws-region: us-west-2
92+
role-duration-seconds: 10800
93+
- name: Run Integ Tests
94+
uses: aws-actions/aws-codebuild-run-build@v1
95+
with:
96+
project-name: sagemaker-python-sdk-ci-integ-tests
97+
source-version-override: 'refs/pull/${{ github.event.pull_request.number }}/head^{${{ github.event.pull_request.head.sha }}}'

‎CHANGELOG.md

Lines changed: 103 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,108 @@
11
# Changelog
22

3+
## v2.218.0 (2024-05-01)
4+
5+
### Features
6+
7+
* set default allow_pickle param to False
8+
9+
### Bug Fixes and Other Changes
10+
11+
* properly close files in lineage queries and tests
12+
13+
## v2.217.0 (2024-04-24)
14+
15+
### Features
16+
17+
* support session tag chaining for training job
18+
19+
### Bug Fixes and Other Changes
20+
21+
* Add Triton v24.03 URI
22+
* mainline alt config parsing
23+
* Fix tox installs
24+
* Add PT 2.2 Graviton Inference DLC
25+
26+
## v2.216.1 (2024-04-22)
27+
28+
### Bug Fixes and Other Changes
29+
30+
* add DXB and CGK to Jumpstart regions
31+
* chore(deps): bump apache-airflow from 2.8.4 to 2.9.0 in /requirements/extras
32+
* bump djl-inference 0.27.0 neuronx sdk to 2.18.1
33+
* chore: release TGI 2.0.0
34+
35+
## v2.216.0 (2024-04-17)
36+
37+
### Features
38+
39+
* optimum 0.0.21
40+
* Add TF 2.14 Graviton Inference support
41+
* JumpStart alternative config parsing
42+
* TGI 1.4.5
43+
44+
### Bug Fixes and Other Changes
45+
46+
* chore(deps): bump black from 22.3.0 to 24.3.0 in /requirements/extras
47+
* Add back serialization for automatic speech recognition
48+
* bump apache-airflow version to 2.8.4
49+
* remove trailing slash when uploading to S3 with dataset_builder.to_csv_file
50+
* Update Collaborator Check workflow to check for users which are part of collaborator team
51+
* forward network_isolation parameter to Estimators when False
52+
* Flaky slow test
53+
* Revert "Test SM PySDK Variations"
54+
55+
### Documentation Changes
56+
57+
* Add supported task types to schema builder omission
58+
59+
## v2.215.0 (2024-04-12)
60+
61+
### Features
62+
63+
* JumpStart Gated Model Support in ModelBuilder Local Modes
64+
* Changes to support remote schema retrieval for task types (question-answering, fill-mask) and added e2e tests for both local and remote hf schema logic.
65+
* Upgrade smp to version 2.3.0
66+
67+
### Bug Fixes and Other Changes
68+
69+
* disable modelbuilder mlflow local integ tests
70+
* add integ-tests to codebuild-ci.yml
71+
* [Feat] Support MLflow Model Format Through ModelBuilder
72+
* Test SM PySDK Variations
73+
* typo in jumpstart manifest and refine tests
74+
* add kix to launched regions
75+
* Remove space specific business logic from Python SDK function to fetch execution role
76+
* Remove notebook tests from CI health check and the script
77+
78+
## v2.214.3 (2024-04-04)
79+
80+
### Bug Fixes and Other Changes
81+
82+
* [Fix] Switch to subprocess in ModelBuilder when capturing dependencies
83+
* chore: skip flaky test
84+
85+
## v2.214.2 (2024-04-01)
86+
87+
### Bug Fixes and Other Changes
88+
89+
* Skip JS Tune integration test
90+
* bump apache-airflow version to 2.8.3
91+
* bump onnx version to >=1.15.0
92+
* Updates for DJL 0.27.0 release
93+
* Tune (local mode) support for Jumpstart Models
94+
* attach jumpstart estimator for gated model
95+
96+
## v2.214.1 (2024-03-27)
97+
98+
### Bug Fixes and Other Changes
99+
100+
* Update schema dependency version
101+
* remove failing deprecated tests from suite
102+
* update readme, trigger p311 tests
103+
* JumpStart list models flaky tests
104+
* fix badge in README
105+
3106
## v2.214.0 (2024-03-22)
4107

5108
### Features

‎VERSION

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
2.214.1.dev0
1+
2.218.1.dev0

‎pyproject.toml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
[tool.black]
2+
line-length = 100

‎requirements/extras/huggingface_requirements.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1 +1,2 @@
11
accelerate>=0.24.1,<=0.27.0
2+
sagemaker_schema_inference_artifacts>=0.0.5

‎requirements/extras/test_requirements.txt

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -9,10 +9,10 @@ coverage>=5.2, <6.2
99
mock==4.0.3
1010
contextlib2==21.6.0
1111
awslogs==0.14.0
12-
black==22.3.0
12+
black==24.3.0
1313
stopit==1.1.2
1414
# Update tox.ini to have correct version of airflow constraints file
15-
apache-airflow==2.8.2
15+
apache-airflow==2.9.0
1616
apache-airflow-providers-amazon==7.2.1
1717
attrs>=23.1.0,<24
1818
fabric==2.6.0
@@ -31,6 +31,8 @@ transformers>=4.36.0
3131
sentencepiece==0.1.99
3232
# https://github.com/triton-inference-server/server/issues/6246
3333
tritonclient[http]<2.37.0
34-
onnx==1.14.1
34+
onnx>=1.15.0
3535
# tf2onnx==1.15.1
3636
nbformat>=5.9,<6
37+
accelerate>=0.24.1,<=0.27.0
38+
schema==0.7.5

‎requirements/tox/black_requirements.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
black==24.3.0

‎requirements/tox/twine_requirements.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
twine==3.8.0
1+
twine==5.0.0

‎src/sagemaker/amazon/record_pb2.py

Lines changed: 8 additions & 8 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)