Skip to content

Commit 4fae327

Browse files
awaelchlicarmoccarohitgr7Bordadependabot[bot]
authored
Weekly patch release v1.7.2 (#14126)
* update version and changelog for 1.7.2 release * Reset all results on epoch end (#14061) Co-authored-by: Carlos Mocholí <[email protected]> * Skip ddp fork tests on windows (#14121) * Fix device placement when `.cuda()` called without specifying index (#14128) * Convert subprocess test to standalone test (#14101) * Fix entry point test for Python 3.10 (#14154) * Fix flaky test caused by weak reference (#14157) * Fix saving hyperparameters in a composition where parent is not a LM or LDM (#14151) Co-authored-by: Rohit Gupta <[email protected]> * Remove DeepSpeed version restriction from Lite (#13967) * Configure the check-group app (#14165) Co-authored-by: Jirka <[email protected]> * Update onnxruntime requirement from <=1.12.0 to <1.13.0 in /requirements (#14083) Updates the requirements on [onnxruntime](https://github.com/microsoft/onnxruntime) to permit the latest version. - [Release notes](https://github.com/microsoft/onnxruntime/releases) - [Changelog](https://github.com/microsoft/onnxruntime/blob/master/docs/ReleaseManagement.md) - [Commits](microsoft/onnxruntime@v0.1.4...v1.12.1) --- updated-dependencies: - dependency-name: onnxruntime dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Update gcsfs requirement from <2022.6.0,>=2021.5.0 to >=2021.5.0,<2022.8.0 in /requirements (#14079) Update gcsfs requirement in /requirements Updates the requirements on [gcsfs](https://github.com/fsspec/gcsfs) to permit the latest version. - [Release notes](https://github.com/fsspec/gcsfs/releases) - [Commits](fsspec/gcsfs@2021.05.0...2022.7.1) --- updated-dependencies: - dependency-name: gcsfs dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Fix a bug that caused spurious `AttributeError` when multiple `DataLoader` classes are imported (#14117) fix * CI: Replace `_` of in GHA workflow filenames with `-` (#13917) * Rename workflow files * Update docs * Fix azure badges * Update the main readme * bad rebase * Update doc * CI: Update Windows version from 2019 to 2022 (#14129) Update windows * CI/CD: Add CUDA version to docker image tags (#13831) * append cuda version to tags * revertme: push to hub * Update docker readme * Build base-conda-py3.9-torch1.12-cuda11.3.1 * Use new images in conda tests * revertme: push to hub * Revert "revertme: push to hub" This reverts commit 0f7d534. * Revert "revertme: push to hub" This reverts commit 46a05fc. * Run conda if workflow edited * Run gpu testing if workflow edited * Use new tags in release/Dockerfile * Build base-cuda and PL release images with all combinations * Update release docker * Update conda from py3.9-torch1.12 to py3.10-torch.1.12 * Fix ubuntu version * Revert conda * revertme: push to hub * Don't build Python 3.10 for now... * Fix pl release builder * updating version contribute to the error? docker/buildx#456 * Update actions' versions * Update slack user to notify * Don't use 11.6.0 to avoid bagua incompatibility * Don't use 11.1, and use 11.1.1 * Update .github/workflows/ci-pytorch_test-conda.yml Co-authored-by: Luca Medeiros <[email protected]> * Update trigger * Ignore artfacts from tutorials * Trim docker images to distribute * Add an image for tutorials * Update conda image 3.8x1.10 * Try different conda variants * No need to set cuda for conda jobs * Update who to notify ipu failure * Don't push * update filenaem Co-authored-by: Luca Medeiros <[email protected]> * Avoid entry_points deprecation warning (#14052) Co-authored-by: Adam J. Stewart <[email protected]> Co-authored-by: Akihiro Nitta <[email protected]> * Configure the check-group app (#14165) Co-authored-by: Jirka <[email protected]> * Profile batch transfer and gradient clipping hooks (#14069) Co-authored-by: Rohit Gupta <[email protected]> * Avoid false positive warning about using `sync_dist` when using torchmetrics (#14143) Co-authored-by: Carlos Mocholí <[email protected]> Co-authored-by: Rohit Gupta <[email protected]> * Avoid raising the sampler warning if num_replicas=1 (#14097) Co-authored-by: Carlos Mocholí <[email protected]> Co-authored-by: Rohit Gupta <[email protected]> Co-authored-by: otaj <[email protected]> * Remove skipping logic in favor of path filtering (#14170) * Support checkpoint save and load with Stochastic Weight Averaging (#9938) Co-authored-by: thomas chaton <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Adrian Wälchli <[email protected]> Co-authored-by: Carlos Mocholi <[email protected]> Co-authored-by: Kushashwa Ravi Shrimali <[email protected]> Co-authored-by: Jirka <[email protected]> Co-authored-by: Rohit Gupta <[email protected]> * Use fsdp module to initialize precision scalar for fsdp native (#14092) Co-authored-by: Carlos Mocholí <[email protected]> Co-authored-by: Laverne Henderson <[email protected]> Co-authored-by: Rohit Gupta <[email protected]> * add more issues types (#14174) * add more issues types * Update .github/ISSUE_TEMPLATE/config.yml Co-authored-by: Mansy <[email protected]> * typo Co-authored-by: Adrian Wälchli <[email protected]> Co-authored-by: Kaushik B <[email protected]> Co-authored-by: Mansy <[email protected]> Co-authored-by: Adrian Wälchli <[email protected]> Co-authored-by: Laverne Henderson <[email protected]> Co-authored-by: Akihiro Nitta <[email protected]> * CI: clean building docs (#14216) * CI: clean building docs * group * . * CI: docker focus on PL only (#14246) * CI: docker focus on PL only * group * Allowed setting attributes on `DataLoader` and `BatchSampler` when instantiated inside `*_dataloader` hooks (#14212) Co-authored-by: otaj <[email protected]> * Revert "Remove skipping logic in favor of path filtering (#14170)" (#14244) * Update defaults for WandbLogger's run name and project name (#14145) Co-authored-by: Carlos Mocholí <[email protected]> Co-authored-by: Rohit Gupta <[email protected]> Co-authored-by: Jirka <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Akihiro Nitta <[email protected]> Co-authored-by: Luca Medeiros <[email protected]> Co-authored-by: Adam J. Stewart <[email protected]> Co-authored-by: otaj <[email protected]> Co-authored-by: Adam Reeve <[email protected]> Co-authored-by: thomas chaton <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Kushashwa Ravi Shrimali <[email protected]> Co-authored-by: Laverne Henderson <[email protected]> Co-authored-by: Jirka Borovec <[email protected]> Co-authored-by: Kaushik B <[email protected]> Co-authored-by: Mansy <[email protected]>
1 parent be58159 commit 4fae327

File tree

75 files changed

+1212
-583
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

75 files changed

+1212
-583
lines changed

.actions/setup_tools.py

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -94,11 +94,10 @@ def load_readme_description(path_dir: str, homepage: str, version: str) -> str:
9494
text = text.replace("pytorch-lightning.readthedocs.io/en/stable/", f"pytorch-lightning.readthedocs.io/en/{version}")
9595
# codecov badge
9696
text = text.replace("/branch/master/graph/badge.svg", f"/release/{version}/graph/badge.svg")
97-
# replace github badges for release ones
97+
# github actions badge
9898
text = text.replace("badge.svg?branch=master&event=push", f"badge.svg?tag={version}")
99-
# Azure...
99+
# azure pipelines badge
100100
text = text.replace("?branchName=master", f"?branchName=refs%2Ftags%2F{version}")
101-
text = re.sub(r"\?definitionId=\d+&branchName=master", f"?definitionId=2&branchName=refs%2Ftags%2F{version}", text)
102101

103102
skip_begin = r"<!-- following section will be skipped from PyPI description -->"
104103
skip_end = r"<!-- end skipping PyPI description -->"

.azure/gpu-benchmark.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ jobs:
2828
cancelTimeoutInMinutes: "2"
2929
pool: azure-jirka-spot
3030
container:
31-
image: "pytorchlightning/pytorch_lightning:base-cuda-py3.9-torch1.12"
31+
image: "pytorchlightning/pytorch_lightning:base-cuda-py3.9-torch1.12-cuda11.3.1"
3232
options: "--runtime=nvidia -e NVIDIA_VISIBLE_DEVICES=all --shm-size=32g"
3333
workspace:
3434
clean: all

.azure/gpu-tests.yml

Lines changed: 3 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ jobs:
2626
strategy:
2727
matrix:
2828
'PyTorch - stable':
29-
image: "pytorchlightning/pytorch_lightning:base-cuda-py3.9-torch1.12"
29+
image: "pytorchlightning/pytorch_lightning:base-cuda-py3.9-torch1.12-cuda11.3.1"
3030
# how long to run the job before automatically cancelling
3131
timeoutInMinutes: "80"
3232
# how much time to give 'run always even if cancelled tasks' before stopping them
@@ -44,7 +44,7 @@ jobs:
4444

4545
- bash: |
4646
CHANGED_FILES=$(git diff --name-status origin/master -- . | awk '{print $2}')
47-
FILTER='src/pytorch_lightning|requirements/pytorch|tests/tests_pytorch|examples/pl_*|.azure/*'
47+
FILTER='src/pytorch_lightning|requirements/pytorch|tests/tests_pytorch|examples/pl_*'
4848
echo $CHANGED_FILES > changed_files.txt
4949
MATCHES=$(cat changed_files.txt | grep -E $FILTER)
5050
echo $MATCHES
@@ -75,7 +75,7 @@ jobs:
7575
CUDA_VERSION_MM=$(python -c "import torch ; print(''.join(map(str, torch.version.cuda.split('.')[:2])))")
7676
pip install "bagua-cuda$CUDA_VERSION_MM>=0.9.0"
7777
pip install -e .[strategies]
78-
pip install deepspeed>0.6.4 # TODO: remove when docker images are upgraded
78+
pip install -U deepspeed # TODO: remove when docker images are upgraded
7979
pip install --requirement requirements/pytorch/devel.txt
8080
pip list
8181
env:
@@ -119,15 +119,6 @@ jobs:
119119
timeoutInMinutes: "35"
120120
condition: eq(variables['continue'], '1')
121121

122-
- bash: bash run_standalone_tasks.sh
123-
workingDirectory: tests/tests_pytorch
124-
env:
125-
PL_USE_MOCKED_MNIST: "1"
126-
PL_RUN_CUDA_TESTS: "1"
127-
displayName: 'Testing: PyTorch standalone tasks'
128-
timeoutInMinutes: "10"
129-
condition: eq(variables['continue'], '1')
130-
131122
- bash: |
132123
python -m coverage report
133124
python -m coverage xml

.github/ISSUE_TEMPLATE/config.yml

Lines changed: 10 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,14 @@
11
blank_issues_enabled: false
22
contact_links:
3-
- name: Ask a Question
3+
- name: Ask a Question
44
url: https://github.com/Lightning-AI/lightning/discussions/new
5-
about: Ask and answer Lightning related questions
6-
- name: 💬 Slack
5+
about: Ask and answer Lightning related questions.
6+
- name: 💬 Chat with us
77
url: https://www.pytorchlightning.ai/community
8-
about: Chat with our community
8+
about: Live chat with experts, engineers, and users in our Slack community.
9+
- name: 📖 Read the documentation
10+
url: https://lightning.ai/lightning-docs/
11+
about: Please consult the documentation before opening any issues!
12+
- name: 🙋 Contact us about professional services
13+
url: https://lightning.ai
14+
about: Contact the Lightning.ai sales team for paid support.

.github/checkgroup.yml

Lines changed: 173 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,173 @@
1+
custom_service_name: "Lightning CI required checker"
2+
subprojects:
3+
- id: "CI: CircleCI"
4+
paths:
5+
- ".circleci/**"
6+
checks:
7+
- "test-on-tpus"
8+
9+
- id: "CI: Azure"
10+
paths:
11+
- ".azure/**"
12+
checks:
13+
- "pytorch-lightning (GPUs)"
14+
- "pytorch-lightning (GPUs) (testing PyTorch - stable)"
15+
- "pytorch-lightning (HPUs)"
16+
- "pytorch-lightning (IPUs)"
17+
18+
- id: "pytorch_lightning"
19+
paths:
20+
# all examples don't need to be added because they aren't used in CI, but these are
21+
- "examples/run_ddp_examples.sh"
22+
- "examples/convert_from_pt_to_pl/**"
23+
- "examples/run_pl_examples.sh"
24+
- "examples/pl_basics/backbone_image_classifier.py"
25+
- "examples/pl_basics/autoencoder.py"
26+
- "examples/pl_loops/mnist_lite.py"
27+
- "examples/pl_fault_tolerant/automatic.py"
28+
- "examples/test_pl_examples.py"
29+
- "examples/pl_integrations/dali_image_classifier.py"
30+
- "requirements/pytorch/**"
31+
- "src/pytorch_lightning/**"
32+
- "tests/tests_pytorch/**"
33+
- "setup.cfg" # includes pytest config
34+
- ".github/workflows/ci-pytorch*.yml"
35+
- ".github/workflows/docs-*.yml"
36+
checks:
37+
- "conda (3.8, 1.10)"
38+
- "conda (3.8, 1.9)"
39+
- "conda (3.9, 1.11)"
40+
- "conda (3.9, 1.12)"
41+
- "cpu (macOS-11, 3.10, latest, stable)"
42+
- "cpu (macOS-11, 3.7, latest, stable)"
43+
- "cpu (macOS-11, 3.7, oldest, stable)"
44+
- "cpu (ubuntu-20.04, 3.10, latest, stable)"
45+
- "cpu (ubuntu-20.04, 3.7, latest, stable)"
46+
- "cpu (ubuntu-20.04, 3.7, oldest, stable)"
47+
- "cpu (windows-2022, 3.10, latest, stable)"
48+
- "cpu (windows-2022, 3.7, latest, stable)"
49+
- "cpu (windows-2022, 3.7, oldest, stable)"
50+
- "doctest (pytorch)"
51+
- "make-docs (pytorch)"
52+
- "mypy"
53+
- "PR Gatekeeper (pytorch)"
54+
- "pytorch-lightning (GPUs)"
55+
- "pytorch-lightning (GPUs) (testing PyTorch - stable)"
56+
- "pytorch-lightning (HPUs)"
57+
- "pytorch-lightning (IPUs)"
58+
- "slow (macOS-11, 3.7, 1.11)"
59+
- "slow (ubuntu-20.04, 3.7, 1.11)"
60+
- "slow (windows-2022, 3.7, 1.11)"
61+
- "test-on-tpus"
62+
63+
- id: "pytorch_lightning: Docs"
64+
paths:
65+
- "docs/source-pytorch/**"
66+
- ".github/workflows/docs-*.yml"
67+
- "requirements/docs.txt"
68+
- "requirements/pytorch/**"
69+
checks:
70+
- "doctest (pytorch)"
71+
- "make-docs (pytorch)"
72+
73+
- id: "pytorch_lightning: Docker"
74+
paths:
75+
- "dockers/**"
76+
- "!dockers/README.md"
77+
- "requirements.txt"
78+
- "requirements/*.txt"
79+
- "requirements/pytorch/*"
80+
- "environment.yml"
81+
- ".github/workflows/*docker*.yml"
82+
- "setup.py"
83+
checks:
84+
- "build-conda (3.8, 1.10)"
85+
- "build-conda (3.8, 1.9)"
86+
- "build-conda (3.9, 1.11)"
87+
- "build-conda (3.9, 1.12)"
88+
- "build-cuda (3.8, 1.9, 11.1.1)"
89+
- "build-cuda (3.9, 1.10, 11.3.1)"
90+
- "build-cuda (3.9, 1.11, 11.3.1)"
91+
- "build-cuda (3.9, 1.12, 11.3.1)"
92+
- "build-cuda (3.9, 1.9, 11.1.1)"
93+
- "build-hpu (1.5.0, 1.11.0)"
94+
- "build-ipu (3.9, 1.9)"
95+
- "build-NGC"
96+
- "build-pl (3.9, 1.10, 11.3.1)"
97+
- "build-pl (3.9, 1.11, 11.3.1)"
98+
- "build-pl (3.9, 1.12, 11.3.1)"
99+
- "build-pl (3.9, 1.9, 11.1.1)"
100+
- "build-xla (3.7, 1.12)"
101+
102+
- id: "pytorch_lightning: mypy"
103+
paths:
104+
- ".github/workflows/code-checks.yml"
105+
- "pyproject.toml" # includes mypy config
106+
checks:
107+
- "mypy"
108+
109+
- id: "lightning_app"
110+
paths:
111+
- ".github/workflows/ci-app*.yml"
112+
- "requirements/app/**"
113+
- "src/lightning_app/**"
114+
- "tests/tests_app/**"
115+
- "tests/tests_app_examples/**"
116+
- "tests/tests_clusters/**"
117+
# the examples are used in the app CI
118+
- "examples/app_*"
119+
checks:
120+
- "Cloud Test (boring_app)"
121+
- "Cloud Test (collect_failures)"
122+
- "Cloud Test (commands_and_api)"
123+
- "Cloud Test (custom_work_dependencies)"
124+
- "Cloud Test (drive)"
125+
- "Cloud Test (idle_timeout)"
126+
- "Cloud Test (payload)"
127+
- "Cloud Test (template_jupyterlab)"
128+
- "Cloud Test (template_react_ui)"
129+
- "Cloud Test (template_streamlit_ui)"
130+
- "Cloud Test (v0_app)"
131+
- "doctest (app)"
132+
- "make-docs (app)"
133+
- "pytest (macOS-11, 3.8, latest)"
134+
- "pytest (macOS-11, 3.8, oldest)"
135+
- "pytest (ubuntu-20.04, 3.8, latest)"
136+
- "pytest (ubuntu-20.04, 3.8, oldest)"
137+
- "pytest (windows-2022, 3.8, latest)"
138+
- "pytest (windows-2022, 3.8, oldest)"
139+
140+
- id: "lightning_app: Docs"
141+
paths:
142+
- "docs/source-app/**"
143+
- ".github/workflows/docs-*.yml"
144+
- "requirements/docs.txt"
145+
- "requirements/app/**"
146+
checks:
147+
- "doctest (app)"
148+
- "make-docs (app)"
149+
150+
- id: "install"
151+
paths:
152+
- ".actions/setup_tools.py"
153+
- ".github/workflows/ci-pkg-install.yml"
154+
- "setup.py"
155+
- "src/lightning/**"
156+
# all __about__, __version__, __setup__
157+
- "src/*/__*.py"
158+
checks:
159+
- "install-meta-pypi (macOS-11, 3.8)"
160+
- "install-meta-pypi (ubuntu-20.04, 3.8)"
161+
- "install-meta-pypi (windows-2022, 3.8)"
162+
- "install-meta-src (macOS-11, 3.8)"
163+
- "install-meta-src (macOS-11, lightning, 3.8)"
164+
- "install-meta-src (ubuntu-20.04, 3.8)"
165+
- "install-meta-src (ubuntu-20.04, lightning, 3.8)"
166+
- "install-meta-src (windows-2022, 3.8)"
167+
- "install-meta-src (windows-2022, lightning, 3.8)"
168+
- "install-standalone (macOS-11, app, 3.8)"
169+
- "install-standalone (macOS-11, pytorch, 3.8)"
170+
- "install-standalone (ubuntu-20.04, app, 3.8)"
171+
- "install-standalone (ubuntu-20.04, pytorch, 3.8)"
172+
- "install-standalone (windows-2022, app, 3.8)"
173+
- "install-standalone (windows-2022, pytorch, 3.8)"

0 commit comments

Comments
 (0)