@@ -5,9 +5,48 @@ Release Notes
55New features, bug fixes, and improvements are regularly made to the SageMaker
66distributed model parallel library.
77
8- SageMaker Distributed Model Parallel 1.7 .0 Release Notes
8+ SageMaker Distributed Model Parallel 1.8 .0 Release Notes
99========================================================
1010
11+ *Date: March. 23. 2022 *
12+
13+ **New Features **
14+
15+ * Added tensor parallelism support for the `GPT-J model
16+ <https://huggingface.co/docs/transformers/model_doc/gptj> `_.
17+ When using the GPT-J model of Hugging Face Transformers v4.17.0 with
18+ tensor parallelism, the SageMaker model parallel library automatically
19+ replaces the model with a tensor parallel distributed GPT-J model.
20+ For more information, see `Support for Hugging Face Transformer Models
21+ <https://docs.aws.amazon.com/sagemaker/latest/dg/model-parallel-extended-features-pytorch-hugging-face.html> `_
22+ in the *Amazon SageMaker Model Parallel Training developer guide *.
23+
24+ **Migration to AWS Deep Learning Containers **
25+
26+ This version passed benchmark testing and is migrated to the following AWS Deep Learning Containers:
27+
28+ * HuggingFace 4.17.0 DLC with PyTorch 1.10.2
29+
30+ .. code ::
31+
32+ 763104351884.dkr.ecr.us-west-2.amazonaws.com/huggingface-pytorch-training:1.10.2-transformers4.17.0-gpu-py38-cu113-ubuntu20.04
33+
34+
35+ The binary file of this version of the library for custom container users:
36+
37+ .. code ::
38+
39+ https://sagemaker-distributed-model-parallel.s3.us-west-2.amazonaws.com/pytorch-1.10.0/build-artifacts/2022-03-12-00-33/smdistributed_modelparallel-1.8.0-cp38-cp38-linux_x86_64.whl
40+
41+
42+ ----
43+
44+ Release History
45+ ===============
46+
47+ SageMaker Distributed Model Parallel 1.7.0 Release Notes
48+ --------------------------------------------------------
49+
1150*Date: March. 07. 2022 *
1251
1352**Currency Updates **
@@ -49,11 +88,6 @@ This version passed benchmark testing and is migrated to the following AWS Deep
4988 763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:1.10.2-gpu-py38-cu113-ubuntu20.04-sagemaker
5089
5190
52- ----
53-
54- Release History
55- ===============
56-
5791 SageMaker Distributed Model Parallel 1.6.0 Release Notes
5892--------------------------------------------------------
5993
0 commit comments