You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+13-13Lines changed: 13 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -42,19 +42,19 @@ This guidance will:
42
42
</div>
43
43
44
44
### Architecture Steps
45
-
1. User authenticates to AWS Identity and Access Management (IAM) via AWS Tools and SDKs.
46
-
2. The configuration and input media is uploaded to a dedicated Amazon Simple Storage Service (S3) bucket location. This can be done using a Gradio interface and AWS Software Development Kit (SDK).
47
-
3. Optionally, the solution supports external job submission by uploading a ‘.json’ job configuration file and media into a designated S3 bucket location.
48
-
4. The job json file uploaded to the bucket will trigger an Amazon Simple Notification Service (SNS) message that will invoke an initialization AWS Lambda function.
49
-
5. The initialization Lambda function will perform input validation and set appropriate variables for the state machine.
50
-
6. The workflow job record will be created in Amazon DynamoDB job table.
51
-
7. The initialization Lambda function will invoke an AWS Step Functions State Machine to handle the entire workflow job.
52
-
8. An Amazon SageMaker Training Job will be submitted synchronously using the state machine built-in wait until completion mechanism.
53
-
10. The Amazon Elastic Container Registry (ECR) container image and S3 model artifacts will be used to spin up a new graphics processing unit (GPU) container. The instance type is determined by the job json configuration.
54
-
11. The GPU container will run the entire pipeline.
55
-
12. Upon job completion, a final Lambda function will complete the workflow job by updating the job metadata in DynamoDB and notifying the user via email upon completion using SNS.
56
-
13. Internal workflow parameters are stored in Parameter Store during solution deployment to decouple services.
57
-
Amazon CloudWatch is used to monitor the training logs, surfacing errors to the user.
45
+
1. User authenticates to [AWS Identity and Access Management (IAM)](https://aws.amazon.com/iam/) via AWS Tools and SDKs.
46
+
2. The input is uploaded to a dedicated [Amazon Simple Storage Service (S3)](https://aws.amazon.com/s3/) job bucket location. This can be done using a Gradio interface and AWS Software Development Kit (SDK).
47
+
3. Optionally, the solution supports external job submission by uploading a ‘.JSON’ job configuration file and media into a designated S3 job bucket location.
48
+
4. The job JSON file uploaded to the S3 job bucket will trigger an [Amazon Simple Notification Service (SNS)](https://aws.amazon.com/sns/) message that will invoke an initialization [AWS Lambda](https://aws.amazon.com/lambda/) function.
49
+
5. The job trigger **AWS Lambda** function will perform input validation and set appropriate variables for the [AWS Step Function State Machine](https://aws.amazon.com/step-functions/).
50
+
6. The workflow job record will be created in [Amazon DynamoDB](https://aws.amazon.com/dynamodb/) job table.
51
+
7. The job trigger **AWS Lambda** function will invoke an **AWS Step Functions State Machine** to handle the entire workflow job.
52
+
8. An [Amazon SageMaker](https://aws.amazon.com/sagemaker/) Training Job will be submitted synchronously using the state machine built-in wait until completion mechanism.
53
+
9. The [Amazon Elastic Container Registry (ECR)](https://aws.amazon.com/ecr/) container image and S3 job bucket model artifacts will be used to spin up a new Graphics Processing Unit (GPU) container. The compute node instance type is determined by the job JSON configuration.
54
+
10. The GPU container will run the entire pipeline as an **Amazon SageMaker** training job.
55
+
11. The job completion**AWS Lambda** function will complete the workflow job by updating the job metadata in **Amazon DynamoDB** and notifying the user via email upon completion using **Amazon SNS**.
56
+
12. Internal workflow parameters are stored in [AWS System Manager Parameter Store](https://docs.aws.amazon.com/systems-manager/latest/userguide/systems-manager-parameter-store.html) during guidance deployment to decouple the job trigger **AWS Lambda** function and the **AWS Step Function State Machine**.
57
+
13.[Amazon CloudWatch](https://aws.amazon.com/cloudwatch/) is used to monitor the training logs, surfacing errors to the user.
0 commit comments