Skip to content
This repository was archived by the owner on Dec 30, 2024. It is now read-only.

Commit cab35bc

Browse files
authored
update README with architecture details (#27)
* update README with numbering the 5 key architectural components
1 parent ce09a65 commit cab35bc

File tree

1 file changed

+12
-6
lines changed

1 file changed

+12
-6
lines changed

README.md

Lines changed: 12 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -24,18 +24,24 @@ For a detailed solution deployment guide, refer to [Discovering Hot Topics using
2424

2525
## Architecture Overview
2626

27-
Deploying this solution with the default parameters builds the following environment in the AWS Cloud. The overall architecture of the solution has the following key components. Note that the below diagram represents Twitter as the ingestion feed - there are plans to add other social media platforms in future releases.
27+
Deploying this solution with the default parameters builds the following environment in the AWS Cloud. The overall architecture of the solution has the following key components. Note that the below diagram represents Twitter and news feeds as ingestion sources - there are plans to add other social media platforms in future releases.
2828

2929
<p align="center">
3030
<img src="source/images/architecture.png">
3131
<br/>
3232
</p>
3333

34-
- Ingestion – Social media feed ingestion using a combination of Lambda functions, Kinesis Data Stream and DynamoDB to manage state
35-
- Workflow – An AWS Step Function based workflow to orchestrate various services
36-
- Inference – AWS Cloud’s machine learning capabilities through Amazon Translate, Amazon Comprehend, and Amazon Rekognition
37-
- Application Integration – Event based architecture approach through the use of AWS Events Bridge
38-
- Storage and Visualization – A combination of Kinesis Data Firehose, S3 Buckets, Glue, Athena and QuickSight
34+
The architecture of the solution includes the following key components and workflows:
35+
36+
1. Ingestion – Social media and RSS feed ingestion and management using Lambda functions, Amazon DynamoDB, and Amazon CloudWatch Event Scheduler.
37+
38+
2. Data Stream — The data is buffered through Amazon Kinesis Data Streams to provide resiliency and throttle incoming requests. The Data Streams have a configured DLQ to catch any errors in processing feeds.
39+
40+
3. Workflow – Consumer (Lambda function) of the Data Streams initiates a Step Functions workflow that orchestrates Amazon Machine Learning capabilities including: Amazon Translate, Amazon Comprehend, and Amazon Rekognition.
41+
42+
4. Integration – The inference data integrates with the storage components through an event-driven architecture using Amazon EventBridge. EventBridge allows further customization to add additional targets by configuring rules.
43+
44+
5. Storage and Visualization – A combination of Kinesis Data Firehose, Amazon S3 buckets, AWS Glue tables, Amazon Athena, and Amazon QuickSight.
3945

4046
<p align="center">
4147
<img src="source/images/dashboard.png">

0 commit comments

Comments
 (0)