Skip to content

Commit 6c3111e

Browse files
committed
02-cleanup-complete
1 parent 208735e commit 6c3111e

File tree

1 file changed

+32
-12
lines changed

1 file changed

+32
-12
lines changed

modules/use-cases-architectures/pages/real-time-data-pipeline/02-create-decodable-objects.adoc

Lines changed: 32 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -10,15 +10,19 @@ This guide is part of a series that creates a real-time data pipeline with Astra
1010

1111
== The Astra Streaming connection info
1212

13-
To connect Astra to Decodable you are going to need a few things from your Astra Streaming tenant. First from the Astra portal home navigate to the webstore-clicks streaming tenant.
13+
To connect Astra to Decodable, you need some information from your Astra Streaming tenant. From the Astra portal home, navigate to the webstore-clicks streaming tenant.
1414

1515
image:decodable-data-pipeline/02/image4.png[]
1616

17-
You should be on the “Connect” tab. Scroll down and locate the “Tenant Details” area. You will need these values.
17+
In the “Connect” tab, scroll down to the “Tenant Details” area.
18+
You will need these values to connect to Decodable.
1819

1920
image:decodable-data-pipeline/02/image16.png[]
2021

21-
You will also need a Pulsar token. Click the “Token Manager” link and “Create Token”. Just make it for 7 days, no need to create a long-lasting cred. That will popup a window with the token value. Click the clipboard icon to copy the token. Paste it to a temp safe location like notepad.
22+
You will also need to create a Pulsar token.
23+
Click the “Token Manager” link and “Create Token”.
24+
A popup window will appear with the token value.
25+
Click the clipboard icon to copy the token, and paste it to a temporary safe location like Notepad.
2226

2327
image:decodable-data-pipeline/02/image31.png[]
2428

@@ -95,7 +99,12 @@ image:decodable-data-pipeline/02/image12.png[]
9599
|===
96100
+
97101
image:decodable-data-pipeline/02/image10.png[]
98-
102+
+
103+
[NOTE]
104+
====
105+
You have to actually select "string" for the data type in the dropdown menu, or Decodable will not accept the schema.
106+
====
107+
+
99108
. Click “Next” and name the overall connection “Astra-Streaming-All-Webclicks-Connection”.
100109
+
101110
image:decodable-data-pipeline/02/image26.png[]
@@ -104,7 +113,7 @@ image:decodable-data-pipeline/02/image26.png[]
104113
+
105114
image:decodable-data-pipeline/02/image13.png[]
106115

107-
== Creating Decodable connections to Astra Streaming for product web clicks
116+
== Creating a Decodable connection to Astra Streaming for product web clicks
108117

109118
Create another connection to stream product clicks.
110119

@@ -152,7 +161,12 @@ image:decodable-data-pipeline/02/image21.png[]
152161
|===
153162
+
154163
image:decodable-data-pipeline/02/image3.png[]
155-
164+
+
165+
[NOTE]
166+
====
167+
You have to actually select "string" for the data type in the dropdown menu, or Decodable will not accept the schema.
168+
====
169+
+
156170
. Click “Next” and name the overall connection “Astra-Streaming-Product-Webclicks-Connection”.
157171
+
158172
image:decodable-data-pipeline/02/image15.png[]
@@ -163,7 +177,8 @@ image:decodable-data-pipeline/02/image34.png[]
163177

164178
== Creating an HTTP data ingestion source
165179

166-
We will need one more connection created. This one is how raw data will be posted (or ingested) into the pipeline. We’ll use Decodable’s “REST” connector.
180+
We need to create one more connection.
181+
We’ll use Decodable’s REST connector to POST (or ingest) raw data into the pipeline.
167182

168183
. Navigate to the “Connections” area and click “New Connection”.
169184

@@ -200,7 +215,12 @@ image:decodable-data-pipeline/02/image1.png[]
200215
|===
201216
+
202217
image:decodable-data-pipeline/02/image6.png[]
203-
218+
+
219+
[NOTE]
220+
====
221+
You have to actually select "string" for the data type in the dropdown menu, or Decodable will not accept the schema.
222+
====
223+
+
204224
. Click “Next” and name the overall connection “Webstore-Raw-Clicks-Connection”.
205225
+
206226
image:decodable-data-pipeline/02/image29.png[]
@@ -209,7 +229,7 @@ image:decodable-data-pipeline/02/image29.png[]
209229
+
210230
image:decodable-data-pipeline/02/image24.png[]
211231

212-
. anchor:endpoint-details[]Did you notice in the connector settings how the “Endpoint” value had a “<connection-id>”? That is a dynamic value that is generated when the connection is created. Navigate to the “Details” tab of the connection and you will see the final endpoint value. We’ll prefix that value with our account info (ddieruf.api.decodable.co) to create a usable URL. Learn more about the https://docs.decodable.co/docs/connector-reference-rest#endpoint-url[REST connector in Decodable documentation^]{external-link-icon}.
232+
. anchor:endpoint-details[]Notice in the connector settings how the “Endpoint” value has a “<connection-id>” value. This is a dynamic value that is generated when the connection is created. Navigate to the “Details” tab of the connection and you will see the final endpoint value. We’ll prefix that value with our account info (ddieruf.api.decodable.co) to create a usable URL. Learn more about the REST connector in the https://docs.decodable.co/docs/connector-reference-rest#endpoint-url[Decodable documentation^]{external-link-icon}.
213233
+
214234
image:decodable-data-pipeline/02/image7.png[]
215235

@@ -255,15 +275,15 @@ from `Webstore-Raw-Clicks-Stream`
255275
+
256276
image:decodable-data-pipeline/02/image17.png[]
257277

258-
. Click “Next” to view the auto generated output stream. Thank you Decodable!
278+
. Click “Next” and review the auto-generated output stream. Thank you Decodable!
259279
+
260280
image:decodable-data-pipeline/02/image23.png[]
261281

262282
. Click “Next” and name the pipeline “Webstore-Raw-Clicks-Normalize-Pipeline”.
263283
+
264284
image:decodable-data-pipeline/02/image11.png[]
265285

266-
. Click “Create Pipeline” to create. Be patient, it might take a few seconds.
286+
. Click “Create Pipeline” and be patient, it might take a few seconds.
267287
+
268288
image:decodable-data-pipeline/02/image20.png[]
269289

@@ -292,7 +312,7 @@ where TRIM(LOWER(SPLIT_INDEX(url_path, '/', 1))) = 'catalog'
292312
+
293313
image:decodable-data-pipeline/02/image33.png[]
294314

295-
. Click “Next” and review the auto-generated output streaming. Thank you again Decodable!
315+
. Click “Next” and review the auto-generated output stream. Thank you again Decodable!
296316
+
297317
image:decodable-data-pipeline/02/image32.png[]
298318

0 commit comments

Comments
 (0)