You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/use-cases-architectures/pages/real-time-data-pipeline/02-create-decodable-objects.adoc
+32-12Lines changed: 32 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,15 +10,19 @@ This guide is part of a series that creates a real-time data pipeline with Astra
10
10
11
11
== The Astra Streaming connection info
12
12
13
-
To connect Astra to Decodable you are going to need a few things from your Astra Streaming tenant. First from the Astra portal home navigate to the webstore-clicks streaming tenant.
13
+
To connect Astra to Decodable, you need some information from your Astra Streaming tenant. From the Astra portal home, navigate to the webstore-clicks streaming tenant.
14
14
15
15
image:decodable-data-pipeline/02/image4.png[]
16
16
17
-
You should be on the “Connect” tab. Scroll down and locate the “Tenant Details” area. You will need these values.
17
+
In the “Connect” tab, scroll down to the “Tenant Details” area.
18
+
You will need these values to connect to Decodable.
18
19
19
20
image:decodable-data-pipeline/02/image16.png[]
20
21
21
-
You will also need a Pulsar token. Click the “Token Manager” link and “Create Token”. Just make it for 7 days, no need to create a long-lasting cred. That will popup a window with the token value. Click the clipboard icon to copy the token. Paste it to a temp safe location like notepad.
22
+
You will also need to create a Pulsar token.
23
+
Click the “Token Manager” link and “Create Token”.
24
+
A popup window will appear with the token value.
25
+
Click the clipboard icon to copy the token, and paste it to a temporary safe location like Notepad.
We will need one more connection created. This one is how raw data will be posted (or ingested) into the pipeline. We’ll use Decodable’s “REST” connector.
180
+
We need to create one more connection.
181
+
We’ll use Decodable’s REST connector to POST (or ingest) raw data into the pipeline.
167
182
168
183
. Navigate to the “Connections” area and click “New Connection”.
. anchor:endpoint-details[]Did you notice in the connector settings how the “Endpoint” value had a “<connection-id>”? That is a dynamic value that is generated when the connection is created. Navigate to the “Details” tab of the connection and you will see the final endpoint value. We’ll prefix that value with our account info (ddieruf.api.decodable.co) to create a usable URL. Learn more about the https://docs.decodable.co/docs/connector-reference-rest#endpoint-url[REST connector in Decodable documentation^]{external-link-icon}.
232
+
. anchor:endpoint-details[]Notice in the connector settings how the “Endpoint” value has a “<connection-id>” value. This is a dynamic value that is generated when the connection is created. Navigate to the “Details” tab of the connection and you will see the final endpoint value. We’ll prefix that value with our account info (ddieruf.api.decodable.co) to create a usable URL. Learn more about the REST connector in the https://docs.decodable.co/docs/connector-reference-rest#endpoint-url[Decodable documentation^]{external-link-icon}.
213
233
+
214
234
image:decodable-data-pipeline/02/image7.png[]
215
235
@@ -255,15 +275,15 @@ from `Webstore-Raw-Clicks-Stream`
255
275
+
256
276
image:decodable-data-pipeline/02/image17.png[]
257
277
258
-
. Click “Next” to view the autogenerated output stream. Thank you Decodable!
278
+
. Click “Next” and review the auto-generated output stream. Thank you Decodable!
259
279
+
260
280
image:decodable-data-pipeline/02/image23.png[]
261
281
262
282
. Click “Next” and name the pipeline “Webstore-Raw-Clicks-Normalize-Pipeline”.
263
283
+
264
284
image:decodable-data-pipeline/02/image11.png[]
265
285
266
-
. Click “Create Pipeline” to create. Be patient, it might take a few seconds.
286
+
. Click “Create Pipeline” and be patient, it might take a few seconds.
267
287
+
268
288
image:decodable-data-pipeline/02/image20.png[]
269
289
@@ -292,7 +312,7 @@ where TRIM(LOWER(SPLIT_INDEX(url_path, '/', 1))) = 'catalog'
292
312
+
293
313
image:decodable-data-pipeline/02/image33.png[]
294
314
295
-
. Click “Next” and review the auto-generated output streaming. Thank you again Decodable!
315
+
. Click “Next” and review the auto-generated output stream. Thank you again Decodable!
0 commit comments