Skip to content

Commit 9531a27

Browse files
authored
DOC-4949 Refine attributes in Streaming Learning (#54)
* token steps * token stuff and attributes pt 1 * rest of attributes * support-url * astra-db
1 parent 3a045b2 commit 9531a27

File tree

19 files changed

+167
-131
lines changed

19 files changed

+167
-131
lines changed

antora.yml

Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,13 +8,22 @@ nav:
88

99
asciidoc:
1010
attributes:
11+
company: 'DataStax'
1112
product: 'Astra Streaming'
13+
product-short: 'Astra'
14+
astra-db: 'Astra DB'
15+
astra-ui: 'Astra Portal'
16+
astra-url: 'https://astra.datastax.com'
17+
astra-ui-link: '{astra-url}[{astra-ui}^]'
1218
pulsar: 'Apache Pulsar'
1319
pulsar-short: 'Pulsar'
1420
pulsar-reg: 'Apache Pulsar(TM)'
1521
pulsar-version: '2.10' #DO NOT INCLUDE PATCH VERSION <MAJOR>.<MINOR>.<PATCH>
1622
debezium-version: '1.7'
1723
astra-streaming-examples-repo: 'https://raw.githubusercontent.com/datastax/astra-streaming-examples/master'
24+
kafka-for-astra: 'Starlight for Kafka'
25+
starlight-rabbitmq: 'Starlight for RabbitMQ'
1826
cass: Apache Cassandra
1927
cass-short: Cassandra
20-
cass-reg: Apache Cassandra(R)
28+
cass-reg: Apache Cassandra(R)
29+
support-url: 'https://support.datastax.com'

modules/ROOT/pages/index.adoc

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -45,20 +45,20 @@ xref:streaming-learning:use-cases-architectures:starlight/jms/index.adoc[Get sta
4545
****
4646

4747
[sidebar.landing-card]
48-
.xref:streaming-learning:use-cases-architectures:starlight/kafka/index.adoc[Starlight for Kafka]
48+
.xref:streaming-learning:use-cases-architectures:starlight/kafka/index.adoc[{kafka-for-astra}]
4949
****
5050
--
51-
Starlight for Kafka brings native {pulsar} protocol support by introducing a Kafka protocol handler on {pulsar-short} brokers.
51+
{kafka-for-astra} brings native {pulsar} protocol support by introducing a Kafka protocol handler on {pulsar-short} brokers.
5252
5353
xref:streaming-learning:use-cases-architectures:starlight/kafka/index.adoc[Get started now] | xref:starlight-for-kafka:ROOT:index.adoc[Configuring] | https://github.com/datastax/starlight-for-kafka[Source Code]
5454
--
5555
****
5656

5757
[sidebar.landing-card]
58-
.xref:streaming-learning:use-cases-architectures:starlight/rabbitmq/index.adoc[Starlight for RabbitMQ]
58+
.xref:streaming-learning:use-cases-architectures:starlight/rabbitmq/index.adoc[{starlight-rabbitmq}]
5959
****
6060
--
61-
Starlight for RabbitMQ combines the AMQP 0.9.1 API with {pulsar-short}, providing a powerful way to modernize your RabbitMQ infrastructure, improve performance, and reduce costs.
61+
{starlight-rabbitmq} combines the AMQP 0.9.1 API with {pulsar-short}, providing a powerful way to modernize your RabbitMQ infrastructure, improve performance, and reduce costs.
6262
6363
xref:streaming-learning:use-cases-architectures:starlight/rabbitmq/index.adoc[Get started now] | xref:starlight-for-rabbitmq:ROOT:index.adoc[Configuring] | https://github.com/datastax/starlight-for-rabbitmq[Source Code]
6464
--

modules/functions/pages/astream-functions.adoc

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,7 @@ The command below assumes you've properly configured the client.conf file for pu
115115
bin/pulsar-admin functions create --function-config-file </absolute/path/to/your/python/func-create-config.yml>
116116
----
117117

118-
. Check results: Go to the {astra_ui} to see your newly deployed function listed under the “Functions” tab for your Tenant. See <<controlling-your-function,Controlling your function>> for more information on testing and monitoring your function in {product}.
118+
. Check results: Go to the {astra-ui} to see your newly deployed function listed under the “Functions” tab for your Tenant. See <<controlling-your-function,Controlling your function>> for more information on testing and monitoring your function in {product}.
119119

120120
.. You can also use the pulsar-admin command to list your functions:
121121
+
@@ -249,7 +249,7 @@ userConfig:
249249
+
250250
[NOTE]
251251
====
252-
{product} requires the “inputs” topic to have a message schema defined before deploying the function. Otherwise, deployment errors may occur. Use the {astra_ui} to define the message schema for a topic.
252+
{product} requires the “inputs” topic to have a message schema defined before deploying the function. Otherwise, deployment errors may occur. Use the {astra-ui} to define the message schema for a topic.
253253
====
254254
+
255255
. Use pulsar-admin to deploy your new JAR to {product} or {pulsar-short}.
@@ -260,7 +260,7 @@ The command below assumes you've properly configured the client.conf file for pu
260260
bin/pulsar-admin functions create --function-config-file </absolute/path/to/your/javajar/func-create-config.yml>
261261
----
262262

263-
. Check results: Go to the {astra_ui} to see your newly deployed function listed under the “Functions” tab for your Tenant. See <<controlling-your-function,Controlling your function>> for more information on testing and monitoring your function in {product}.
263+
. Check results: Go to the {astra-ui} to see your newly deployed function listed under the “Functions” tab for your Tenant. See <<controlling-your-function,Controlling your function>> for more information on testing and monitoring your function in {product}.
264264

265265
.. You can also use the pulsar-admin command to list your functions:
266266
+
@@ -280,7 +280,7 @@ image::astream-name-function.png[Function and Namespace]
280280

281281
. Select the file you want to pull the function from and which function you want to use within that file.
282282

283-
Astra generates a list of acceptable classes. Python and Java functions are added a little differently from each other.
283+
{product} generates a list of acceptable classes. Python and Java functions are added a little differently from each other.
284284

285285
Python functions are added by loading a Python file (.py) or a zipped Python file (.zip). When adding Python files, the Class Name is specified as the name of the Python file without the extension plus the class you want to execute.
286286

modules/functions/pages/deploy-in-sink.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ Now, functions can be deployed at sink creation and apply preprocessing to sink
88

99
== Create sink function in {product}
1010

11-
Creating a sink function is similar to creating a sink in the {astra_ui}, but with a few additional steps.
11+
Creating a sink function is similar to creating a sink in the {astra-ui}, but with a few additional steps.
1212

1313
. xref:pulsar-io:connectors/index.adoc[Create a sink] as described in the {product} documentation.
1414
. During sink creation, select the transform function you want to run inside the sink.

modules/functions/partials/deploy-as.adoc

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
1-
Deploy transform functions in the *Functions* tab of the {astra_ui}.
1+
Deploy transform functions in the *Functions* tab of the {astra-ui}.
22

3-
The process is similar to xref:astra-streaming:developing:astream-functions.adoc[creating a function in the {astra_ui}], but with a few additional steps.
3+
The process is similar to xref:astra-streaming:developing:astream-functions.adoc[creating a function in the {astra-ui}], but with a few additional steps.
44

55
. After naming your new function, select the *Use {company} transform function* option.
66
. Select a transform function from the list of available functions:

modules/pulsar-io/pages/connectors/index.adoc

Lines changed: 16 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ include::partial$connectors/sources/source-connectors.adoc[tag=production]
2828

2929
{company} is always experimenting with connectors. Below are the connectors currently in development that have not yet been promoted to official support in *{product}*.
3030

31-
To get access to these connectors, contact {support_url}[{company} Support].
31+
To get access to these connectors, contact {support-url}[{company} Support].
3232

3333
=== Sink Connectors (experimental)
3434

@@ -57,22 +57,32 @@ Assuming you have downloaded client.conf to the {pulsar-short} folder:
5757
----
5858
--
5959
60-
cURL::
60+
curl::
6161
+
6262
--
63+
// tag::rest-env-vars[]
64+
You need a {pulsar-short} token for REST API authentication.
65+
This is different from your {astra-db} application tokens.
66+
67+
. In the {astra-ui-link}, go to *Streaming*, click your tenant's name, and then click the *Settings* tab.
6368
64-
You'll need to create an {product} API token to be used with the Rest API. This is different from your Astra tokens.
69+
. Click *Create Token*.
6570
66-
Navigate to the "Settings" area in the {product} UI and choose "Create Token".
71+
. Copy the token, store it securely, and then click *Close*.
6772
68-
Retrieve the web service URL from the "Connect" tab in the {product} UI.
73+
. Click the *Connect* tab, and then copy the *Web Service URL*.
6974
75+
. Create environment variables for your tenant's token and web service URL:
76+
+
7077
[source,shell,subs="attributes+"]
7178
----
7279
export WEB_SERVICE_URL=<replace-me>
7380
export ASTRA_STREAMING_TOKEN=<replace-me>
7481
----
82+
// end::rest-env-vars[]
7583
84+
. Use these values to form curl commands to the REST API:
85+
+
7686
[source,shell,subs="attributes+"]
7787
----
7888
curl "$WEB_SERVICE_URL/admin/v3/sinks/builtinsinks" -H "Authorization: $ASTRA_STREAMING_TOKEN"
@@ -100,18 +110,7 @@ Assuming you have downloaded client.conf to the {pulsar-short} folder:
100110
cURL::
101111
+
102112
--
103-
104-
You'll need to create an {product} API token to be used with the Rest API. This is different from your Astra tokens.
105-
106-
Navigate to the "Settings" area in the {product} UI and choose "Create Token".
107-
108-
Retrieve the web service URL from the "Connect" tab in the {product} UI.
109-
110-
[source,shell,subs="attributes+"]
111-
----
112-
export WEB_SERVICE_URL=<replace-me>
113-
export ASTRA_STREAMING_TOKEN=<replace-me>
114-
----
113+
include::pulsar-io:connectors/index.adoc[tag=rest-env-vars]
115114
116115
[source,shell,subs="attributes+"]
117116
----

modules/pulsar-io/pages/connectors/sinks/astra-db.adoc

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,11 +1,11 @@
1-
= {astra_db} ({cass-reg} enhanced)
1+
= {astra-db} ({cass-reg} enhanced)
22
:connectorName: astra-db-sink
33
:connectorType: astra-db
44
:page-tag: astra-db,cdc,sink-connector
55

6-
{company} {astra_db} Sink Connector is based on the open-source https://docs.datastax.com/en/pulsar-connector/docs/index.html[{cass-reg} sink connector for {pulsar-reg}]. Depending on how you deploy the connector, it can be used to sink topic messages with a table in {astra_db} or a table in a {cass-short} cluster outside of DB.
6+
{company} {astra-db} Sink Connector is based on the open-source https://docs.datastax.com/en/pulsar-connector/docs/index.html[{cass-reg} sink connector for {pulsar-reg}]. Depending on how you deploy the connector, it can be used to sink topic messages with a table in {astra-db} or a table in a {cass-short} cluster outside of DB.
77

8-
The {product} portal provides simple way to connect this sink and a table in Astra DB with simply a token. Using pulsar-admin or the REST API, you can configure the sink to connect with a {cass-short} connection manually.
8+
The {product} portal provides simple way to connect this sink and a table in {astra-db} with simply a token. Using pulsar-admin or the REST API, you can configure the sink to connect with a {cass-short} connection manually.
99

1010
This reference assumes you are manually connecting to a {cass-short} table.
1111

@@ -51,7 +51,7 @@ include::example$connectors/sinks/{connectorType}/config.csv[]
5151
// TODO: Need descriptions of every param
5252
=== Auth Properties
5353

54-
These values are provided in the *auth* area in the above cassandra connection parameters.
54+
These values are provided in the *auth* area in the above {cass-short} connection parameters.
5555

5656
[%header,format=csv,cols="2,1,1,3"]
5757
|===
@@ -60,7 +60,7 @@ include::example$connectors/sinks/{connectorType}/auth.csv[]
6060

6161
=== Topic Properties
6262

63-
These values are provided in the *topic* area in the above cassandra connection parameters.
63+
These values are provided in the *topic* area in the above {cass-short} connection parameters.
6464

6565
Refer to the official documentation for a https://docs.datastax.com/en/pulsar-connector/docs/cfgRefPulsarDseConnection.html[connection properties reference].
6666

modules/pulsar-io/partials/connectors/sinks/curl-tab.adoc

Lines changed: 11 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,17 +1,24 @@
11
// tag::curl-prereq[]
2-
You'll need to create an {product} API token to be used with the REST API. This is different from your Astra tokens.
2+
You need a {pulsar-short} token for REST API authentication.
3+
This is different from your {astra-db} application tokens.
34

4-
Navigate to the "Settings" area in the {product} UI and choose "Create Token".
5+
. In the {astra-ui-link}, go to *Streaming*, click your tenant's name, and then click the *Settings* tab.
56

6-
Retrieve the web service URL from the "Connect" tab in the {product} UI.
7+
. Click *Create Token*.
78

8-
Refer to the complete https://pulsar.apache.org/sink-rest-api/#tag/sink[{pulsar-short} sinks REST API spec] for all available options.
9+
. Copy the token, store it securely, and then click *Close*.
10+
11+
. Click the *Connect* tab, and then copy the *Web Service URL*.
912

13+
. Create environment variables for your tenant's token and web service URL:
14+
+
1015
[source,shell,subs="attributes+"]
1116
----
1217
export WEB_SERVICE_URL=<replace-me>
1318
export ASTRA_STREAMING_TOKEN=<replace-me>
1419
----
20+
+
21+
Refer to the complete https://pulsar.apache.org/sink-rest-api/#tag/sink[{pulsar-short} sinks REST API spec] for all available options.
1522
// end::curl-prereq[]
1623
// tag::curl-start[]
1724
[source,shell,subs="attributes+"]

modules/pulsar-io/partials/connectors/sources/curl-tab.adoc

Lines changed: 12 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,25 @@
11
// tag::curl-prereq[]
2-
You'll need to create an {product} API token to be used with the REST API. This is different from your Astra tokens.
2+
You need a {pulsar-short} token for REST API authentication.
3+
This is different from your {astra-db} application tokens.
34

4-
Navigate to the "Settings" area in the {product} UI and choose "Create Token".
5+
. In the {astra-ui-link}, go to *Streaming*, click your tenant's name, and then click the *Settings* tab.
56

6-
Retrieve the web service URL from the "Connect" tab in the {product} UI.
7+
. Click *Create Token*.
78

8-
Refer to the complete https://pulsar.apache.org/source-rest-api/#tag/sources[{pulsar-short} sources REST API spec],
9-
for all available options.
9+
. Copy the token, store it securely, and then click *Close*.
10+
11+
. Click the *Connect* tab, and then copy the *Web Service URL*.
1012

13+
. Create environment variables for your tenant's token and web service URL:
14+
+
1115
[source,shell,subs="attributes+"]
1216
----
1317
export WEB_SERVICE_URL=<replace-me>
1418
export ASTRA_STREAMING_TOKEN=<replace-me>
1519
----
20+
+
21+
Refer to the complete https://pulsar.apache.org/source-rest-api/#tag/sources[{pulsar-short} sources REST API spec],
22+
for all available options.
1623
// end::curl-prereq[]
1724
// tag::curl-start[]
1825
[source,shell,subs="attributes+"]

modules/pulsar-io/partials/connectors/sources/monitoring.adoc

Lines changed: 23 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -16,19 +16,27 @@ include::example$connectors/sources/pulsar-admin-info.sh[]
1616
cURL::
1717
+
1818
--
19+
You need a {pulsar-short} token for REST API authentication.
20+
This is different from your {astra-db} application tokens.
1921
20-
You'll need to create an {product} API token to be used with the REST API. This is different from your Astra tokens.
22+
. In the {astra-ui-link}, go to *Streaming*, click your tenant's name, and then click the *Settings* tab.
2123
22-
Navigate to the "Settings" area in the {product} UI and choose "Create Token".
24+
. Click *Create Token*.
2325
24-
Retrieve the web service URL from the "Connect" tab in the {product} UI.
26+
. Copy the token, store it securely, and then click *Close*.
2527
28+
. Click the *Connect* tab, and then copy the *Web Service URL*.
29+
30+
. Create environment variables for your tenant's token and web service URL:
31+
+
2632
[source,shell,subs="attributes+"]
2733
----
2834
export WEB_SERVICE_URL=<replace-me>
2935
export ASTRA_STREAMING_TOKEN=<replace-me>
3036
----
3137
38+
. Use these values to form curl commands to the REST API:
39+
+
3240
[source,shell,subs="attributes+"]
3341
----
3442
include::example$connectors/sources/curl-info.sh[]
@@ -60,25 +68,33 @@ include::example$connectors/sources/pulsar-admin-status.sh[]
6068
cURL::
6169
+
6270
--
71+
You need a {pulsar-short} token for REST API authentication.
72+
This is different from your {astra-db} application tokens.
73+
74+
. In the {astra-ui-link}, go to *Streaming*, click your tenant's name, and then click the *Settings* tab.
6375
64-
You'll need to create an {product} API token to be used with the REST API. This is different from your Astra tokens.
76+
. Click *Create Token*.
6577
66-
Navigate to the "Settings" area in the {product} UI and choose "Create Token".
78+
. Copy the token, store it securely, and then click *Close*.
6779
68-
Retrieve the web service URL from the "Connect" tab in the {product} UI.
80+
. Click the *Connect* tab, and then copy the *Web Service URL*.
6981
82+
. Create environment variables for your tenant's token and web service URL:
83+
+
7084
[source,shell,subs="attributes+"]
7185
----
7286
export WEB_SERVICE_URL=<replace-me>
7387
export ASTRA_STREAMING_TOKEN=<replace-me>
7488
----
7589
90+
. Use these values to form curl commands to the REST API:
91+
+
7692
[source,shell,subs="attributes+"]
7793
----
7894
include::example$connectors/sources/curl-status.sh[]
7995
----
8096
--
81-
97+
+
8298
Response::
8399
+
84100
--

0 commit comments

Comments
 (0)