Skip to content

Commit c9edd41

Browse files
authored
Merge pull request #44 from datastax/stage
Stage
2 parents 6605ea0 + 225a2de commit c9edd41

23 files changed

+1072
-47
lines changed

antora.yml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,4 @@ asciidoc:
1111
request_feature_access_email: '[email protected]'
1212

1313
nav:
14-
- modules/pulsar-io/nav.adoc
15-
- modules/functions/nav.adoc
16-
- modules/use-cases-architectures/nav.adoc
14+
- modules/ROOT/nav.adoc

modules/ROOT/nav.adoc

Lines changed: 63 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,63 @@
1+
* Processing Data
2+
** Change Data Capture
3+
*** xref:streaming-learning:use-cases-architectures:change-data-capture/index.adoc[Overview]
4+
*** xref:streaming-learning:use-cases-architectures:change-data-capture/table-schema-evolution.adoc[Table schema evolution]
5+
*** xref:streaming-learning:use-cases-architectures:change-data-capture/consuming-change-data.adoc[Consuming change data]
6+
*** xref:streaming-learning:use-cases-architectures:change-data-capture/questions-and-patterns.adoc[Questions and patterns]
7+
8+
** xref:streaming-learning:use-cases-architectures:real-time-data-pipeline/index.adoc[Data Pipelines]
9+
10+
* Migrating to Apache Pulsar
11+
12+
** xref:streaming-learning:use-cases-architectures:starlight/kafka/index.adoc[Starlight for Kafka]
13+
** xref:streaming-learning:use-cases-architectures:starlight/rabbitmq/index.adoc[Starlight for RabbitMQ]
14+
** xref:streaming-learning:use-cases-architectures:starlight/jms/index.adoc[Starlight for JMS]
15+
16+
* APIs & References
17+
18+
** Connectors
19+
20+
*** Sources
21+
**** xref:streaming-learning:pulsar-io:connectors/sources/data-generator.adoc[]
22+
**** xref:streaming-learning:pulsar-io:connectors/sources/debezium-mongodb.adoc[]
23+
**** xref:streaming-learning:pulsar-io:connectors/sources/debezium-mysql.adoc[]
24+
**** xref:streaming-learning:pulsar-io:connectors/sources/debezium-oracle.adoc[]
25+
**** xref:streaming-learning:pulsar-io:connectors/sources/debezium-postgres.adoc[]
26+
**** xref:streaming-learning:pulsar-io:connectors/sources/debezium-sqlserver.adoc[]
27+
**** xref:streaming-learning:pulsar-io:connectors/sources/kafka.adoc[]
28+
**** xref:streaming-learning:pulsar-io:connectors/sources/kinesis.adoc[]
29+
30+
*** Sinks
31+
**** xref:streaming-learning:pulsar-io:connectors/sinks/astra-db.adoc[]
32+
**** xref:streaming-learning:pulsar-io:connectors/sinks/cloud-storage.adoc[]
33+
**** xref:streaming-learning:pulsar-io:connectors/sinks/elastic-search.adoc[]
34+
**** xref:streaming-learning:pulsar-io:connectors/sinks/google-bigquery.adoc[]
35+
**** xref:streaming-learning:pulsar-io:connectors/sinks/jdbc-postgres.adoc[]
36+
**** xref:streaming-learning:pulsar-io:connectors/sinks/jdbc-mariadb.adoc[]
37+
**** xref:streaming-learning:pulsar-io:connectors/sinks/jdbc-clickhouse.adoc[]
38+
**** xref:streaming-learning:pulsar-io:connectors/sinks/jdbc-sqllite.adoc[]
39+
**** xref:streaming-learning:pulsar-io:connectors/sinks/kafka.adoc[]
40+
**** xref:streaming-learning:pulsar-io:connectors/sinks/kinesis.adoc[]
41+
**** xref:streaming-learning:pulsar-io:connectors/sinks/snowflake.adoc[]
42+
43+
** xref:streaming-learning:functions:astream-functions.adoc[Pulsar Functions]
44+
45+
** Transformation Functions
46+
47+
*** xref:streaming-learning:functions:index.adoc[Overview]
48+
*** xref:streaming-learning:functions:cast.adoc[]
49+
*** xref:streaming-learning:functions:compute.adoc[]
50+
*** xref:streaming-learning:functions:drop.adoc[]
51+
*** xref:streaming-learning:functions:flatten.adoc[]
52+
*** xref:streaming-learning:functions:merge-key-value.adoc[]
53+
*** xref:streaming-learning:functions:unwrap-key-value.adoc[]
54+
*** xref:streaming-learning:functions:deploy-in-sink.adoc[]
55+
*** xref:streaming-learning:functions:drop-fields.adoc[]
56+
57+
** Topic Subscriptions
58+
59+
*** xref:streaming-learning:subscriptions:index.adoc[Overview]
60+
*** xref:streaming-learning:subscriptions:astream-subscriptions-exclusive.adoc[Exclusive]
61+
*** xref:streaming-learning:subscriptions:astream-subscriptions-failover.adoc[Failover]
62+
*** xref:streaming-learning:subscriptions:astream-subscriptions-shared.adoc[Shared]
63+
*** xref:streaming-learning:subscriptions:astream-subscriptions-keyshared.adoc[Key Shared]

modules/ROOT/pages/index.adoc

Lines changed: 91 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,93 @@
11
= DataStax Streaming Learning
2+
:page-layout: gcx-landing
3+
:blank: {empty}
24

3-
The learning site is a collection of guides and articles about DataStax streaming products. Each product has its own area dedicated to providing specifics to get started, its features, and other details. The learning site helps you get the most out of each product and get to production using best practices.
5+
The learning site is a collection of guides and articles about DataStax streaming products. Each product has its own area dedicated to providing specifics to get started, its features, and other details. The learning site helps you get the most out of each product and get to production using best practices.
6+
7+
== Processing Data
8+
9+
++++
10+
<div class="landing-row">
11+
++++
12+
13+
[sidebar.landing-card]
14+
.xref:streaming-learning:use-cases-architectures:change-data-capture/index.adoc[Change Data Capture (CDC)]
15+
****
16+
--
17+
Change Data Capture (CDC) is a design pattern used in software development to capture and propagate changes made to data in a system. The CDC pattern is commonly used in real-time data streaming applications to enable near-real-time processing of data changes.
18+
--
19+
****
20+
21+
[sidebar.landing-card]
22+
.xref:streaming-learning:use-cases-architectures:real-time-data-pipeline/index.adoc[Real-time data pipeline]
23+
****
24+
--
25+
A real-time data pipeline is a series of steps that takes data from its original source and moves it to a destination such as a data warehouse or data lake. The pipeline is a set of steps that are executed in a specific order to transform the data and make it available for analysis.
26+
--
27+
****
28+
29+
++++
30+
</div>
31+
++++
32+
33+
== Migrating to Apache Pulsar
34+
35+
++++
36+
<div class="landing-row">
37+
++++
38+
39+
[sidebar.landing-card]
40+
.xref:streaming-learning:use-cases-architectures:starlight/jms/index.adoc[Starlight for JMS]
41+
****
42+
--
43+
Starlight for JMS allows enterprises to take advantage of the scalability and resiliency of a modern streaming platform to run their existing JMS applications.
44+
45+
xref:streaming-learning:use-cases-architectures:starlight/jms/index.adoc[Get started now] | xref:starlight-for-jms:ROOT:index.adoc[Configuring] | https://github.com/datastax/pulsar-jms[Source Code^]{external-link-icon}
46+
--
47+
****
48+
49+
[sidebar.landing-card]
50+
.xref:streaming-learning:use-cases-architectures:starlight/kafka/index.adoc[Starlight for Kafka]
51+
****
52+
--
53+
Starlight for Kafka brings native Apache Kafka® protocol support to Apache Pulsar by introducing a Kafka protocol handler on Pulsar brokers.
54+
55+
xref:streaming-learning:use-cases-architectures:starlight/kafka/index.adoc[Get started now] | xref:starlight-for-kafka:ROOT:index.adoc[Configuring] | https://github.com/datastax/starlight-for-kafka[Source Code^]{external-link-icon}
56+
--
57+
****
58+
59+
[sidebar.landing-card]
60+
.xref:streaming-learning:use-cases-architectures:starlight/rabbitmq/index.adoc[Starlight for RabbitMQ]
61+
****
62+
--
63+
Starlight for RabbitMQ combines the AMQP 0.9.1 API with Pulsar, providing a powerful way to modernize your RabbitMQ infrastructure, improve performance, and reduce costs.
64+
65+
xref:streaming-learning:use-cases-architectures:starlight/rabbitmq/index.adoc[Get started now] | xref:starlight-for-rabbitmq:ROOT:index.adoc[Configuring] | https://github.com/datastax/starlight-for-rabbitmq[Source Code^]{external-link-icon}
66+
--
67+
****
68+
69+
++++
70+
</div>
71+
++++
72+
73+
== APIs & References
74+
75+
=== Connectors
76+
77+
A connector is a function that moves data between Apache Pulsar and external systems. Source are used to push data to Pulsar from external systems such as databases, message queues, and storage systems. Sinks are used to pull data from a Pulsar topic to an external system like a database, data warehouse, or storage system. +
78+
xref:streaming-learning:pulsar-io:connectors/index.adoc#_source_connectors[Sources] | xref:streaming-learning:pulsar-io:connectors/index.adoc#_sink_connectors[Sinks] | xref:streaming-learning:pulsar-io:connectors/index.adoc#_experimental_connectors[Experimental]
79+
80+
=== Pulsar Functions
81+
82+
Functions are lightweight compute processes that enable you to process each message received on a topic. You can apply custom logic to that message, transforming or enriching it, and then output it to a different topic. +
83+
xref:streaming-learning:functions:astream-functions.adoc[Learn more]
84+
85+
=== Transformation Functions
86+
87+
Transform functions are a low-code implementation of common Pulsar functions. They are used to transform messages from one format to another. Use them to transform a message, enrich messages with additional data, or filter messages based on their content. +
88+
xref:streaming-learning:functions:cast.adoc[Cast] | xref:streaming-learning:functions:compute.adoc[Compute] | xref:streaming-learning:functions:drop.adoc[Drop] | xref:streaming-learning:functions:flatten.adoc[Flatten] | xref:streaming-learning:functions:merge-key-value.adoc[Merge] | xref:streaming-learning:functions:unwrap-key-value.adoc[Unwrap]
89+
90+
=== Topic Subscriptions
91+
92+
Subscriptions in Pulsar describe which consumers are consuming data from a topic and how they want to consume that data. +
93+
xref:streaming-learning:subscriptions:astream-subscriptions-exclusive.adoc[Exclusive] | xref:streaming-learning:subscriptions:astream-subscriptions-shared.adoc[Shared] | xref:streaming-learning:subscriptions:astream-subscriptions-failover.adoc[Failover] | xref:streaming-learning:subscriptions:astream-subscriptions-keyshared.adoc[Key Shared]
368 KB
Loading
17 KB
Loading
360 KB
Loading
6.24 KB
Loading
86.5 KB
Loading
65.7 KB
Loading
136 KB
Loading

0 commit comments

Comments
 (0)