Skip to content

Commit fc47cdb

Browse files
Remove page aliases; fix page headers
1 parent d1fca81 commit fc47cdb

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

43 files changed

+72
-224
lines changed

modules/ROOT/pages/index.adoc

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,4 @@
11
= DataStax Streaming Learning
2-
:blank: {empty}
32

43
The learning site is a collection of guides and articles about DataStax streaming products. Each product has its own area dedicated to providing specifics to get started, its features, and other details. The learning site helps you get the most out of each product and get to production using best practices.
54

modules/functions/pages/astream-functions.adoc

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,5 @@
11
= Apache Pulsar Functions
2-
32
:page-tag: astra-streaming,dev,develop,pulsar,java,python
4-
:page-aliases: docs@astra-streaming::astream-functions.adoc
53

64
Functions are lightweight compute processes that enable you to process each message received on a topic. You can apply custom logic to that message, transforming or enriching it, and then output it to a different topic.
75

modules/functions/pages/cast.adoc

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,7 @@
1+
= Cast
12
:functionName: cast
2-
:attribute-missing: skip
3-
:slug: cast-transform-function
43
:page-tag: cast, transform-function
54

6-
= Cast
7-
85
The cast transform function transforms the data to a target compatible schema.
96

107
The `step` name is `cast`, and the `UserConfig` is controlled here: `{"steps": [{"type": "cast", "schema-type": "STRING"}]}`.

modules/functions/pages/compute.adoc

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,7 @@
1+
= Compute
12
:functionName: compute
2-
:attribute-missing: skip
3-
:slug: compute-transform-function
43
:page-tag: compute, transform-function
54

6-
= Compute
7-
85
The `compute` transform function computes field values based on an `expression` evaluated at runtime. +
96
If the field already exists, it will be overwritten. +
107
The step name is `compute` and the function's `UserConfig` is controlled in this step: +

modules/functions/pages/deploy-in-sink.adoc

Lines changed: 2 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,5 @@
1-
:attribute-missing: skip
2-
:slug: cast-transform-function
3-
:page-tag: cast, transform-function
4-
51
= Deploy transform function in sink
2+
:page-tag: cast, transform-function
63

74
As of https://www.datastax.com/products/luna-streaming[Luna Streaming] version 2.10.1.6, transform functions can be deployed inside of a sink process. +
85
Before this update, functions transformed data either after it was written to a topic by a source connector, or before it was read from a topic by a sink connector. +
@@ -36,7 +33,7 @@ The function is loaded at sink creation:
3633

3734
[NOTE]
3835
====
39-
https://github.com/datastax/pulsar[Luna Streaming 2.10+] is required to deploy custom functions in Pulsar.
36+
https://github.com/datastax/pulsar[Luna Streaming 2.10+] is required to deploy custom functions in Pulsar.
4037
====
4138

4239
Create a sink connector, and include the path to the transform function and configuration at creation:

modules/functions/pages/drop-fields.adoc

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,7 @@
1+
2+
= Drop fields
13
:functionName: drop-fields
2-
:attribute-missing: skip
3-
:slug: drop-fields-transform-function
44
:page-tag: drop-fields, transform-function
5-
= Drop fields
65

76
The {functionName} transform function drops fields of structured data (Currently only AVRO is supported). +
87
The cast transform function transforms the data to a target compatible schema.
@@ -19,10 +18,10 @@ The `step` name is `drop-field`, and the `UserConfig` is controlled here: `{"ste
1918
|A comma-separated list of fields to drop.
2019

2120
|part
22-
|when used with KeyValue data, defines if the transform function is done on the `key` or on the `value`. If `null` or absent the transform function applies to both the key and the value.
21+
|when used with KeyValue data, defines if the transform function is done on the `key` or on the `value`. If `null` or absent the transform function applies to both the key and the value.
2322
|===
2423

25-
== Example
24+
== Example
2625

2726
. Produce an AVRO message with the payload: `{name: value1, password: value2}`.
2827
+

modules/functions/pages/drop.adoc

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,6 @@
1+
= Drop
12
:functionName: drop
2-
:attribute-missing: skip
3-
:slug: drop-transform-function
43
:page-tag: drop, transform-function
5-
= Drop
64

75
The {functionName} transform function drops a record from further processing. +
86
Use in conjunction with `when` to selectively drop records. +
@@ -23,7 +21,7 @@ The step name is `drop`, and the `UserConfig` is controlled here: `{"steps": [{"
2321

2422
. Produce an AVRO message with the payload: `{firstName: value1, lastName: value2}`.
2523
. The function drops records matching the `when` statement `value.firstName == value1`. +
26-
There is no output.
24+
There is no output.
2725

2826
== What's next?
2927

modules/functions/pages/flatten.adoc

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,6 @@
1+
= Flatten
12
:functionName: flatten
2-
:attribute-missing: skip
3-
:slug: flatten-transform-function
43
:page-tag: flatten, transform-function
5-
= Flatten
64

75
The {functionName} transform function converts structured, nested data into a new single-hierarchy-level structured data. +
86
The names of the new fields are built by concatenating the intermediate level field names. +
@@ -18,7 +16,7 @@ The step name is `flatten`, and the `UserConfig` is controlled here: `UserConfig
1816
|The delimiter to use when concatenating the field names (default: _)
1917

2018
|part
21-
|when used with KeyValue data, defines if the transform function is done on the `key` or on the `value`. If `null` or absent the transform function applies to both the key and the value.
19+
|when used with KeyValue data, defines if the transform function is done on the `key` or on the `value`. If `null` or absent the transform function applies to both the key and the value.
2220
|===
2321

2422
== Example

modules/functions/pages/merge-key-value.adoc

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,7 @@
1+
= Merge KeyValue
12
:functionName: merge-key-value
2-
:attribute-missing: skip
3-
:slug: merge-key-value-transform-function
43
:page-tag: merge-key-value, transform-function
54

6-
= Merge KeyValue
7-
85
The {functionName} transform function merges the fields of KeyValue records where both the key and value are structured types of the same schema type. (Currently only AVRO is supported). +
96
The step name is `merge-key-value` and the `UserConfig` is controlled here: `{"steps": [{"type": "merge-key-value"}]}`.
107

modules/functions/pages/unwrap-key-value.adoc

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,7 @@
1+
= Unwrap KeyValue
12
:functionName: unwrap-key-value
2-
:attribute-missing: skip
3-
:slug: unwrap-key-value-transform-function
43
:page-tag: unwrap-key-value, transform-function
54

6-
= Unwrap KeyValue
7-
85
If the record value is a KeyValue, the {functionName} transform function extracts the KeyValue's key or value and makes it the record value. +
96
The step name is `unwrap-key-value`, and the `UserConfig` is controlled here: `{"steps": [{"type": "unwrap-key-value"}]}`.
107

0 commit comments

Comments
 (0)