You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: v2/pubsub-to-redis/README_Cloud_PubSub_to_Redis.md
+2-31Lines changed: 2 additions & 31 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,10 +6,6 @@ Pub/Sub subscription and writes the message payload to Redis. The most common us
6
6
case of this template is to export logs to Redis Enterprise for advanced
7
7
search-based log analysis in real time.
8
8
9
-
Before writing to Redis, you can apply a JavaScript user-defined function to the
10
-
message payload. Any messages that experience processing failures are forwarded
11
-
to a Pub/Sub unprocessed topic for further troubleshooting and reprocessing.
12
-
13
9
For added security, enable an SSL connection when setting up your database
14
10
endpoint connection.
15
11
@@ -37,20 +33,7 @@ on [Metadata Annotations](https://github.com/GoogleCloudPlatform/DataflowTemplat
37
33
***redisSinkType**: The Redis sink. Supported values are `STRING_SINK, HASH_SINK, STREAMS_SINK, and LOGGING_SINK`. For example, `STRING_SINK`. Defaults to: STRING_SINK.
38
34
***connectionTimeout**: The Redis connection timeout in milliseconds. For example, `2000`. Defaults to: 2000.
39
35
***ttl**: The key expiration time in seconds. The `ttl` default for `HASH_SINK` is -1, which means it never expires.
40
-
***javascriptTextTransformGcsPath**: The Cloud Storage URI of the .js file that defines the JavaScript user-defined function (UDF) to use. For example, `gs://my-bucket/my-udfs/my_file.js`.
41
-
***javascriptTextTransformFunctionName**: The name of the JavaScript user-defined function (UDF) to use. For example, if your JavaScript function code is `myTransform(inJson) { /*...do stuff...*/ }`, then the function name is `myTransform`. For sample JavaScript UDFs, see UDF Examples (https://github.com/GoogleCloudPlatform/DataflowTemplates#udf-examples).
42
-
***javascriptTextTransformReloadIntervalMinutes**: Specifies how frequently to reload the UDF, in minutes. If the value is greater than 0, Dataflow periodically checks the UDF file in Cloud Storage, and reloads the UDF if the file is modified. This parameter allows you to update the UDF while the pipeline is running, without needing to restart the job. If the value is `0`, UDF reloading is disabled. The default value is `0`.
43
-
44
-
45
-
## User-Defined functions (UDFs)
46
-
47
-
The Pub/Sub to Redis Template supports User-Defined functions (UDFs).
48
-
UDFs allow you to customize functionality by providing a JavaScript function
49
-
without having to maintain or build the entire template code.
50
36
51
-
Check [Create user-defined functions for Dataflow templates](https://cloud.google.com/dataflow/docs/guides/templates/create-template-udf)
52
-
and [Using UDFs](https://github.com/GoogleCloudPlatform/DataflowTemplates#using-udfs)
53
-
for more information about how to create and test those functions.
0 commit comments