You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1. Go to Google Cloud Console -> Dataflow -> [Create job from template](https://console.cloud.google.com/dataflow/createjob)
8
-
2. Choose the name and region for the Dataflow job
9
-
3. Select **Custom Template**
10
-
4. As Template path, use `betterstack/pubsub-to-betterstack.json`
11
-
5. Set parameters based on your Google Cloud Pub/Sub Subscription and [Better Stack Telemetry source](https://telemetry.betterstack.com/team/260195/sources)
12
-
6. Click **Run job**
7
+
Experience SQL-compatible structured log management based on ClickHouse. [Learn more ⇗](https://betterstack.com/telemetry)
13
8
14
-
## Running the template using CLI
9
+
## Documentation
15
10
16
-
1. Set parameters based on your Google Cloud Pub/Sub Subscription and [Better Stack Telemetry source](https://telemetry.betterstack.com/team/260195/sources)
The template supports the following optional parameters:
36
-
37
-
-`batch_size`: Number of messages to batch before sending to Better Stack. Default: 100
38
-
-`window_size`: Window size in seconds for batching messages. Default: 10
39
-
-`max_retries`: Maximum number of retry attempts for failed requests. Uses exponential backoff between retries. Default: 3
40
-
-`initial_retry_delay`: Initial delay in seconds between retries. The delay doubles with each retry attempt. Default: 1
11
+
[Getting started ⇗](https://betterstack.com/docs/logs/google-cloud-pubsub/)
41
12
42
-
You can include these parameters in your Dataflow job in Optional Parameters section during creation in UI, or by adding them to the `gcloud dataflow flex-template run` command - e.g. `--parameters window_size=5`.
0 commit comments