You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
After running this command, you'll be prompted to authorize Cloudflare Workers Pipelines to create R2 API tokens on your behalf. These tokens are required by your Pipeline. Your Pipeline uses the tokens when loading data into your bucket. You can approve the request through the browser link which will open automatically.
25
25
26
26
If you prefer not to authenticate this way, you may pass your [R2 API Tokens](/r2/api/s3/tokens/) to Wrangler:
After running this command, you'll be prompted to authorize Cloudflare Workers Pipelines to create R2 API tokens on your behalf. These tokens are required by your Pipeline. Your Pipeline uses the tokens when loading data into your bucket. You can approve the request through the browser link which will open automatically.
50
50
51
51
If you prefer not to authenticate this way, you may pass your [R2 API Tokens](/r2/api/s3/tokens/) to Wrangler:
@@ -60,6 +60,8 @@ When choosing a name for your Pipeline:
60
60
3. The name cannot contain special characters outside dashes (`-`).
61
61
4. The name must start and end with a letter or a number.
62
62
63
+
You'll notice that we have set two optional flags while creating the pipeline: `--batch-max-seconds` and `--compression`. We've added these flags to make it faster for you to see the output of your first Pipeline. For production use cases, we recommend keeping the default settings.
64
+
63
65
Once you create your Pipeline, you will receive a HTTP endpoint which you can post data to. You should see output as shown below:
64
66
65
67
```sh output
@@ -68,7 +70,7 @@ Once you create your Pipeline, you will receive a HTTP endpoint which you can po
68
70
✅ Successfully created pipeline [PIPELINE-NAME] with ID [PIPELINE-ID]
@@ -87,7 +89,7 @@ Pipelines handle batching the data, so you can continue posting data to the Pipe
87
89
88
90
## 4. Verify in R2
89
91
90
-
Go to the R2 bucket you created in step 1 via [the Cloudflare dashboard](https://dash.cloudflare.com/). You should see a prefix for today's date. Click through, and you will see a file created containing the JSON data you posted in step 3.
92
+
Go to the R2 bucket you created in step 1 via [the Cloudflare dashboard](https://dash.cloudflare.com/). You should see a prefix for today's date. Click through, and you will see a file created containing the JSON data you posted in step 3. You will be able to preview the file, and verify that the data you posted in step 2 is present in the file.
Ingestion URLs are tied to your Pipeline ID. Turning HTTP off, and then turning it back on, will not change the URL.
34
34
35
35
## Authentication
36
36
You can secure your HTTP ingestion endpoint using Cloudflare API tokens. By default, authentication is turned off. To enable authentication, use `--authentication true` while creating or updating a Pipeline.
0 commit comments