You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/content/docs/pipelines/observability/metrics.mdx
+40-7Lines changed: 40 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,15 +6,48 @@ sidebar:
6
6
7
7
---
8
8
9
-
Pipelines metrics are split across three different nodes under `viewer` > `accounts`. Refer to [Explore the GraphQL schema](/analytics/graphql-api/getting-started/explore-graphql-schema/) to learn how to navigate a GraphQL schema and discover which data are available.
9
+
Pipelines expose metrics which allow you to measure data ingested, requests made, and data delivered, across all your Pipelines.
10
10
11
-
To learn more about the GraphQL Analytics API, refer to [GraphQL Analytics API](/analytics/graphql-api/).
11
+
The metrics displayed in the [Cloudflare dashboard](https://dash.cloudflare.com/) are queried from Cloudflare’s [GraphQL Analytics API](/analytics/graphql-api/). You can access the metrics [programmatically](#query-via-the-graphql-api) via GraphQL or HTTP client.
12
12
13
-
You can use the GraphQL API to measure metrics for data ingested, as well as data delivered.
13
+
## Metrics
14
+
### Ingestion
15
+
Pipelines export the below metrics within the `pipelinesIngestionAdaptiveGroups` dataset.
| Ingestion Events |`count`| Number of delivery events to an R2 bucket |
36
+
| Delivered Bytes |`deliveredBytes`| Total number of bytes ingested |
37
+
38
+
The `pipelinesDeliverynAdaptiveGroups` dataset provides the following dimensions for filtering and grouping queries:
39
+
*`pipelineId` - ID of the pipeline
40
+
*`datetime` - Timestamp of the delivery event
41
+
*`date` - Timestamp of the delivery event, truncated to the start of a day
42
+
*`datetimeHour` - Timestamp of the delivery event, truncated to the start of an hour
43
+
*`datetimeMinute` - Timestamp of the delivery event, truncated to the start of a minute
44
+
45
+
46
+
## Query via the GraphQL API
47
+
48
+
You can programmatically query analytics for your Workflows via the [GraphQL Analytics API](/analytics/graphql-api/). This API queries the same datasets as the Cloudflare dashboard, and supports GraphQL [introspection](/analytics/graphql-api/features/discovery/introspection/).
49
+
50
+
Pipelines GraphQL datasets require an `accountTag` filter, with your Cloudflare account ID.
18
51
19
52
### Measure total bytes & records ingested over time period
- Number of pipeline shards. More shards handle higher request volume; fewer shards produce larger output files. Defaults to 2. Must be between 1 and 15.
2050
2058
2051
2059
### `update`
2052
2060
@@ -2056,24 +2064,43 @@ Update an existing pipeline
- Number of pipeline shards. More shards handle higher request volume; fewer shards produce larger output files. Defaults to 2. Must be between 1 and 15.
0 commit comments