You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
out_bigquery: add skipInvalidRows and ignoreUnknownValues params (#623)
Added BigQuery request body parameters `skipInvalidRows` and `ignoreUnknownValues` that are used for the streaming inserts. Updated these docs in sync with the changes in the main Fluent Bit repo.
Signed-off-by: zhenyami <[email protected]>
Copy file name to clipboardExpand all lines: pipeline/outputs/bigquery.md
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -40,6 +40,10 @@ Fluent Bit BigQuery output plugin uses a JSON credentials file for authenticatio
40
40
| project\_id | The project id containing the BigQuery dataset to stream into. | The value of the `project_id` in the credentials file |
41
41
| dataset\_id | The dataset id of the BigQuery dataset to write into. This dataset must exist in your project. ||
42
42
| table\_id | The table id of the BigQuery table to write into. This table must exist in the specified dataset and the schema must match the output. ||
43
+
| skip_invalid_rows | Insert all valid rows of a request, even if invalid rows exist. The default value is false, which causes the entire request to fail if any invalid rows exist. | Off |
44
+
| ignore_unknown_values | Accept rows that contain values that do not match the schema. The unknown values are ignored. Default is false, which treats unknown values as errors. | Off |
45
+
46
+
See Google's [official documentation](https://cloud.google.com/bigquery/docs/reference/rest/v2/tabledata/insertAll) for further details.
0 commit comments