Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 27 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,33 @@ of [Apache Kafka Connect](https://kafka.apache.org/documentation.html#connect).
The Kafka Connect BigQuery Connector documentation is available online at https://aiven-open.github.io/bigquery-connector-for-apache-kafka/.
The site contains a complete list of the configuration options as well as information about the project.

### Configuration notes

If the configuration includes a JSON GCP credential structure that uses a `credential_source` entry, one of the following environment variables must be set.

| Source Type | Environment Variable |
|-------------|---------------------------------|
| file | io.aiven.commons.envcheck.files |
| url | io.aiven.commons.envcheck.uri |
| executable | io.aiven.commons.envcheck.cmd |

The environment variables contain a comma separated list of valid entries for each type. If the environment variable is not set, or the JSON value is not found in the environment variable, the value will be prohibited and an exception thrown before the connector starts.

As an example, to access https://example.com/credentials.cgi the environment variable `io.aiven.commons.envcheck.uri` would need to contain the URL:

```
export io.aiven.commons.envcheck.uri=https://example.com/credentials.cgi
# start the kafka processes
```

To add an additional URL, for example `https://example.net/credentials.cgi` the export would look like:

```
export io.aiven.commons.envcheck.uri=https://example.com/credentials.cgi,https://example.net/credentials.cgi
# start the kafka processes
```


## History

This connector was [originally developed by WePay](https://github.com/wepay/kafka-connect-bigquery).
Expand Down

This file was deleted.

Loading