Skip to content
This repository was archived by the owner on Mar 27, 2022. It is now read-only.

Commit e291c9d

Browse files
committed
Set bdutil to always use latest connectors
1 parent e612ea5 commit e291c9d

File tree

2 files changed

+4
-4
lines changed

2 files changed

+4
-4
lines changed

bdutil_env.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -205,10 +205,10 @@ CORES_PER_REDUCE_TASK=1.0
205205
JAVAOPTS='-Xms1024m -Xmx2048m'
206206

207207
# Complete URL for downloading the GCS Connector JAR file.
208-
GCS_CONNECTOR_JAR='https://storage.googleapis.com/hadoop-lib/gcs/gcs-connector-1.5.3-hadoop1.jar'
208+
GCS_CONNECTOR_JAR='https://storage.googleapis.com/hadoop-lib/gcs/gcs-connector-latest-hadoop1.jar'
209209

210210
# Complete URL for downloading the BigQuery Connector JAR file.
211-
BIGQUERY_CONNECTOR_JAR='https://storage.googleapis.com/hadoop-lib/bigquery/bigquery-connector-0.7.9-hadoop1.jar'
211+
BIGQUERY_CONNECTOR_JAR='https://storage.googleapis.com/hadoop-lib/bigquery/bigquery-connector-latest-hadoop1.jar'
212212

213213
# Complete URL for downloading the configuration script.
214214
BDCONFIG='https://storage.googleapis.com/hadoop-tools/bdconfig/bdconfig-0.28.1.tar.gz'

hadoop2_env.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -44,9 +44,9 @@ CORES_PER_REDUCE_TASK=2.0
4444
CORES_PER_APP_MASTER=2.0
4545

4646
# Connector with Hadoop AbstractFileSystem implemenation for YARN
47-
GCS_CONNECTOR_JAR='https://storage.googleapis.com/hadoop-lib/gcs/gcs-connector-1.5.3-hadoop2.jar'
47+
GCS_CONNECTOR_JAR='https://storage.googleapis.com/hadoop-lib/gcs/gcs-connector-latest-hadoop2.jar'
4848

49-
BIGQUERY_CONNECTOR_JAR='https://storage.googleapis.com/hadoop-lib/bigquery/bigquery-connector-0.7.9-hadoop2.jar'
49+
BIGQUERY_CONNECTOR_JAR='https://storage.googleapis.com/hadoop-lib/bigquery/bigquery-connector-latest-hadoop2.jar'
5050

5151

5252
HDFS_DATA_DIRS_PERM='700'

0 commit comments

Comments
 (0)