Skip to content
This repository was archived by the owner on Mar 27, 2024. It is now read-only.

Commit e472131

Browse files
author
Hong
authored
Update documentation for OAP 1.3.1 (#246)
1 parent cf6d0bb commit e472131

File tree

2 files changed

+8
-12
lines changed

2 files changed

+8
-12
lines changed

docs/Gazelle_on_Dataproc.md

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -23,9 +23,7 @@ To create a new cluster with initialization actions, follow the steps below:
2323

2424
1). Click the **CREATE CLUSTER** to create and custom your cluster.
2525

26-
2). **Set up cluster:** choose cluster type and Dataproc image version `2.0-centos8`, enable component gateway, and add Jupyter Notebook, ZooKeeper.
27-
28-
![Enable_component_gateway](../integrations/oap/dataproc/imgs/component_gateway.png)
26+
2). **Set up cluster:** choose cluster type and Dataproc image version ***2.0***, enable component gateway, and add Jupyter Notebook, ZooKeeper.
2927

3028
3). **Configure nodes:** choose the instance type and other configurations of nodes;
3129

@@ -53,9 +51,9 @@ spark.executor.extraLibraryPath /opt/benchmark-tools/oap/lib
5351
spark.executorEnv.CC /opt/benchmark-tools/oap/bin/gcc
5452
spark.executorEnv.LD_PRELOAD /usr/lib64/libjemalloc.so
5553
56-
spark.files /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar,/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar
57-
spark.driver.extraClassPath /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar
58-
spark.executor.extraClassPath /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar
54+
spark.files /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar,/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar,/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-spark311-1.3.1.jar,/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-common-1.3.1.jar
55+
spark.driver.extraClassPath /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-spark311-1.3.1.jar:/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-common-1.3.1.jar
56+
spark.executor.extraClassPath /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-spark311-1.3.1.jar:/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-common-1.3.1.jar
5957
spark.executor.instances 8
6058
spark.executor.cores 8
6159
spark.executor.memory 8g

integrations/oap/dataproc/benchmark/Gazelle_on_Dataproc.md

Lines changed: 4 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -21,9 +21,7 @@ To create a new cluster with initialization actions, follow the steps below:
2121

2222
1). Click the **CREATE CLUSTER** to create and custom your cluster.
2323

24-
2). **Set up cluster:** choose cluster type and Dataproc image version `2.0-centos8`, enable component gateway, and add Jupyter Notebook, ZooKeeper.
25-
26-
![Enable_component_gateway](../imgs/component_gateway.png)
24+
2). **Set up cluster:** choose cluster type and Dataproc image version ***2.0***, enable **Component Gateway**, and add Jupyter Notebook, ZooKeeper.
2725

2826
3). **Configure nodes:** choose the instance type and other configurations of nodes.
2927

@@ -108,9 +106,9 @@ spark.executor.extraLibraryPath /opt/benchmark-tools/oap/lib
108106
spark.executorEnv.CC /opt/benchmark-tools/oap/bin/gcc
109107
spark.executorEnv.LD_PRELOAD /usr/lib64/libjemalloc.so
110108
111-
spark.files /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar,/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar
112-
spark.driver.extraClassPath /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar
113-
spark.executor.extraClassPath /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar
109+
spark.files /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar,/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar,/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-spark311-1.3.1.jar,/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-common-1.3.1.jar
110+
spark.driver.extraClassPath /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-spark311-1.3.1.jar:/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-common-1.3.1.jar
111+
spark.executor.extraClassPath /opt/benchmark-tools/oap/oap_jars/spark-columnar-core-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-arrow-datasource-standard-1.3.1-jar-with-dependencies.jar:/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-spark311-1.3.1.jar:/opt/benchmark-tools/oap/oap_jars/spark-sql-columnar-shims-common-1.3.1.jar
114112
spark.executor.instances 8
115113
spark.executor.cores 8
116114
spark.executor.memory 8g

0 commit comments

Comments
 (0)