@@ -3,13 +3,13 @@ title: Iceberg Catalog
33---
44import FunctionDescription from '@site/src /components/FunctionDescription';
55
6- <FunctionDescription description =" ๅผๅ
ฅๆๆดๆฐ: v1.2.668" />
6+ <FunctionDescription description =" ๅผๅ
ฅๆๆดๆฐไบ๏ผ v1.2.668" />
77
8- Databend ๆฏๆ้ๆ [ Apache Iceberg] ( https://iceberg.apache.org/ ) ็ฎๅฝ๏ผๅขๅผบไบๅ
ถๆฐๆฎ็ฎก็ๅๅๆ็ๅ
ผๅฎนๆงๅๅคๅ่ฝๆงใ่ฟ้่ฟๆ ็ผๆดๅ Apache Iceberg ๅผบๅคง็ๅ
ๆฐๆฎๅๅญๅจ็ฎก็่ฝๅ ๏ผๆฉๅฑไบ Databend ็ๅ่ฝใ
8+ Databend ๆฏๆ้ๆ [ Apache Iceberg] ( https://iceberg.apache.org/ ) ็ฎๅฝ๏ผๅขๅผบไบๅ
ถๅจๆฐๆฎ็ฎก็ๅๅๆๆน้ข็ๅ
ผๅฎนๆงๅๅคๅ่ฝๆงใ่ฟ้่ฟๅฐ Apache Iceberg ๅผบๅคง็ๅ
ๆฐๆฎๅๅญๅจ็ฎก็่ฝๅๆ ็ผ้ๆๅฐๅนณๅฐไธญ ๏ผๆฉๅฑไบ Databend ็ๅ่ฝใ
99
1010## ๆฐๆฎ็ฑปๅๆ ๅฐ
1111
12- ไธ่กจๅฑ็คบไบ Apache Iceberg ๅ Databend ไน้ด็ๆฐๆฎ็ฑปๅๆ ๅฐใ่ฏทๆณจๆ๏ผDatabend ็ฎๅไธๆฏๆ่กจไธญๆชๅๅบ็ Iceberg ๆฐๆฎ็ฑปๅใ
12+ ไธ่กจๅๅบไบ Apache Iceberg ๅ Databend ไน้ด็ๆฐๆฎ็ฑปๅๆ ๅฐใ่ฏทๆณจๆ๏ผDatabend ็ฎๅไธๆฏๆ่กจไธญๆชๅๅบ็ Iceberg ๆฐๆฎ็ฑปๅใ
1313
1414| Apache Iceberg | Databend |
1515| ------------------------------- | ----------------------- |
@@ -44,25 +44,29 @@ Databend ๆไพไบไปฅไธๅฝไปคๆฅ็ฎก็็ฎๅฝ๏ผ
4444
4545``` sql
4646CREATE CATALOG < catalog_name>
47- TYPE = < catalog_type>
48- CONNECTION = (
49- METASTORE_ADDRESS = ' <hive_metastore_address>'
50- URL = ' <data_storage_path>'
51- < connection_parameter> = ' <connection_parameter_value>'
52- < connection_parameter> = ' <connection_parameter_value>'
47+ TYPE= ICEBERG
48+ CONNECTION= (
49+ TYPE= ' <connection_type>'
50+ ADDRESS= ' <address>'
51+ WAREHOUSE= ' <warehouse_location>'
52+ " <connection_parameter>" = ' <connection_parameter_value>'
53+ " <connection_parameter>" = ' <connection_parameter_value>'
5354 ...
54- )
55+ );
5556```
5657
57- | ๅๆฐ | ๆฏๅฆๅฟ
้ | ๆ่ฟฐ |
58- | -----------------------| -----------| ---------------------------------------------------------------------------------------------------------------------------|
59- | TYPE | ๆฏ | ็ฎๅฝ็ฑปๅ๏ผ'HIVE' ่กจ็คบ Hive ็ฎๅฝ๏ผ'ICEBERG' ่กจ็คบ Iceberg ็ฎๅฝใ |
60- | METASTORE_ADDRESS | ๅฆ | Hive Metastore ๅฐๅใไป
ๅฏน Hive ็ฎๅฝๅฟ
้ใ|
61- | URL | ๆฏ | ไธๆญค็ฎๅฝๅ
ณ่็ๅค้จๅญๅจไฝ็ฝฎใ่ฟๅฏไปฅๆฏๆกถๆๆกถๅ
็ๆไปถๅคนใไพๅฆ๏ผ's3://databend-toronto/'ใ |
62- | connection_parameter | ๆฏ | ็จไบไธๅค้จๅญๅจๅปบ็ซ่ฟๆฅ็่ฟๆฅๅๆฐใๆ้็ๅๆฐๅ ็นๅฎ็ๅญๅจๆๅกๅ่ฎค่ฏๆนๆณ่ๅผใ่ฏทๅ้
[ ่ฟๆฅๅๆฐ] ( /sql/sql-reference/connect-parameters ) ่ทๅ่ฏฆ็ปไฟกๆฏใ |
58+ | ๅๆฐ | ๆฏๅฆๅฟ
ๅกซ | ๆ่ฟฐ |
59+ | ------------------------------| -----------| -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
60+ | ` <catalog_name> ` | ๆฏ | ่ฆๅๅปบ็ catalog ๅ็งฐใ |
61+ | ` TYPE ` | ๆฏ | ๆๅฎ catalog ็ฑปๅใๅฏนไบ Iceberg๏ผ่ฎพ็ฝฎไธบ ` ICEBERG ` ใ |
62+ | ` CONNECTION ` | ๆฏ | Iceberg catalog ็่ฟๆฅๅๆฐใ |
63+ | ` TYPE ` (ๅจ ` CONNECTION ` ๅ
) | ๆฏ | ่ฟๆฅ็ฑปๅใๅฏนไบ Iceberg๏ผ้ๅธธ่ฎพ็ฝฎไธบ ` rest ` ไปฅไฝฟ็จๅบไบ REST ็่ฟๆฅใ |
64+ | ` ADDRESS ` | ๆฏ | Iceberg ๆๅก็ๅฐๅๆ URL๏ผไพๅฆ ` http://127.0.0.1:8181 ` ๏ผใ |
65+ | ` WAREHOUSE ` | ๆฏ | Iceberg ๆฐไป็ไฝ็ฝฎ๏ผ้ๅธธๆฏไธไธช S3 ๅญๅจๆกถๆๅ
ผๅฎน็ๅฏน่ฑกๅญๅจ็ณป็ปใ |
66+ | ` <connection_parameter> ` | ๆฏ | ็จไบไธๅค้จๅญๅจๅปบ็ซ่ฟๆฅ็ๅๆฐใๆ้็ๅๆฐๆ นๆฎๅ
ทไฝ็ๅญๅจๆๅกๅ่ฎค่ฏๆนๆณ่ๆๆไธๅใๆๅ
ณ่ฏฆ็ปไฟกๆฏ๏ผ่ฏทๅ้
[ ่ฟๆฅๅๆฐ] ( /sql/sql-reference/connect-parameters ) ใๅฆๆๆจไฝฟ็จ็ๆฏ Amazon S3 ๆ S3 ๅ
ผๅฎน็ๅญๅจ็ณป็ป๏ผ่ฏท็กฎไฟๅจๅๆฐๅๅ ไธ ` s3. ` ๅ็ผ๏ผไพๅฆ ` s3.region ` ใ` s3.endpoint ` ๏ผใ |
6367
6468::: note
65- ่ฆไป HDFS ่ฏปๅๆฐๆฎ๏ผๆจ้่ฆๅจๅฏๅจ Databend ไนๅ่ฎพ็ฝฎไปฅไธ็ฏๅขๅ้ใ่ฟไบ็ฏๅขๅ้็กฎไฟ Databend ๅฏไปฅ่ฎฟ้ฎๅฟ
่ฆ็ Java ๅ Hadoop ไพ่ต้กน๏ผไปฅๆๆไธ HDFS ไบคไบใ่ฏท็กฎไฟๅฐ "/path/to/java" ๅ "/path/to/hadoop" ๆฟๆขไธบ Java ๅ Hadoop ๅฎ่ฃ
็ๅฎ้
่ทฏๅพ ๏ผๅนถ่ฐๆด CLASSPATH ไปฅๅ
ๅซๆๆๅฟ
้็ Hadoop JAR ๆไปถใ
69+ ่ฆไป HDFS ่ฏปๅๆฐๆฎ๏ผๆจ้่ฆๅจๅฏๅจ Databend ไนๅ่ฎพ็ฝฎไปฅไธ็ฏๅขๅ้ใ่ฟไบ็ฏๅขๅ้็กฎไฟ Databend ่ฝๅค่ฎฟ้ฎๅฟ
่ฆ็ Java ๅ Hadoop ไพ่ต้กน๏ผไปฅๆๆๅฐไธ HDFS ไบคไบใ่ฏท็กฎไฟๅฐ "/path/to/java" ๅ "/path/to/hadoop" ๆฟๆขไธบๅฎ้
็ Java ๅ Hadoop ๅฎ่ฃ
่ทฏๅพ ๏ผๅนถ่ฐๆด CLASSPATH ไปฅๅ
ๅซๆๆๅฟ
้็ Hadoop JAR ๆไปถใ
6670``` shell
6771export JAVA_HOME=/path/to/java
6872export LD_LIBRARY_PATH=${JAVA_HOME} /lib/server:${LD_LIBRARY_PATH}
@@ -73,7 +77,7 @@ export CLASSPATH=/all/hadoop/jar/files
7377
7478### SHOW CREATE CATALOG
7579
76- ่ฟๅๆๅฎ็ฎๅฝ็่ฏฆ็ป้
็ฝฎ ๏ผๅ
ๆฌๅ
ถ็ฑปๅๅๅญๅจๅๆฐใ
80+ ่ฟๅๆๅฎ catalog ็่ฏฆ็ป้
็ฝฎ ๏ผๅ
ๆฌๅ
ถ็ฑปๅๅๅญๅจๅๆฐใ
7781
7882#### ่ฏญๆณ
7983
@@ -83,7 +87,7 @@ SHOW CREATE CATALOG <catalog_name>;
8387
8488### SHOW CATALOGS
8589
86- ๆพ็คบๆๆๅทฒๅๅปบ็็ฎๅฝ ใ
90+ ๆพ็คบๆๆๅทฒๅๅปบ็ catalog ใ
8791
8892#### ่ฏญๆณ
8993
@@ -93,7 +97,7 @@ SHOW CATALOGS [LIKE '<pattern>']
9397
9498### USE CATALOG
9599
96- ๅฐๅฝๅไผ่ฏๅๆขๅฐๆๅฎ็็ฎๅฝ ใ
100+ ๅฐๅฝๅไผ่ฏๅๆขๅฐๆๅฎ็ catalog ใ
97101
98102#### ่ฏญๆณ
99103
@@ -103,24 +107,16 @@ USE CATALOG <catalog_name>
103107
104108## ไฝฟ็จ็คบไพ
105109
106- ๆญค็คบไพๆผ็คบไบๅๅปบไธไธช็ฎๅฝ๏ผ่ฏฅ็ฎๅฝ้
็ฝฎไธบไธไฝไบ MinIO ็ 's3://databend/iceberg/' ็ Iceberg ๆฐๆฎๅญๅจ่ฟ่กไบคไบใ
110+ ๆญค็คบไพๅฑ็คบไบๅฆไฝไฝฟ็จๅบไบ REST ็่ฟๆฅๅๅปบ Iceberg catalog๏ผๆๅฎๆๅกๅฐๅใๆฐไปไฝ็ฝฎ๏ผS3๏ผไปฅๅๅฏ้็ๅๆฐ๏ผๅฆ AWS ๅบๅๅ่ชๅฎไน็ซฏ็น๏ผ๏ผ
107111
108112``` sql
109- CREATE CATALOG iceberg_ctl
110- TYPE = ICEBERG
111- CONNECTION = (
112- URL = ' s3://databend/iceberg/ '
113- AWS_KEY_ID = ' minioadmin '
114- AWS_SECRET_KEY = ' minioadmin '
115- ENDPOINT_URL = ' http://127.0.0.1:9000 '
116- REGION = ' us-east-2 '
113+ CREATE CATALOG ctl
114+ TYPE= ICEBERG
115+ CONNECTION= (
116+ TYPE = ' rest '
117+ ADDRESS = ' http://127.0.0.1:8181 '
118+ WAREHOUSE = ' s3://iceberg-tpch '
119+ " s3.region " = ' us-east-1 '
120+ " s3.endpoint " = ' http://127.0.0.1:9000 '
117121);
118-
119- SHOW CREATE CATALOG iceberg_ctl;
120-
121- โโโโโโโโโโโโโโโฌโโโโโโโโโโฌโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
122- โ Catalog โ Type โ Option โ
123- โโโโโโโโโโโโโโโผโโโโโโโโโโผโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโค
124- โ iceberg_ctl โ iceberg โ STORAGE PARAMS s3 | bucket= databend, root= / iceberg/ , endpoint= http:// 127 .0 .0 .1 :9000 โ
125- โโโโโโโโโโโโโโโดโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
126122```
0 commit comments