Skip to content

Commit 8fcdc95

Browse files
Fokkoyothinix
Fokko
and
yothinix
authored
Feat/add support kerberize hivemetastore (#1634)
Took #766 and addressed the comments, to make sure that it gets into 0.9.0 --------- Co-authored-by: Yothin Muangsommuk <[email protected]>
1 parent addeb2f commit 8fcdc95

File tree

6 files changed

+645
-500
lines changed

6 files changed

+645
-500
lines changed

‎mkdocs/docs/configuration.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -417,6 +417,11 @@ catalog:
417417
s3.secret-access-key: password
418418
```
419419

420+
| Key | Example | Description |
421+
|------------------------------| ------- | --------------------------------- |
422+
| hive.hive2-compatible | true | Using Hive 2.x compatibility mode |
423+
| hive.kerberos-authentication | true | Using authentication via Kerberos |
424+
420425
When using Hive 2.x, make sure to set the compatibility flag:
421426

422427
```yaml

‎mkdocs/docs/index.md

Lines changed: 18 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -40,23 +40,24 @@ pip install "pyiceberg[s3fs,hive]"
4040

4141
You can mix and match optional dependencies depending on your needs:
4242

43-
| Key | Description: |
44-
| ------------ | ------------------------------------------------------------------------- |
45-
| hive | Support for the Hive metastore |
46-
| glue | Support for AWS Glue |
47-
| dynamodb | Support for AWS DynamoDB |
48-
| sql-postgres | Support for SQL Catalog backed by Postgresql |
49-
| sql-sqlite | Support for SQL Catalog backed by SQLite |
50-
| pyarrow | PyArrow as a FileIO implementation to interact with the object store |
51-
| pandas | Installs both PyArrow and Pandas |
52-
| duckdb | Installs both PyArrow and DuckDB |
53-
| ray | Installs PyArrow, Pandas, and Ray |
54-
| daft | Installs Daft |
55-
| s3fs | S3FS as a FileIO implementation to interact with the object store |
56-
| adlfs | ADLFS as a FileIO implementation to interact with the object store |
57-
| snappy | Support for snappy Avro compression |
58-
| gcsfs | GCSFS as a FileIO implementation to interact with the object store |
59-
| rest-sigv4 | Support for generating AWS SIGv4 authentication headers for REST Catalogs |
43+
| Key | Description: |
44+
|---------------|---------------------------------------------------------------------------|
45+
| hive | Support for the Hive metastore |
46+
| hive-kerberos | Support for Hive metastore in Kerberos environment |
47+
| glue | Support for AWS Glue |
48+
| dynamodb | Support for AWS DynamoDB |
49+
| sql-postgres | Support for SQL Catalog backed by Postgresql |
50+
| sql-sqlite | Support for SQL Catalog backed by SQLite |
51+
| pyarrow | PyArrow as a FileIO implementation to interact with the object store |
52+
| pandas | Installs both PyArrow and Pandas |
53+
| duckdb | Installs both PyArrow and DuckDB |
54+
| ray | Installs PyArrow, Pandas, and Ray |
55+
| daft | Installs Daft |
56+
| s3fs | S3FS as a FileIO implementation to interact with the object store |
57+
| adlfs | ADLFS as a FileIO implementation to interact with the object store |
58+
| snappy | Support for snappy Avro compression |
59+
| gcsfs | GCSFS as a FileIO implementation to interact with the object store |
60+
| rest-sigv4 | Support for generating AWS SIGv4 authentication headers for REST Catalogs |
6061

6162
You either need to install `s3fs`, `adlfs`, `gcsfs`, or `pyarrow` to be able to fetch files from an object store.
6263

0 commit comments

Comments
 (0)