Skip to content

[blog]: hands on fluss lakehouse#1279

Merged
polyzos merged 3 commits intoapache:mainfrom
gyang94:blog-hands-on-lakehouse
Jul 23, 2025
Merged

[blog]: hands on fluss lakehouse#1279
polyzos merged 3 commits intoapache:mainfrom
gyang94:blog-hands-on-lakehouse

Conversation

@gyang94
Copy link
Contributor

@gyang94 gyang94 commented Jul 6, 2025

Purpose

Linked issue: close #xxx

A blog about "Hands on Fluss Lakehouse"

Brief change log

Tests

API and Format

Documentation


datalake.format: paimon
datalake.paimon.metastore: filesystem
datalake.paimon.warehouse: /tmp/fluss-paimon-data
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since our docker quick start are using local filesystem as paimon dir. Can we use minio(s3) as paimon directory to make it different. I believe this hands on will be much useful if with s3.

Copy link
Contributor

@luoyuxia luoyuxia Jul 7, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If you have any problem integrating with s3(mino), please let me know. I have some experience in integrating with paimon s3.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok, I will try.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That would be amazing and something I've been trying to find time to try out myself, so a guide would be helpful to save time.. I believe @michaelkoepf also worked on this.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

But I want to clarify that only paimon on minio(s3), not fluss on minio since currently Fluss doesn't support minio.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @luoyuxia @polyzos , updated this blog to use paimon s3 as lakehouse locally. please check.

@gyang94 gyang94 force-pushed the blog-hands-on-lakehouse branch from 2e9748a to 3779b07 Compare July 19, 2025 11:38
@polyzos
Copy link
Contributor

polyzos commented Jul 23, 2025

@gyang94 Thanks for putting this together 🚀

@polyzos polyzos merged commit 5c4225e into apache:main Jul 23, 2025
2 checks passed
polyzos added a commit to polyzos/fluss that referenced this pull request Aug 30, 2025
* [blog]: hands on fluss lakehouse

* feat: hands on fluss lakehouse with paimon s3

* make a few adjustments

---------

Co-authored-by: ipolyzos <ipolyzos.se@gmail.com>
polyzos added a commit to Alibaba-HZY/fluss that referenced this pull request Aug 31, 2025
* [blog]: hands on fluss lakehouse

* feat: hands on fluss lakehouse with paimon s3

* make a few adjustments

---------

Co-authored-by: ipolyzos <ipolyzos.se@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants