Cloudberry Database Roadmap 2024 #369
Replies: 10 comments 16 replies
-
|
Hi can you share what are the changes regarding compute/storage separation in the architecture and how we can dynamically increase/decrease number of segments ? |
Beta Was this translation helpful? Give feedback.
-
|
For open-source Cloudberry, it is still in MPP architecture. The Cloudberry vendor, HashData, has implemented compute/storage separation in its commercial product. I am wondering where you are seeing the information. We can update it to avoid confusing anyone. |
Beta Was this translation helpful? Give feedback.
-
|
We now support for |
Beta Was this translation helpful? Give feedback.
-
|
Iceberg, PostGIS & GUI are all very smart moves. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks @pjvldb ❤️ |
Beta Was this translation helpful? Give feedback.
-
|
Hello everyone, I'm currently working with the Cloudberry Database and I'm interested in using the pgvector extension for vector similarity searches. Before proceeding, I wanted to ask if anyone has experience with installing or using pgvector within Cloudberry Database. Is it compatible with Cloudberry, given its PostgreSQL 14.4 kernel? Are there any specific steps or considerations I should be aware of when setting it up? Any insights or guidance would be greatly appreciated. Thank you! Josef Szylar |
Beta Was this translation helpful? Give feedback.
-
|
Hi, I successfully installed pgvector extension 0.7 on Cloudberry on a 1 node system. |
Beta Was this translation helpful? Give feedback.
-
|
We have already integrated pgvector extension into Cloudberry. |
Beta Was this translation helpful? Give feedback.
-
|
Is greenplum6->cloudberry migration native support in this roadmap? |
Beta Was this translation helpful? Give feedback.
-
|
yes, thanks for your reminder. will open source one business migration tool to help users migrate from GP to Cloudberry. I can udpate this to the roadmap later. |
Beta Was this translation helpful? Give feedback.
-
|
Oh, you mean the native migration support, right? |
Beta Was this translation helpful? Give feedback.
-
I mean something similar to pg_upgrade. |
Beta Was this translation helpful? Give feedback.
-
|
It seems like we need to do some investigations on the differences in system catalogs and data table formats between GP 6 and Cloudberry. Could you help us with this, @reshke ? Once we have a clear understanding of the differences, we can discuss the implementation options in more detail. |
Beta Was this translation helpful? Give feedback.
-
Ok, i will do my best |
Beta Was this translation helpful? Give feedback.
-
|
does |
Beta Was this translation helpful? Give feedback.
-
Cloudberry keeps interface compatibility with postgres. So integration with airflow seems not hard. If you found any issues when integrating with airflow, please file issues here: https://github.com/apache/cloudberry/issues |
Beta Was this translation helpful? Give feedback.
-
|
|
Beta Was this translation helpful? Give feedback.
-
Yes, it is. |
Beta Was this translation helpful? Give feedback.
-
|
Cart |
Beta Was this translation helpful? Give feedback.
-
|
Hi everyone, since Cloudberry has joined the ASF Incubator, the new roadmap for Cloudberry is now up for discussion. We welcome your feedback: https://lists.apache.org/thread/wo1lsly8h7q8c4sxrwpw73ylbnzrcwrv. |
Beta Was this translation helpful? Give feedback.
-
|
Hello! What type of integration with Iceberg do you mean? Native, PXF, some other methods? |
Beta Was this translation helpful? Give feedback.
-
|
What do you mean by "Native"? We are working on a FDW named datalake_fdw, which will support the functionalities of access to Iceberg tables(including read and write). That FDW will be open sourced soon. That's the initial plan of integration with Iceberg in our head. On the other hand, I think another group from the OSS community is working on upgrading PXF, and integration with Iceberg maybe one of the upgrade jobs, I guess. Any idea about integration with Iceberg or Paimon tables is welcome. |
Beta Was this translation helpful? Give feedback.
-
|
We can refer to paper https://dl.acm.org/doi/pdf/10.1145/3722212.3724459 from databricks, make Iceberg as first class table like heap table that called "Native". |
Beta Was this translation helpful? Give feedback.
-
|
I found this https://www.crunchydata.com/blog/crunchy-data-warehouse-postgres-with-iceberg-for-high-performance-analytics to prove my standpoint. |
Beta Was this translation helpful? Give feedback.
-
|
Is there any update on the schedule for apache-cloudberry 2.0 full release ? |
Beta Was this translation helpful? Give feedback.
-
|
Hi @xanadu-dev, we now have two rounds for 2.0—RC1 and RC2—and we've fixed some license issues. I think we'll have an RC3 round soon (this week?). As you may know, Cloudberry, as an incubator project, will go through a two-phase vote (for the Cloudberry PPMC vote, then for the Apache Incubator vote). Regarding the schedule, I think we can not set a fixed time now, but we will speed up the process ASAP. Related links: |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Note
Hi everyone, since Cloudberry has joined the ASF Incubator, the new roadmap for Cloudberry is now up for discussion. We welcome your feedback: https://lists.apache.org/thread/wo1lsly8h7q8c4sxrwpw73ylbnzrcwrv.
This roadmap outlines the key milestones and focuses on the Cloudberry Database project in 2024. It aims to enhance functionality to strengthen further the Cloudberry Database's position as the next-gen unified open-source database for Analytics and AI.
Note
Some plans may change depending on how the Cloudberry Database evolves in reality.
Features and Enhancements
Kernel Update
Streaming
Lakehouse
AI/ML
Utilities, Tools, and Ecosystem
Release
We plan to release the Cloudberry Database at the following pace:
1.5.01.5.1/ 1.5.01.5.2/ 1.5.11.6.0 rc11.6.0 rc21.6.01.6.11.6.21.7.0 rc11.7.0 rc21.7.01.7.1In addition, we will support more CPUs and operating systems for the release packages, including Linux for x86_64/aarch64, and KylinOS for x86_64/aarch64.
Ask for feedbacks
We want to invite you to join us in shaping the future of Cloudberry Database. We'd love to hear your thoughts and ideas, so please don't hesitate to share them with us. We're committed to making our platform as open, user-friendly, and innovative as possible, and your feedback will help us achieve that goal. Thank you for your support, and we can't wait to hear from you!
Want to try it out quickly? Follow our Bootcamp program to get started with the Cloudberry Database Sandbox.
Beta Was this translation helpful? Give feedback.
All reactions