|
1 | 1 | # Vine - Datalake Format base on Rust (WIP) |
2 | 2 |
|
3 | | -> **Status**: Work in Progress |
| 3 | +__This project is 'working in progress'__ |
4 | 4 |
|
5 | | -This project aimes 'datalake table format' optimized for `streaming data writes`, built on Rust. |
| 5 | +This project aimes 'datalake table format' optimized for `streaming data writes`. |
| 6 | +It is built on Rust, and [vortex]() |
6 | 7 |
|
7 | 8 | ## Quick Start |
8 | 9 |
|
@@ -37,23 +38,23 @@ df.show() |
37 | 38 |
|
38 | 39 | ``` |
39 | 40 | ┌─────────────────────────────────────┐ |
40 | | -│ Query Engines (Spark, Trino) │ |
| 41 | +│ Query Engines (Spark, Flink..) │ |
41 | 42 | └──────────────┬──────────────────────┘ |
42 | 43 | │ DataSource API |
43 | 44 | ┌──────────────▼──────────────────────┐ |
44 | | -│ Connectors (vine-spark/vine-trino) │ |
| 45 | +│ Connectors (vine-spark/vine-flink) │ |
45 | 46 | └──────────────┬──────────────────────┘ |
46 | 47 | │ JNI |
47 | 48 | ┌──────────────▼──────────────────────┐ |
48 | 49 | │ Rust Core (vine-core) │ |
49 | | -│ - Fast 'vortex' writes │ |
| 50 | +│ - Fast 'vortex' writes │ |
50 | 51 | │ - Date-based partitioning │ |
51 | 52 | └──────────────┬──────────────────────┘ |
52 | 53 | │ |
53 | 54 | ┌──────────────▼──────────────────────┐ |
54 | 55 | │ Storage (vortex files) │ |
55 | 56 | │ 2024-12-26/data_143025.vtx │ |
56 | | -│ 2024-12-27/data_091500.vtx │ |
| 57 | +│ 2024-12-27/data_091500.vtx │ |
57 | 58 | └─────────────────────────────────────┘ |
58 | 59 | ``` |
59 | 60 |
|
|
0 commit comments