Skip to content

Commit 71aed1e

Browse files
authored
Merge pull request #5 from kination/replace-csv-to-arrow
Replace csv to 'arrow' on JNI read/write
2 parents 80ddad8 + 428c794 commit 71aed1e

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

42 files changed

+4804
-1973
lines changed

README.md

Lines changed: 7 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,9 @@
11
# Vine - Datalake Format base on Rust (WIP)
22

3-
> **Status**: Work in Progress
3+
__This project is 'working in progress'__
44

5-
This project aimes 'datalake table format' optimized for `streaming data writes`, built on Rust.
5+
This project aimes 'datalake table format' optimized for `streaming data writes`.
6+
It is built on Rust, and [vortex]()
67

78
## Quick Start
89

@@ -37,23 +38,23 @@ df.show()
3738

3839
```
3940
┌─────────────────────────────────────┐
40-
│ Query Engines (Spark, Trino)
41+
│ Query Engines (Spark, Flink..)
4142
└──────────────┬──────────────────────┘
4243
│ DataSource API
4344
┌──────────────▼──────────────────────┐
44-
│ Connectors (vine-spark/vine-trino) │
45+
│ Connectors (vine-spark/vine-flink) │
4546
└──────────────┬──────────────────────┘
4647
│ JNI
4748
┌──────────────▼──────────────────────┐
4849
│ Rust Core (vine-core) │
49-
│ - Fast 'vortex' writes
50+
│ - Fast 'vortex' writes │
5051
│ - Date-based partitioning │
5152
└──────────────┬──────────────────────┘
5253
5354
┌──────────────▼──────────────────────┐
5455
│ Storage (vortex files) │
5556
│ 2024-12-26/data_143025.vtx │
56-
│ 2024-12-27/data_091500.vtx
57+
│ 2024-12-27/data_091500.vtx │
5758
└─────────────────────────────────────┘
5859
```
5960

0 commit comments

Comments
 (0)