Skip to content

Commit d3ba769

Browse files
kouJonahkel
authored andcommitted
apacheGH-48612: [Ruby] Add support for reading streaming format (apache#48613)
### Rationale for this change It's a streaming variant of IPC format. ### What changes are included in this PR? * Add `ArrowFormat::MessagePullReader` * Add `ArrowFormat::StreamingPullReader` * Add `ArrowFormat::StreamingReader` * Extract read schema and record batch features as `ArrowFormat::Readable` and reuse it in `ArrowFormat::StreamingPullParser` and `ArrowFormat::FileReader` ### Are these changes tested? Yes. We should add more error case tests later. ### Are there any user-facing changes? Yes. * GitHub Issue: apache#48612 Authored-by: Sutou Kouhei <kou@clear-code.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
1 parent d12020e commit d3ba769

File tree

8 files changed

+1449
-1047
lines changed

8 files changed

+1449
-1047
lines changed

ruby/red-arrow-format/lib/arrow-format.rb

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -16,4 +16,5 @@
1616
# under the License.
1717

1818
require_relative "arrow-format/file-reader"
19+
require_relative "arrow-format/streaming-reader"
1920
require_relative "arrow-format/version"

ruby/red-arrow-format/lib/arrow-format/error.rb

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,9 @@ class Error < StandardError
1919
end
2020

2121
class ReadError < Error
22+
end
23+
24+
class FileReadError < ReadError
2225
attr_reader :buffer
2326
def initialize(buffer, message)
2427
@buffer = buffer

0 commit comments

Comments
 (0)