This repository was archived by the owner on Sep 27, 2019. It is now read-only.

Support COPY for CSV files#1371

Merged

apavlo merged 42 commits intocmu-db:masterfrom

pmenon:csv

Jun 8, 2018

Commits on Jun 6, 2018

Add more information to CopyStatement. Cleaned up includes.
pmenon
committed
Add CSVScan node to ToString and FromString. Removed BINARY external format for now.
pmenon
committed
Move COPY from DDL to DML processing. COPY now goes through planner/optimization.
pmenon
committed
Propagate external file information
pmenon
committed
Removed unused serialization stuff from plan nodes
pmenon
committed
Codegen can now have constant generic/opaque bytes in module
pmenon
committed
When no columns specified during copy, all columns are inserted
pmenon
committed
Added function to throw expception with ill-formatted input string when converting to number
pmenon
committed
Removed serialization
pmenon
committed
Added input functions in prepartion to read table data from files
pmenon
committed
All SQL types must now provide an input function to convert a string into a SQL type
pmenon
committed
Added test for value integrity
pmenon
committed
First take at CSV Scan translator
pmenon
committed
Fix after rebase
pmenon
committed
file api
pmenon
committed
CSV scanner reads lines
pmenon
committed
Process CSV line in scanner
pmenon
committed
Free memory when re-allocating line buffer
pmenon
committed
Added memcmp to codegen interface. Renamed CallPrintf() to Printf().
pmenon
committed
Cleaned up CSV scan translator. Added null checking.
pmenon
committed
Moved TupleRuntime::CreateVarlen() into ValuesRuntime::WriteVarlen(). Better code organization and clearer name.
pmenon
committed
Added error handling for long columns. Added null-terminator byte for when read-buffers are copied to line-buffers.
pmenon
committed
Added inputs for decimal types
pmenon
committed
Moved type-specific functions into function namespace
pmenon
committed
REALLY simple Date support
pmenon
committed
Compile fixes for GCC 6+
pmenon
committed
Get string inputs working
pmenon
committed
Beefed up tests
pmenon
committed
Simple CSV scan test
pmenon
committed
Updated optimize to continue support for old/weird/strange AF copy executor
pmenon
committed
Extracted implementation into CPP file for plan node
pmenon
committed
* Propagatge file options through optimization.
pmenon
committed
Fixes after rebase
pmenon
committed
Simple function to convert tuple to string CSV
pmenon
committed
Fix void* -> i8* conversion
pmenon
committed
More tests
pmenon
committed
Address reviews
pmenon
committed
Revert "Removed serialization"
pmenon
committed
Revert "Removed unused serialization stuff from plan nodes"
pmenon
committed
Beefed up tests, which caught more bugs
pmenon
committed
Fix tests
pmenon
committed
Reducing copying overhead for columns, constraints and loop variables during CheckConstraints(). We were spending 50% of our time here during bulk insertions into wide tables due to unnecessary cop…
pmenon
committed

Support COPY for CSV files#1371apavlo merged 42 commits intocmu-db:mastercmu-db/peloton:masterfrom pmenon:csvpmenon/peloton-1:csvCopy head branch name to clipboard

Commits

Commits on Jun 6, 2018

Support COPY for CSV files#1371
apavlo merged 42 commits intocmu-db:masterfrom
pmenon:csv