Skip to content

Commit db6dc33

Browse files
author
flow-php
committed
1 parent d7f669c commit db6dc33

16 files changed

+338
-1387
lines changed

‎changelog/index.html‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -222,6 +222,7 @@ <h2 class="my-2 text-2xl font-semibold tracking-wide">Loads</h2>
222222
<h2><a id="flow-php-unreleased---2025-07-13" href="#content-unreleased---2025-07-13" class="mr-2" aria-hidden="true" title="Permalink">#</a>[Unreleased] - 2025-07-13</h2>
223223
<h3><a id="flow-php-added" href="#content-added" class="mr-2" aria-hidden="true" title="Permalink">#</a>Added</h3>
224224
<ul>
225+
<li><a rel="noopener noreferrer" target="_blank" href="https://github.com/flow-php/flow/pull/1765">#1765</a> - <strong>Allow to chose encoding for parquet columns</strong> - <a rel="noopener noreferrer" target="_blank" href="https://github.com/norberttech">@norberttech</a></li>
225226
<li><a rel="noopener noreferrer" target="_blank" href="https://github.com/flow-php/flow/pull/1764">#1764</a> - <strong>Support for Delta Binary Packed encoding in Parquet</strong> - <a rel="noopener noreferrer" target="_blank" href="https://github.com/norberttech">@norberttech</a></li>
226227
<li><a rel="noopener noreferrer" target="_blank" href="https://github.com/flow-php/flow/pull/1760">#1760</a> - <strong>OpenAPI Specification Bridge</strong> - <a rel="noopener noreferrer" target="_blank" href="https://github.com/norberttech">@norberttech</a></li>
227228
</ul>

‎documentation/api/lib/parquet/classes/Flow-Parquet-Option.html‎

Lines changed: 64 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -150,6 +150,13 @@ <h4 id="toc-cases">
150150
</dt>
151151
<dd>Some parquet writers might not properly use LogicalTyp for storing Strings or JSON&#039;s.</dd>
152152

153+
<dt class="phpdocumentor-table-of-contents__entry -case -">
154+
<a class="" href="classes/Flow-Parquet-Option.html#enumcase_COLUMNS_COMPRESSIONS">COLUMNS_COMPRESSIONS</a>
155+
<span>
156+
</span>
157+
</dt>
158+
<dd>Per-column compression configuration using flat path notation.</dd>
159+
153160
<dt class="phpdocumentor-table-of-contents__entry -case -">
154161
<a class="" href="classes/Flow-Parquet-Option.html#enumcase_COLUMNS_ENCODINGS">COLUMNS_ENCODINGS</a>
155162
<span>
@@ -330,6 +337,45 @@ <h4 class="phpdocumentor-element__name" id="enumcase_BYTE_ARRAY_TO_STRING">
330337

331338

332339

340+
</article>
341+
<article
342+
class="
343+
phpdocumentor-element
344+
-enum-case
345+
"
346+
>
347+
<h4 class="phpdocumentor-element__name" id="enumcase_COLUMNS_COMPRESSIONS">
348+
COLUMNS_COMPRESSIONS
349+
<a href="classes/Flow-Parquet-Option.html#enumcase_COLUMNS_COMPRESSIONS" class="headerlink"><i class="fas fa-link"></i></a>
350+
351+
</h4>
352+
<aside class="phpdocumentor-element-found-in">
353+
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
354+
:
355+
<span class="phpdocumentor-element-found-in__line">38</span>
356+
357+
</aside>
358+
359+
<p class="phpdocumentor-summary">Per-column compression configuration using flat path notation.</p>
360+
361+
362+
<section class="phpdocumentor-description"><p>Accepts array&lt;string, Compressions&gt; where key is column flat path and value is compression enum.</p>
363+
<p>Flat path examples:</p>
364+
<ul>
365+
<li>Simple columns: 'column_name'</li>
366+
<li>Nested structs: 'user.address.street'</li>
367+
<li>List elements: 'items.list.element'</li>
368+
<li>Map keys/values: 'metadata.key_value.key', 'metadata.key_value.value'</li>
369+
</ul>
370+
<p>Values must be Compressions enum instances.</p>
371+
<p>Default: null (use global compression setting)</p>
372+
</section>
373+
374+
375+
376+
377+
378+
333379
</article>
334380
<article
335381
class="
@@ -345,22 +391,22 @@ <h4 class="phpdocumentor-element__name" id="enumcase_COLUMNS_ENCODINGS">
345391
<aside class="phpdocumentor-element-found-in">
346392
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
347393
:
348-
<span class="phpdocumentor-element-found-in__line">38</span>
394+
<span class="phpdocumentor-element-found-in__line">54</span>
349395

350396
</aside>
351397

352398
<p class="phpdocumentor-summary">Per-column encoding configuration using flat path notation.</p>
353399

354400

355-
<section class="phpdocumentor-description"><p>Accepts array&lt;string, string&gt; where key is column flat path and value is encoding name.</p>
401+
<section class="phpdocumentor-description"><p>Accepts array&lt;string, Encodings&gt; where key is column flat path and value is encoding enum.</p>
356402
<p>Flat path examples:</p>
357403
<ul>
358404
<li>Simple columns: 'column_name'</li>
359405
<li>Nested structs: 'user.address.street'</li>
360406
<li>List elements: 'items.list.element'</li>
361407
<li>Map keys/values: 'metadata.key_value.key', 'metadata.key_value.value'</li>
362408
</ul>
363-
<p>Supported encodings: PLAIN, RLE_DICTIONARY, DELTA_BINARY_PACKED</p>
409+
<p>Values must be Encodings enum instances.</p>
364410
<p>Default: null (use automatic encoding selection)</p>
365411
</section>
366412

@@ -384,7 +430,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_DICTIONARY_PAGE_MIN_CARDINA
384430
<aside class="phpdocumentor-element-found-in">
385431
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
386432
:
387-
<span class="phpdocumentor-element-found-in__line">48</span>
433+
<span class="phpdocumentor-element-found-in__line">64</span>
388434

389435
</aside>
390436

@@ -417,7 +463,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_DICTIONARY_PAGE_SIZE">
417463
<aside class="phpdocumentor-element-found-in">
418464
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
419465
:
420-
<span class="phpdocumentor-element-found-in__line">55</span>
466+
<span class="phpdocumentor-element-found-in__line">71</span>
421467

422468
</aside>
423469

@@ -447,7 +493,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_GZIP_COMPRESSION_LEVEL">
447493
<aside class="phpdocumentor-element-found-in">
448494
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
449495
:
450-
<span class="phpdocumentor-element-found-in__line">63</span>
496+
<span class="phpdocumentor-element-found-in__line">79</span>
451497

452498
</aside>
453499

@@ -478,7 +524,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_INT_96_AS_DATETIME">
478524
<aside class="phpdocumentor-element-found-in">
479525
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
480526
:
481-
<span class="phpdocumentor-element-found-in__line">77</span>
527+
<span class="phpdocumentor-element-found-in__line">93</span>
482528

483529
</aside>
484530

@@ -514,7 +560,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_LZ4_COMPRESSION_LEVEL">
514560
<aside class="phpdocumentor-element-found-in">
515561
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
516562
:
517-
<span class="phpdocumentor-element-found-in__line">85</span>
563+
<span class="phpdocumentor-element-found-in__line">101</span>
518564

519565
</aside>
520566

@@ -545,7 +591,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_PAGE_MAXIMUM_ROWS_COUNT">
545591
<aside class="phpdocumentor-element-found-in">
546592
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
547593
:
548-
<span class="phpdocumentor-element-found-in__line">93</span>
594+
<span class="phpdocumentor-element-found-in__line">109</span>
549595

550596
</aside>
551597

@@ -576,7 +622,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_PAGE_SIZE_BYTES">
576622
<aside class="phpdocumentor-element-found-in">
577623
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
578624
:
579-
<span class="phpdocumentor-element-found-in__line">104</span>
625+
<span class="phpdocumentor-element-found-in__line">120</span>
580626

581627
</aside>
582628

@@ -609,7 +655,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_PAGE_SIZE_CHECK_INTERVAL">
609655
<aside class="phpdocumentor-element-found-in">
610656
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
611657
:
612-
<span class="phpdocumentor-element-found-in__line">113</span>
658+
<span class="phpdocumentor-element-found-in__line">129</span>
613659

614660
</aside>
615661

@@ -641,7 +687,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_ROUND_NANOSECONDS">
641687
<aside class="phpdocumentor-element-found-in">
642688
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
643689
:
644-
<span class="phpdocumentor-element-found-in__line">121</span>
690+
<span class="phpdocumentor-element-found-in__line">137</span>
645691

646692
</aside>
647693

@@ -672,7 +718,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_ROW_GROUP_SIZE_BYTES">
672718
<aside class="phpdocumentor-element-found-in">
673719
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
674720
:
675-
<span class="phpdocumentor-element-found-in__line">132</span>
721+
<span class="phpdocumentor-element-found-in__line">148</span>
676722

677723
</aside>
678724

@@ -705,7 +751,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_ROW_GROUP_SIZE_CHECK_INTERV
705751
<aside class="phpdocumentor-element-found-in">
706752
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
707753
:
708-
<span class="phpdocumentor-element-found-in__line">141</span>
754+
<span class="phpdocumentor-element-found-in__line">157</span>
709755

710756
</aside>
711757

@@ -737,7 +783,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_VALIDATE_DATA">
737783
<aside class="phpdocumentor-element-found-in">
738784
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
739785
:
740-
<span class="phpdocumentor-element-found-in__line">147</span>
786+
<span class="phpdocumentor-element-found-in__line">163</span>
741787

742788
</aside>
743789

@@ -767,7 +813,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_WRITER_VERSION">
767813
<aside class="phpdocumentor-element-found-in">
768814
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
769815
:
770-
<span class="phpdocumentor-element-found-in__line">157</span>
816+
<span class="phpdocumentor-element-found-in__line">173</span>
771817

772818
</aside>
773819

@@ -802,7 +848,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_ZSTD_COMPRESSION_LEVEL">
802848
<aside class="phpdocumentor-element-found-in">
803849
<abbr class="phpdocumentor-element-found-in__file" title="src/lib/parquet/src/Flow/Parquet/Option.php"><a href="files/src-lib-parquet-src-flow-parquet-option.html"><abbr title="src/lib/parquet/src/Flow/Parquet/Option.php">Option.php</abbr></a></abbr>
804850
:
805-
<span class="phpdocumentor-element-found-in__line">165</span>
851+
<span class="phpdocumentor-element-found-in__line">181</span>
806852

807853
</aside>
808854

@@ -933,6 +979,7 @@ <h4 class="phpdocumentor-element__name" id="enumcase_ZSTD_COMPRESSION_LEVEL">
933979
<ul class="phpdocumentor-list -clean">
934980
<li class=""><a href="classes/Flow-Parquet-Option.html#enumcase_BROTLI_COMPRESSION_LEVEL">BROTLI_COMPRESSION_LEVEL</a></li>
935981
<li class=""><a href="classes/Flow-Parquet-Option.html#enumcase_BYTE_ARRAY_TO_STRING">BYTE_ARRAY_TO_STRING</a></li>
982+
<li class=""><a href="classes/Flow-Parquet-Option.html#enumcase_COLUMNS_COMPRESSIONS">COLUMNS_COMPRESSIONS</a></li>
936983
<li class=""><a href="classes/Flow-Parquet-Option.html#enumcase_COLUMNS_ENCODINGS">COLUMNS_ENCODINGS</a></li>
937984
<li class=""><a href="classes/Flow-Parquet-Option.html#enumcase_DICTIONARY_PAGE_MIN_CARDINALITY_RATION">DICTIONARY_PAGE_MIN_CARDINALITY_RATION</a></li>
938985
<li class=""><a href="classes/Flow-Parquet-Option.html#enumcase_DICTIONARY_PAGE_SIZE">DICTIONARY_PAGE_SIZE</a></li>

0 commit comments

Comments
 (0)