v18.5.0

What's Changed

• fix(parquet/pqarrow): Fix null_count column stats by @MasslessParticle in #489
• chore: Use apache/arrow-dotnet for integration test by @kou in #495
• feat(parquet): utilize memory allocator in serializedPageReader by @joechenrh in #485
• chore: Bump actions/setup-python from 5.6.0 to 6.0.0 by @dependabot[bot] in #501
• chore: Bump actions/github-script from 7.0.1 to 8.0.0 by @dependabot[bot] in #502
• chore: Automate GitHub Releases creation and site redirect by @kou in #497
• chore: Bump actions/setup-go from 5 to 6 by @dependabot[bot] in #500
• chore: Bump github.com/stretchr/testify from 1.11.0 to 1.11.1 by @dependabot[bot] in #488
• use xnor for boolean equals function by @Dhruvit96 in #505
• chore: Bump golang.org/x/sync from 0.16.0 to 0.17.0 by @dependabot[bot] in #498
• chore: Bump golang.org/x/sys from 0.35.0 to 0.36.0 by @dependabot[bot] in #499
• chore: Bump golang.org/x/tools from 0.36.0 to 0.37.0 by @dependabot[bot] in #507
• chore(ci): fix verify_rc finding latest go by @zeroshade in #512
• feat: Add support for specifying Timestamp ValueStr output layout by @erezrokah in #510
• fix(arrow/cdata): Avoid calling unsafe.Slice on zero-length pointers by @orlp in #513
• chore: Bump google.golang.org/grpc from 1.75.0 to 1.75.1 by @dependabot[bot] in #514
• fix(arrow/compute): fix scalar comparison panic by @zeroshade in #518
• fix(arrow/array): fix panic in dictionary builders by @zeroshade in #517
• chore: Bump github.com/hamba/avro/v2 from 2.29.0 to 2.30.0 by @dependabot[bot] in #508
• chore: Bump google.golang.org/protobuf from 1.36.8 to 1.36.9 by @dependabot[bot] in #515
• fix(parquet/pqarrow): unsupported dictionary types in pqarrow by @zeroshade in #520
• chore(parquet/metadata): use constant time compare for signature verify by @zeroshade in #528
• build(deps): update substrait to v7 by @zeroshade in #526
• fix(parquet): fix adaptive bloom filter duplicate hash counting, comparison logic, and GC safety by @Mandukhai-Alimaa in #527
• chore: Bump google.golang.org/protobuf from 1.36.9 to 1.36.10 by @dependabot[bot] in #530
• refactor(arrow): last increment of the Record -> RecordBatch migration by @Mandukhai-Alimaa in #522
• chore: Bump github.com/google/flatbuffers from 25.2.10+incompatible to 25.9.23+incompatible by @dependabot[bot] in #524
• chore: Bump github.com/substrait-io/substrait-go/v7 from 7.0.0 to 7.1.0 by @dependabot[bot] in #529
• chore: Bump golang.org/x/tools from 0.37.0 to 0.38.0 by @dependabot[bot] in #537
• chore: Bump google.golang.org/grpc from 1.75.1 to 1.76.0 by @dependabot[bot] in #534
• chore: Bump github.com/pterm/pterm from 0.12.81 to 0.12.82 by @dependabot[bot] in #539
• chore: Bump github.com/klauspost/compress from 1.18.0 to 1.18.1 by @dependabot[bot] in #538
• fix: update iceberg substrait URN by @zeroshade in #541
• optimization: comparison: when DataType is static, skip reflection by @pixelherodev in #542
• chore: Bump actions/download-artifact from 5.0.0 to 6.0.0 by @dependabot[bot] in #550
• chore: Bump actions/upload-artifact from 4.6.2 to 5.0.0 by @dependabot[bot] in #549
• fix(parquet/pqarrow): decoding Parquet with Arrow dict in schema by @freakyzoidberg in #551
• feat: support conversion of chunked arrays by @ahmed-mez in #553
• format: regenerate internal/flatbuf from arrow repo and newer flatc by @pixelherodev in #555
• Batch of small optimizations by @pixelherodev in #556
• perf: optimize compute.Take for fewer memory allocations by @hamilton-earthscope in #557
• optimization: compare: avoid initializing config when it's not needed by @pixelherodev in #563
• optimization: schema: use slices.Sort instead of sort.Slice by @pixelherodev in #564
• doc(parquet): document arrow parquet mappings by @amoeba in #561
• fix: Metadata.Equal comparison with keys in different order by @zeroshade in #571
• perf(compute): optimize Take kernel for list types by @hamilton-earthscope in #573
• chore: Bump golang.org/x/sync from 0.17.0 to 0.18.0 by @dependabot[bot] in #567
• chore: Bump golang.org/x/sys from 0.37.0 to 0.38.0 by @dependabot[bot] in #568
• build: add pqarrow_read_only build tags to avoid building write related code by @jacobromero in #569
• chore: Bump actions/checkout from 5.0.0 to 5.0.1 by @dependabot[bot] in #577
• chore: Bump golang.org/x/tools from 0.38.0 to 0.39.0 by @dependabot[bot] in #576
• [Go] [Parquet] pqarrow file-writer & row-group-writer tracking total & total compressed bytes by @DuanWeiFan in #548
• [Go][Parquet] Fix FixedSizeList nullable elements read as NULL by @rmorgans in #585
• [Go][Parquet] Refactor: extract visitListLike helper for list-like types by @rmorgans in #586
• chore: Bump google.golang.org/grpc from 1.76.0 to 1.77.0 by @dependabot[bot] in #580
• chore: Bump github.com/substrait-io/substrait-go/v7 from 7.1.0 to 7.2.0 by @dependabot[bot] in #579
• feat(compute): Take kernel for Map type by @hamilton-earthscope in #574
• chore: Bump actions/checkout from 5.0.1 to 6.0.0 by @dependabot[bot] in #582
• chore: Bump actions/setup-go from 6.0.0 to 6.1.0 by @dependabot[bot] in #581
• fix: correctly initialize SchemaField.ColIndex by @JamesGuthrie in #591
• chore: Bump actions/checkout from 5.0.1 to 6.0.0 by @dependabot[bot] in #590
• chore: Bump actions/setup-python from 6.0.0 to 6.1.0 by @dependabot[bot] in #589
• chore: Bump github.com/klauspost/compress from 1.18.1 to 1.18.2 by @dependabot[bot] in #588
• fix(arrow/array): fix concat for out of order REE slices by @zeroshade in #587
• new(arrow/compute): temporal rounding methods by @hamilton-earthscope in #572
• chore(arrow): Bump package version to 18.5.0 by @zeroshade in #594
• perf(parquet): minor tweaks for iceberg write improvement by @hamilton-earthscope in #595
• fix(arrow/cdata): fix leaks identified by leak-sanitizer by @zeroshade in #603
• chore: Bump golang.org/x/sys from 0.38.0 to 0.39.0 by @dependabot[bot] in #600
• chore: Bump actions/checkout from 6.0.0 to 6.0.1 by @dependabot[bot] in #598
• chore: Bump golang.org/x/sync from 0.18.0 to 0.19.0 by @dependabot[bot] in #599

New Contributors

• @Dhruvit96 made their first contribution in #505
• @erezrokah made their first contribution in #510
• @orlp made their first contribution in #513
• @pixelherodev made their first contribution in #542
• @freakyzoidberg made their first contribution in #551
• @ahmed-mez made their first contribution in #553
• @hamilton-earthscope made their first contribution in #557
• @jacobromero made their first contribution in #569
• @DuanWeiFan made their first contribution in #548
• @rmorgans made their first contribution in #585
• @JamesGuthrie made their first contribution in #591

Full Changelog: https://github.com/apache/arrow-go/compar...

Apache Arrow Go v18.5.0-rc1

18.5.0 RC1

Apache Arrow Go v18.5.0-rc0

18.5.0 RC0

v18.4.1

What's Changed

• fix(arrow/compute/exprs): Handle large types in expr handling by @zeroshade in #440
• chore: Bump github.com/klauspost/cpuid/v2 from 2.2.11 to 2.3.0 by @dependabot[bot] in #444
• chore: Bump golang.org/x/sync from 0.15.0 to 0.16.0 by @dependabot[bot] in #443
• chore: Bump golang.org/x/sys from 0.33.0 to 0.34.0 by @dependabot[bot] in #442
• fix(arrow/compute/exprs): fix literalToDatum for precision types by @zeroshade in #447
• chore: Bump golang.org/x/tools from 0.34.0 to 0.35.0 by @dependabot[bot] in #441
• fix(arrow/array): Fix RecordFromJSON perf by @zeroshade in #449
• fix(arrow/array): update timestamp json format by @zeroshade in #450
• refactor: switch golang.org/x/exp to standard library packages by @ufUNnxagpM in #453
• chore: Bump google.golang.org/grpc from 1.73.0 to 1.74.2 by @dependabot[bot] in #458
• fix(parquet/pqarrow): supress io.EOF in RecordReader.Err() by @ryanschneider in #452
• chore: Bump github.com/substrait-io/substrait-go/v4 from 4.3.0 to 4.4.0 by @dependabot[bot] in #459
• fix(array): add nil checks in Data.Release() for childData by @secfree in #456
• fix(arrow/compute): Fix scalar comparison batches by @zeroshade in #465
• chore: Bump actions/checkout from 4 to 5 by @dependabot[bot] in #471
• chore: Bump golang.org/x/tools from 0.35.0 to 0.36.0 by @dependabot[bot] in #467
• chore: Bump actions/download-artifact from 4.3.0 to 5.0.0 by @dependabot[bot] in #468
• chore: Bump google.golang.org/protobuf from 1.36.6 to 1.36.7 by @dependabot[bot] in #469
• refactor(arrow): rename Record to RecordBatch and add deprecated alias by @Mandukhai-Alimaa in #466
• refactor(arrow): migrate leaf packages to use RecordBatch by @Mandukhai-Alimaa in #473
• refactor(arrow): third increment of the Record -> RecordBatch migration by @Mandukhai-Alimaa in #478
• chore: Bump github.com/go-viper/mapstructure/v2 from 2.3.0 to 2.4.0 by @dependabot[bot] in #480
• ci(parquet/pqarrow): integration tests for reading shredded variants by @zeroshade in #455
• chore: Bump google.golang.org/grpc from 1.74.2 to 1.75.0 by @dependabot[bot] in #483
• chore: Bump github.com/stretchr/testify from 1.10.0 to 1.11.0 by @dependabot[bot] in #482
• Implement RLE dictionary decoder using generics by @daniel-adam-tfs in #477
• chore: Bump google.golang.org/protobuf from 1.36.7 to 1.36.8 by @dependabot[bot] in #481
• fix(parquet/internal/encoding): Fix typed dictionary encoding by @MasslessParticle in #479
• refactor(arrow): fourth increment of the Record -> RecordBatch migration by @Mandukhai-Alimaa in #486
• chore: bump version number by @zeroshade in #487

New Contributors

• @ufUNnxagpM made their first contribution in #453
• @ryanschneider made their first contribution in #452
• @secfree made their first contribution in #456
• @Mandukhai-Alimaa made their first contribution in #466
• @daniel-adam-tfs made their first contribution in #477

Full Changelog: v18.4.0...v18.4.1

Apache Arrow Go v18.4.1-rc0

18.4.1 RC0

v18.4.0

What's Changed

• feat(arrow/cdata): Add ReleaseCArrowArrayStream function by @karsov in #373
• chore: Bump golang.org/x/sync from 0.13.0 to 0.14.0 by @dependabot[bot] in #368
• fix: TestDeltaByteArray implementation and fix by @MetalBlueberry in #369
• chore: Bump golang.org/x/tools from 0.32.0 to 0.33.0 by @dependabot[bot] in #376
• chore: Bump actions/setup-go from 5.4.0 to 5.5.0 by @dependabot[bot] in #377
• chore: move .github/ISSUE_TEMPLATE/config.yaml to config.yml as currently does not work by @raulcd in #383
• chore: Bump google.golang.org/grpc from 1.72.0 to 1.72.1 by @dependabot[bot] in #381
• fix: list_columns.parquet testing by @MetalBlueberry in #378
• feat: Extend arrow csv writter by @MetalBlueberry in #375
• feat(parquet/pqarrow): parallelize SeekToRow by @zeroshade in #380
• chore: Use apache/arrow-js for JS in integration test by @kou in #389
• chore: Bump github.com/apache/thrift from 0.21.0 to 0.22.0 by @dependabot[bot] in #387
• feat(parquet): add variant encoder/decoder by @sfc-gh-mbojanczyk in #344
• chore: remove extra binary by @zeroshade in #391
• CI: add benchmark workflow and script by @singh1203 in #250
• chore: Bump actions/setup-python from 4 to 5 by @dependabot[bot] in #396
• feat(arrow/extensions): Add Variant extension type, array, and builder by @zeroshade in #395
• fix(parquet/pqarrow): Fix propagation of field-ids for Lists by @zeroshade in #397
• feat(arrow/_examples): enhance library examples by @kris-gaudel in #394
• chore: bump Windows GitHub hosted runner to windows-2022 by @raulcd in #407
• chore: Bump golang.org/x/tools from 0.33.0 to 0.34.0 by @dependabot[bot] in #398
• chore: Bump golang.org/x/sync from 0.14.0 to 0.15.0 by @dependabot[bot] in #400
• chore: Bump github.com/pterm/pterm from 0.12.80 to 0.12.81 by @dependabot[bot] in #402
• chore: Bump google.golang.org/grpc from 1.72.1 to 1.73.0 by @dependabot[bot] in #401
• ci(benchmark): Fix benchmark runs by @zeroshade in #409
• ci: fix flaky test by @zeroshade in #411
• ci: make additional checks to prevent flaky EOF by @zeroshade in #414
• refactor: update linter and run it by @zeroshade in #419
• chore: Bump github.com/stoewer/go-strcase from 1.3.0 to 1.3.1 by @dependabot[bot] in #423
• chore: Bump github.com/hamba/avro/v2 from 2.28.0 to 2.29.0 by @dependabot[bot] in #422
• feat: expose Payload.WritePayload to allow serializing into IPC format by @alvarowolfx in #421
• feat(parquet/variant): Parse JSON into variant by @zeroshade in #426
• chore: Bump github.com/go-viper/mapstructure/v2 from 2.2.1 to 2.3.0 by @dependabot[bot] in #427
• refactor(parquet/internal/encoding): Refactor parquet logic to use generics by @zeroshade in #428
• feat(arrrow/compute/expr): support substrait timestamp and decimal properly by @zeroshade in #418
• chore: Bump github.com/klauspost/cpuid/v2 from 2.2.10 to 2.2.11 by @dependabot[bot] in #431
• chore: Bump github.com/andybalholm/brotli from 1.1.1 to 1.2.0 by @dependabot[bot] in #432
• feat(parquet/examples): enhance library examples by @milden6 in #429
• feat(arrow/compute): support some float16 casts by @zeroshade in #430
• feat(parquet/pqarrow): Correctly handle Variant types in schema by @zeroshade in #433
• fix(arrow/avro-reader): bunch of types that didn't work by @Willem-J-an in #416
• feat(parquet/pqarrow): read/write variant by @zeroshade in #434
• build(deps): update to substrait-go v4.3.0 by @zeroshade in #438
• fix(arrow/flight/flightsql): drain channel in flightSqlServer.DoGet by @arnoldwakim in #437
• chore(arrow): Update PkgVersion by @zeroshade in #439

New Contributors

• @karsov made their first contribution in #373
• @MetalBlueberry made their first contribution in #369
• @sfc-gh-mbojanczyk made their first contribution in #344
• @kris-gaudel made their first contribution in #394
• @alvarowolfx made their first contribution in #421
• @milden6 made their first contribution in #429
• @Willem-J-an made their first contribution in #416
• @arnoldwakim made their first contribution in #437

Full Changelog: v18.3.0...v18.4.0

Apache Arrow Go v18.4.0-rc0

18.4.0 RC0

v18.3.1

What's Changed

• feat(arrow/cdata): Add ReleaseCArrowArrayStream function by @karsov in #373
• chore: Bump golang.org/x/sync from 0.13.0 to 0.14.0 by @dependabot in #368
• fix: TestDeltaByteArray implementation and fix by @MetalBlueberry in #369
• chore: Bump golang.org/x/tools from 0.32.0 to 0.33.0 by @dependabot in #376
• chore: Bump actions/setup-go from 5.4.0 to 5.5.0 by @dependabot in #377
• chore: move .github/ISSUE_TEMPLATE/config.yaml to config.yml as currently does not work by @raulcd in #383
• chore: Bump google.golang.org/grpc from 1.72.0 to 1.72.1 by @dependabot in #381
• fix: list_columns.parquet testing by @MetalBlueberry in #378

New Contributors

• @karsov made their first contribution in #373

Full Changelog: v18.3.0...v18.3.1

Apache Arrow Go v18.3.1-rc0

18.3.1 RC0

v18.3.0

What's Changed

• chore: Bump golang.org/x/sync from 0.11.0 to 0.12.0 by @dependabot in #308
• chore: Bump golang.org/x/net from 0.35.0 to 0.36.0 by @dependabot in #313
• feat(arrow/array): convert RecordReader and iterators by @zeroshade in #314
• refactor(arrow/array): replace some codegen with generics by @zeroshade in #315
• chore: Bump golang.org/x/tools from 0.30.0 to 0.31.0 by @dependabot in #317
• chore: Bump github.com/golang/snappy from 0.0.4 to 1.0.0 by @dependabot in #316
• feat(parquet/pqarrow): Add SeekToRow for RecordReader by @zeroshade in #321
• fix: go's atomic operations require 64bit alignment in structs on ARM by @sahib in #323
• feat(arrow/compute): implement "is_in" function by @zeroshade in #319
• fix(parquet/pqarrow): fix propagation of FieldIds for nested fields by @zeroshade in #324
• Fix: Handle null values in PlainFixedLenByteArrayEncoder gracefully by @singh1203 in #320
• fix(parquet/pqarrow): fix definition levels with non-nullable lists by @zeroshade in #325
• chore: Bump actions/upload-artifact from 4.6.1 to 4.6.2 by @dependabot in #331
• chore: Bump actions/setup-go from 5.3.0 to 5.4.0 by @dependabot in #332
• chore: Bump actions/download-artifact from 4.1.9 to 4.2.1 by @dependabot in #333
• chore: fix macOS Go 1.24 CI by @lidavidm in #334
• chore: Bump gonum.org/v1/gonum from 0.15.1 to 0.16.0 by @dependabot in #328
• chore: Bump google.golang.org/protobuf from 1.36.5 to 1.36.6 by @dependabot in #330
• chore: Bump actions/setup-python from 5.4.0 to 5.5.0 by @dependabot in #338
• feat(parquet/metadata): bloom filter implementation by @zeroshade in #336
• feat(parquet): Write/Read bloom filters from files by @zeroshade in #341
• fix: move from atomic.(Add|Load|Store) to atomic.Int64{} by @sahib in #326
• chore: Bump golang.org/x/sync from 0.12.0 to 0.13.0 by @dependabot in #347
• fix(parquet/file): restore goroutine safety for reader by @zeroshade in #343
• chore: Bump google.golang.org/grpc from 1.71.0 to 1.71.1 by @dependabot in #346
• chore: Bump golang.org/x/sys from 0.31.0 to 0.32.0 by @dependabot in #345
• chore: Enable GitHub discussions on arrow-go repository by @raulcd in #353
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.9.0 to 3.9.1 by @dependabot in #355
• chore: Bump golang.org/x/tools from 0.31.0 to 0.32.0 by @dependabot in #356
• Compress: add MarshalText and UnmarshalText by @jdemeyer in #357
• chore: Bump google.golang.org/grpc from 1.71.1 to 1.72.0 by @dependabot in #358
• fix(arrow/array): optional struct array with required field by @zeroshade in #359
• feat(parquet/schema): initial variant logical type by @zeroshade in #352
• chore: Bump actions/setup-python from 5.5.0 to 5.6.0 by @dependabot in #363
• chore: Bump actions/download-artifact from 4.2.1 to 4.3.0 by @dependabot in #364
• chore(arrow): remove most lock copies by @zeroshade in #362
• Fix panic when WriteDataPage fails by @ashishnegi in #366
• GH-46087: [FlightSQL] Allow returning column remarks in FlightSQL's CommandGetTables by @mateuszrzeszutek in #361
• chore: Bump golang.org/x/sys from 0.32.0 to 0.33.0 by @dependabot in #367

New Contributors

• @sahib made their first contribution in #323
• @jdemeyer made their first contribution in #357
• @ashishnegi made their first contribution in #366
• @mateuszrzeszutek made their first contribution in #361

Full Changelog: v18.2.0...v18.3.0