chore: Update to arrow/parquet 59.1.0#23312
Conversation
| // add an initial FlightData message that sends schema | ||
| let options = arrow::ipc::writer::IpcWriteOptions::default(); | ||
| let mut compression_context = CompressionContext::default(); | ||
| let mut compression_context = IpcWriteContext::default(); |
There was a problem hiding this comment.
Struct was renamed (old was deprecated) in
|
|
||
| for (start, end) in valid_or_empty.set_slices() { | ||
| mutable_array_data.extend( | ||
| mutable_array_data.try_extend( |
There was a problem hiding this comment.
Required because extend and extend_null was deprecated
(basically now errors are propagated rather than causing panics)
|
things that can now progress after this arrow-rs upgrade: |
I expect the release to be finalized / approved on Monday at the earliest and then I will mark this PR ready |
|
|
Nice — this also pulls in ParquetPushDecoder::peek_next_row_group(). I'll start on #23067 (Per-RG fully_matched RowFilter skip) once this lands! |
d6e194c to
a82451a
Compare
This PR is now ready for review as arrow 59.1.0 has been released |
zhuqi-lucas
left a comment
There was a problem hiding this comment.
LGTM, thanks @alamb !
|
Thank you for the review @zhuqi-lucas |
(DRAFT until arrow is updated, I am using this PR to pre-test the release)
Which issue does this PR close?
59.1.0(June 2026) arrow-rs#9878Rationale for this change
Update to latest arrow
What changes are included in this PR?
Are these changes tested?
Yes by CI
Are there any user-facing changes?
No API change (this is a minor update of Arrow)