Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I want to use ParquetObjectReader
|
ParquetObjectReader::new(store, meta.location).with_file_size(meta.size); |
to read an S3 object with a specific version. This is not possible with the ParquetObjectReader implementation today.
Describe the solution you'd like
In ParquetObjectReader, add a new version field and a new with_version method. Change the AsyncFileReader and MetadataSuffixFetch implementation to use get_opts with version if version is specified.
Describe alternatives you've considered
Alternative is to maintain a ParquetObjectReader implementation that supports object version in our implementation.
Additional context
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I want to use
ParquetObjectReaderarrow-rs/parquet/src/arrow/async_reader/store.rs
Line 258 in 2273cdc
Describe the solution you'd like
In
ParquetObjectReader, add a newversionfield and a newwith_versionmethod. Change theAsyncFileReaderandMetadataSuffixFetchimplementation to useget_optswith version if version is specified.Describe alternatives you've considered
Alternative is to maintain a
ParquetObjectReaderimplementation that supports object version in our implementation.Additional context