Expand description
Arrow and Parquet boundary helpers for AHRI_TRE workflows.
This crate treats Arrow RecordBatch values as the canonical in-memory
table representation, Parquet as the persisted dataset format, and Arrow IPC
as the binary transport format.
Modules§
- metadata_
keys - streaming
- Incremental representation writers. Each call retains only the current batch; Parquet flushes each bounded batch as a row group.
Structs§
- Ahri
TreArrow Metadata - Ahri
TreField Metadata - Annotated
Arrow Table - Arrow
IpcWrite Options - Arrow
Table - Field
- Describes a single column in a
Schema. - Field
Metadata Proposal - Json
Metadata Extraction - Parquet
Read Options - Parquet
Write Options - Record
Batch - A two-dimensional batch of column-oriented data with a defined schema.
- Schema
- Describes the meta-data of an ordered sequence of relative types.
- Vocabulary
Item Proposal
Enums§
- Arrow
IpcCompression - Data
Type - Datatypes supported by this implementation of Apache Arrow.
- Tabular
Column - Tabular
Error
Constants§
Functions§
- annotate_
arrow_ schema - annotate_
arrow_ table - columns_
to_ record_ batch - extract_
field_ metadata_ proposal - extract_
field_ metadata_ proposals - extract_
json_ field_ metadata_ proposals - extract_
json_ file_ metadata_ proposals - Scans large JSON tables without retaining rows. Only the existing metadata keys are retained, each under the fixed metadata allocation input ceiling.
- open_
ipc_ messages - Opens the bounded message region of an IPC file or stream. File footers are validated before using any untrusted footer length; batches remain streaming.
- read_
ipc_ file - read_
ipc_ schema - read_
ipc_ stream - read_
parquet_ file - read_
parquet_ file_ with_ options - read_
parquet_ schema - Reads only Parquet schema metadata, never materializes data batches.
- record_
batch_ to_ columns - write_
ipc_ file - write_
ipc_ file_ to_ writer - write_
ipc_ file_ with_ options - write_
ipc_ stream - write_
ipc_ stream_ to_ writer - write_
ipc_ stream_ with_ options - write_
parquet_ file - write_
parquet_ file_ with_ options