Skip to main content

Crate ahri_tre_tabular

Crate ahri_tre_tabular 

Source
Expand description

Arrow and Parquet boundary helpers for AHRI_TRE workflows.

This crate treats Arrow RecordBatch values as the canonical in-memory table representation, Parquet as the persisted dataset format, and Arrow IPC as the binary transport format.

Modules§

metadata_keys
streaming
Incremental representation writers. Each call retains only the current batch; Parquet flushes each bounded batch as a row group.

Structs§

AhriTreArrowMetadata
AhriTreFieldMetadata
AnnotatedArrowTable
ArrowIpcWriteOptions
ArrowTable
Field
Describes a single column in a Schema.
FieldMetadataProposal
JsonMetadataExtraction
ParquetReadOptions
ParquetWriteOptions
RecordBatch
A two-dimensional batch of column-oriented data with a defined schema.
Schema
Describes the meta-data of an ordered sequence of relative types.
VocabularyItemProposal

Enums§

ArrowIpcCompression
DataType
Datatypes supported by this implementation of Apache Arrow.
TabularColumn
TabularError

Constants§

AHRI_TRE_METADATA_PREFIX

Functions§

annotate_arrow_schema
annotate_arrow_table
columns_to_record_batch
extract_field_metadata_proposal
extract_field_metadata_proposals
extract_json_field_metadata_proposals
extract_json_file_metadata_proposals
Scans large JSON tables without retaining rows. Only the existing metadata keys are retained, each under the fixed metadata allocation input ceiling.
open_ipc_messages
Opens the bounded message region of an IPC file or stream. File footers are validated before using any untrusted footer length; batches remain streaming.
read_ipc_file
read_ipc_schema
read_ipc_stream
read_parquet_file
read_parquet_file_with_options
read_parquet_schema
Reads only Parquet schema metadata, never materializes data batches.
record_batch_to_columns
write_ipc_file
write_ipc_file_to_writer
write_ipc_file_with_options
write_ipc_stream
write_ipc_stream_to_writer
write_ipc_stream_with_options
write_parquet_file
write_parquet_file_with_options

Type Aliases§

Result
SchemaRef
A reference-counted reference to a Schema.