Parse messages into Arrow Record Batches - #375

Draft

fpacifici wants to merge 13 commits into

mainfrom

fpacifici/arrow_batches

Commits on Sep 13, 2026

docs(arrow): design plan for the Rust Arrow batch parser

fpacifici
and
claude
committed
e8e085e
feat(arrow): add Arrow batch parser dependencies (phase 0)

fpacifici
and
claude
committed
a0b5f54
feat(arrow): expose RecordBatch to Python via PyCapsule (phase 1)

fpacifici
and
claude
committed
5839f5a
refactor(arrow): generalize BatchStep over a flush producer (phase 2)

fpacifici
and
claude
committed
4f08736
feat(arrow): protobuf to Arrow extractors, TraceItem (phase 3)

fpacifici
and
claude
committed
3b67c5e
feat(arrow): the Arrow batch parser step (phase 4)

fpacifici
and
claude
committed
fd79874
feat(arrow): DSL and adapter wiring for ArrowBatchParser (phase 5)

fpacifici
and
claude
committed
3856cca
feat(arrow): example, end-to-end test, benchmark and docs (phase 6)

fpacifici
and
claude
committed
b99fcf0
refactor(arrow): drop the adapter's placement and schema tracking

fpacifici
and
claude
committed
f2df92b

Commits on Sep 14, 2026