Apache Avro
Serialization format for record data, and first choice for streaming data pipelines.
- from
- Standards
- added
- 2026-10-10
- likes
- 0
similar
-
Apache Avro avro.apache.org
Apache Avro™ is a data serialization system.
-
Apache Avro (⭐3.3k) github.com
Data serialization system that provides compact, fast, and efficient serialization of structured data. It supports schema evolution, allows for efficient data compression, and is designed to work well with big data processing frameworks.
-
Apache Arrow (⭐17k) github.com
Language-agnostic columnar in-memory format for fast data interchange, including the Arrow IPC format and Flight RPC for moving data between systems.
-
avro github.com
Discover SQL schemas and convert them to AVRO schemas. Query SQL records into AVRO bytes.
-
Apache Spark Streaming spark.apache.org
framework for stream processing, part of Spark.
-
Apache Sqoop sqoop.apache.org
A tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases.
Standards › APIs: “Serialization format for record data, and first choice for streaming data pipelines.”