Data Engineering
313 items from igorbarinov/awesome-data-engineering ★9,166
-
-
Apache Cassandra cassandra.apache.org
The right choice when you need scalability and high availability without compromising performance.
-
Redash redash.io
Make Your Company Data Driven. Connect to any data source, easily visualize and share your data.
-
Seaborn seaborn.pydata.org
A Python visualization library based on matplotlib. It provides a high-level interface for drawing attractive statistical graphics.
-
AI Dev Jobs aidevboard.com
Job board focused on AI/ML engineering roles with 5,400+ listings and a free REST API.
-
Highcharts highcharts.com
A series of charting libraries for a variety of uses. Can be compatible back to IE6.
-
-
-
Apache Thrift thrift.apache.org
Efficient cross-language IPC/RPC, works between C++, Java, Python, PHP, C#, and many more other languages. Originally developed by Facebook. [Apache2]
-
ArangoDB arangodb.com
A distributed free and open-source database with a flexible data model for documents, graphs, and key-values.
-
-
-
-
-
Apache Spark spark.apache.org
A multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters.
-
-
-
-
Flink flink.apache.org
A streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams.
-
ZingChart zingchart.com
Built to render large data sets other libraries can't handle. Super customizable styling and new features added often. Everything in one modular library.
-
-
parquet parquet.apache.org
Columnar storage format that uses the record shredding and assembly algorithm described in the Dremel paper.
-
-
-
Census getcensus.com
A reverse-ETL tool that let you sync data from your cloud data warehouse to SaaS applications like Salesforce, Marketo, HubSpot, Zendesk, etc. No engineering favors required—just SQL.
-
-
Apache Beam beam.apache.org
A unified programming model that implements both batch and streaming data processing jobs that run on many execution engines.
-
Apache Tez tez.apache.org
An application framework which allows for a complex directed-acyclic-graph of tasks for processing data.
-
Apache Sqoop sqoop.apache.org
A tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases.
-
- next page of items loading…
