Hadoop
161 items from youngwookim/awesome-hadoop ★1,117
-
-
Apache Cassandra cassandra.apache.org
The right choice when you need scalability and high availability without compromising performance.
-
Apache Thrift thrift.apache.org
Efficient cross-language IPC/RPC, works between C++, Java, Python, PHP, C#, and many more other languages. Originally developed by Facebook. [Apache2]
-
Apache Spark spark.apache.org
A multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters.
-
-
-
-
Flink flink.apache.org
A streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams.
-
-
parquet parquet.apache.org
Columnar storage format that uses the record shredding and assembly algorithm described in the Dremel paper.
-
Apache Tez tez.apache.org
An application framework which allows for a complex directed-acyclic-graph of tasks for processing data.
-
Apache Sqoop sqoop.apache.org
A tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases.
-
-
-
-
Apache NiFi nifi.apache.org
An easy to use, powerful, and reliable system to process and distribute data.
-
Apache Mahout mahout.apache.org
An environment for quickly creating scalable performant machine learning applications.
-
-
Apache Hive hive.apache.org
Data warehouse software facilitates querying and managing large datasets residing in distributed storage.
-
-
-
-
-
Apache Calcite calcite.apache.org
framework that allows efficient translation of queries involving heterogeneous and federated data.
-
Azkaban azkaban.github.io
A batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy-to-use web user interface to maintain and track your workflows.
-
-
R-project r-project.org
-
Apache Zeppelin zeppelin.incubator.apache.org
Web-based notebook that enables interactive data analytics with plugable backends, integrated plotting, and extensive Spark support out-of-the-box.
-
-
- next page of items loading…
