Apache Spark
78 items from awesome-spark/awesome-spark ★1,902
-
ORYX github.com
Lambda architecture platform built on Apache Spark and Apache Kafka with specialization for real-time large scale machine learning.
-
Microsoft ML for Apache Spark github.com
A distributed ml library with support for LightGBM, Vowpal Wabbit, OpenCV, Deep Learning, Cognitive Services, and Model Deployment.
-
-
-
-
-
-
Delight github.com
A free & cross platform monitoring tool (Spark UI / Spark History Server alternative).
-
-
-
-
-
deequ github.com
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
-
-
spark-jobserver github.com
Simple Spark as a Service which supports objects sharing using so called named objects. JVM only.
-
-
Apache Kyuubi github.com
A distributed multi-tenant JDBC server for large-scale data processing and analytics, built on top of Apache Spark.
-
-
Spark Cassandra Connector github.com
Cassandra support including data source and API and support for arbitrary queries.
-
-
MLeap github.com
Execution engine and serialization format which supports deployment of o.a.s.ml models without dependency on SparkSession.
-
Optimus github.com
Data Cleansing and Exploration utilities with the goal of simplifying data cleaning.
-
neo4j-spark-connector github.com
Bolt protocol based, Neo4j Connector with RDD, DataFrame and GraphX / GraphFrames support.
-
sparkmagic github.com
Jupyter magics and kernels for working with remote Spark clusters, for interactively working with remote Spark clusters through Livy, in Jupyter notebooks.
-
-
-
Livy github.com
REST server with extensive language support (Python, R, Scala), ability to maintain interactive sessions and object sharing.
-
-
Photon ML github.com
A machine learning library supporting classical Generalized Mixed Model and Generalized Additive Mixed Effect Model.
-
- next page of items loading…
