Big Data
645 items from 0xnr/awesome-bigdata ★14,672
-
Cronicle github.com
Distributed, easy to install, NodeJS based, task scheduler
-
Elephant Bird github.com
libraries for working with LZOP-compressed data.
-
eliasdb github.com
Dependency-free, transactional graph database with REST API, phrase search and SQL-like query language.
-
Snappydata github.com
OLTP + OLAP Database built on Apache Spark.
-
Shapley github.com
A data-driven framework to quantify the value of classifiers in a machine learning ensemble.
-
Actionbase github.com
A database for user interactions (likes, views, follows) represented as graphs, with precomputed reads served in real-time.
-
Marathon github.com
Mesos framework for long-running services.
-
Facebook Scribe github.com
streamed log data aggregator.
-
BIDMach github.com
CPU and GPU-accelerated Machine Learning Library.
-
MLPNeuralNet github.com
Fast multilayer perceptron neural network library for iOS and Mac OS X.
-
Twitter Heron github.com
Heron is a realtime, distributed, fault-tolerant stream processing engine from Twitter replacing Storm.
-
Atlas github.com
a backend for managing dimensional time series data.
-
Akumuli github.com
A numeric time-series database. It can be used to capture, store and process time-series data in real-time. The word "akumuli" can be translated from esperanto as "accumulate".
-
Linkis github.com
Linkis helps easily connect to various back-end computation/storage engines.
-
Suro github.com
log agregattor like Storm and Samza based on Chukwa.
-
skizze github.com
A probabilistic data structure service and storage.
-
DataSphere Studio github.com
one-stop data application development management portal.
-
Beringei github.com
Facebook's in-memory time-series database.
-
Dalmatiner DB github.com
Fast distributed metrics database.
-
Haeinsa github.com
linearly scalable multi-row, multi-table transaction library for HBase based on Percolator.
-
Banana github.com
visualize logs and time-stamped data stored in Solr. Port of Kibana.
-
Baidu File System github.com
distributed filesystem.
-
Airpal github.com
Web UI for PrestoDB.
-
Blueflood github.com
A distributed system designed to ingest and process time series data.
-
Pilosa github.com
Open source distributed bitmap index that dramatically accelerates queries across multiple, massive data sets.
-
GridDB github.com
suitable for sensor data stored in a timeseries.
-
Kapacitor github.com
an open source framework for processing, monitoring, and alerting on time series data.
-
Recline github.com
simple but powerful library for building data applications in pure Javascript and HTML.
-
Microsoft Graph Engine github.com
a distributed in-memory data processing engine, underpinned by a strongly-typed in-memory key-value store and a general distributed computation engine.
-
Mara github.com
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
-
Gremlin github.com
graph traversal Language.
-
Baidu Tera github.com
an Internet-scale database, inspired by BigTable.
-
ActorDB github.com
a distributed SQL database with the scalability of a KV store, while keeping the query capabilities of a relational database.
-
Smooks (⭐421) github.com
Extensible Java framework for processing and transforming structured data such as EDI, XML, CSV, and JSON.
-
Ambry github.com
a distributed object store that supports storage of trillion of small immutable objects as well as billions of large objects.
-
Elassandra github.com
is a fork of Elasticsearch modified to run on top of Apache Cassandra in a scalable and resilient peer-to-peer architecture.
-
Timely github.com
A time series database application that provides secure access to time series data based on Accumulo and Grafana.
-
LocustDB github.com
an experimental analytics database aiming to set a new standard for query performance on commodity hardware.
-
Comdb2 github.com
a clustered RDBMS built on optimistic concurrency control techniques.
-
Conjecture github.com
scalable Machine Learning in Scalding.
-
AgensGraph github.com
transactional graph database based on PostgreSQL.
-
Duckle github.com
open-source visual ETL/ELT platform built on DuckDB with connectors, data quality checks, and lineage.
-
SummitDB github.com
an in-memory, NoSQL key/value database, with disk persistence and using the Raft consensus algorithm.
-
Hydrosphere Mist github.com
a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services.
-
Eventhub github.com
open source event analytics platform.
-
Twitter Fatcache github.com
key/value cache for flash storage.
-
AthenaX github.com
a streaming analytics platform that enables users to run production-quality, large scale streaming analytics using Structured Query Language (SQL).
-
isolation-forest github.com
distributed Spark and Scala implementation of isolation forest for unsupervised outlier detection.
-
Bistro github.com
general-purpose data processing engine for both batch and stream analytics. It is based on a novel data model, which represents data via functions and processes data via column operations as opposed to having only set operations in conventional approaches like MapReduce or SQL.
-
411 github.com
an web application for alert management resulting from scheduled searches into Elasticsearch.
- next page of items loading…
