Big Data
645 items from 0xnr/awesome-bigdata ★14,672
-
Cronicle github.com
Distributed, easy to install, NodeJS based, task scheduler
-
Elephant Bird github.com
libraries for working with LZOP-compressed data.
-
eliasdb github.com
Dependency-free, transactional graph database with REST API, phrase search and SQL-like query language.
-
Snappydata github.com
OLTP + OLAP Database built on Apache Spark.
-
Shapley github.com
A data-driven framework to quantify the value of classifiers in a machine learning ensemble.
-
Actionbase github.com
A database for user interactions (likes, views, follows) represented as graphs, with precomputed reads served in real-time.
-
Marathon github.com
Mesos framework for long-running services.
-
Facebook Scribe github.com
streamed log data aggregator.
-
BIDMach github.com
CPU and GPU-accelerated Machine Learning Library.
-
MLPNeuralNet github.com
Fast multilayer perceptron neural network library for iOS and Mac OS X.
-
Twitter Heron github.com
Heron is a realtime, distributed, fault-tolerant stream processing engine from Twitter replacing Storm.
-
Atlas github.com
a backend for managing dimensional time series data.
-
Akumuli github.com
A numeric time-series database. It can be used to capture, store and process time-series data in real-time. The word "akumuli" can be translated from esperanto as "accumulate".
-
Linkis github.com
Linkis helps easily connect to various back-end computation/storage engines.
-
Suro github.com
log agregattor like Storm and Samza based on Chukwa.
-
skizze github.com
A probabilistic data structure service and storage.
-
DataSphere Studio github.com
one-stop data application development management portal.
-
Beringei github.com
Facebook's in-memory time-series database.
-
Dalmatiner DB github.com
Fast distributed metrics database.
-
Haeinsa github.com
linearly scalable multi-row, multi-table transaction library for HBase based on Percolator.
-
Banana github.com
visualize logs and time-stamped data stored in Solr. Port of Kibana.
-
Baidu File System github.com
distributed filesystem.
-
Airpal github.com
Web UI for PrestoDB.
-
Blueflood github.com
A distributed system designed to ingest and process time series data.
-
Pilosa github.com
Open source distributed bitmap index that dramatically accelerates queries across multiple, massive data sets.
-
GridDB github.com
suitable for sensor data stored in a timeseries.
-
Kapacitor github.com
an open source framework for processing, monitoring, and alerting on time series data.
-
Recline github.com
simple but powerful library for building data applications in pure Javascript and HTML.
-
Microsoft Graph Engine github.com
a distributed in-memory data processing engine, underpinned by a strongly-typed in-memory key-value store and a general distributed computation engine.
-
Mara github.com
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
-
Gremlin github.com
graph traversal Language.
-
Apache Kafka kafka.apache.org
Publish-subscribe messaging rethought as a distributed commit log.
-
Apache Cassandra cassandra.apache.org
The right choice when you need scalability and high availability without compromising performance.
-
Redash redash.io
Make Your Company Data Driven. Connect to any data source, easily visualize and share your data.
-
Highcharts highcharts.com
A series of charting libraries for a variety of uses. Can be compatible back to IE6.
-
D3.js d3js.org
Allows the user to manipulate documents based on data to render charts in SVG.
-
Chart.js chartjs.org
Tiny library (11kb!) including core chart types.
-
C3.js c3js.org
D3 based reusable chart library.
-
Apache Thrift thrift.apache.org
Efficient cross-language IPC/RPC, works between C++, Java, Python, PHP, C#, and many more other languages. Originally developed by Facebook. [Apache2]
-
ArangoDB arangodb.com
A distributed free and open-source database with a flexible data model for documents, graphs, and key-values.
-
DynamoDB aws.amazon.com
[dynamodb]
-
MongoDB mongodb.com
Scalable, flexible document database with querying and indexing.
-
Countly count.ly
Open source mobile & web analytics, push notifications and crash reporting platform, based on Node.js, MongoDB and Linux.
-
Baidu Tera github.com
an Internet-scale database, inspired by BigTable.
-
ActorDB github.com
a distributed SQL database with the scalability of a KV store, while keeping the query capabilities of a relational database.
-
Smooks (⭐421) github.com
Extensible Java framework for processing and transforming structured data such as EDI, XML, CSV, and JSON.
-
Ambry github.com
a distributed object store that supports storage of trillion of small immutable objects as well as billions of large objects.
-
Elassandra github.com
is a fork of Elasticsearch modified to run on top of Apache Cassandra in a scalable and resilient peer-to-peer architecture.
-
Timely github.com
A time series database application that provides secure access to time series data based on Accumulo and Grafana.
-
LocustDB github.com
an experimental analytics database aiming to set a new standard for query performance on commodity hardware.
- next page of items loading…
