Big Data
645 items from 0xnr/awesome-bigdata ★14,672
-
Comdb2 github.com
a clustered RDBMS built on optimistic concurrency control techniques.
-
Conjecture github.com
scalable Machine Learning in Scalding.
-
AgensGraph github.com
transactional graph database based on PostgreSQL.
-
Duckle github.com
open-source visual ETL/ELT platform built on DuckDB with connectors, data quality checks, and lineage.
-
SummitDB github.com
an in-memory, NoSQL key/value database, with disk persistence and using the Raft consensus algorithm.
-
Hydrosphere Mist github.com
a service for exposing Apache Spark analytics jobs and machine learning models as realtime, batch or reactive web services.
-
Eventhub github.com
open source event analytics platform.
-
Twitter Fatcache github.com
key/value cache for flash storage.
-
AthenaX github.com
a streaming analytics platform that enables users to run production-quality, large scale streaming analytics using Structured Query Language (SQL).
-
isolation-forest github.com
distributed Spark and Scala implementation of isolation forest for unsupervised outlier detection.
-
Bistro github.com
general-purpose data processing engine for both batch and stream analytics. It is based on a novel data model, which represents data via functions and processes data via column operations as opposed to having only set operations in conventional approaches like MapReduce or SQL.
-
411 github.com
an web application for alert management resulting from scheduled searches into Elasticsearch.
-
Twitter Twemcache github.com
fork of Memcache.
-
BayesDB github.com
statistic oriented SQL database.
-
Hermes github.com
asynchronous message broker built on top of Kafka.
-
White Elephant github.com
log aggregator and dashboard.
-
Gazette github.com
Distributed streaming infrastructure built on cloud storage which makes it easy to mix and match batch and streaming paradigms.
-
Rakam github.com
open-source real-time custom analytics platform powered by Postgresql, Kinesis and PrestoDB.
-
Seaweed File System github.com
Fast, Simple and Scalable Distributed File System with O(1) disk seek.
-
GhostDB github.com
a distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale.
-
D3.compose github.com
Compose complex, data-driven visualizations from reusable charts and components.
-
LinkedIn Cleo github.com
is a flexible software library for enabling rapid development of partial, out-of-order and real-time typeahead search.
-
ElephantDB github.com
Distributed database specialized in exporting data from Hadoop.
-
Edis github.com
is a protocol-compatible Server replacement for Redis.
-
SiriDB github.com
Highly-scalable, robust and fast, open source time series database with cluster functionality.
-
Spring XD github.com
distributed and extensible system for data ingestion, real time analytics, batch processing, and data export.
-
Storehaus github.com
library to work with asynchronous key value stores, by Twitter.
-
IndexR github.com
an open-source columnar storage format for fast & realtime analytic with big data.
-
AddThis Hydra github.com
distributed data processing and storage system originally developed at AddThis.
-
Graviton github.com
a simple, fast, versioned, authenticated, embeddable key-value store database in pure Go(lang).
-
chartist-js github.com
another open source HTML5 Charts visualization.
-
Zeppelin github.com
a notebook-style collaborative data analysis.
-
Skale github.com
High performance distributed data processing in NodeJS.
-
KarelDB github.com
a relational database backed by Apache Kafka.
-
Phoebus github.com
framework for large scale graph processing.
-
Decider github.com
Flexible and Extensible Machine Learning in Ruby.
-
LinkedIn Zoie github.com
is a realtime search/indexing system written in Java.
-
Adobe spindle github.com
Next-generation web analytics processing with Scala, Spark, and Parquet.
-
Sparrow github.com
scheduling platform.
-
Prometheus prometheus.io
a time series database and service monitoring system.
-
RethinkDB rethinkdb.com
The open-source database for the realtime web.
-
Crate.IO crate.io
Scalable SQL database with the NOSQL goodies.
-
Apache Spark spark.apache.org
A multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters.
-
ElasticSearch elastic.co
Search & Analyze Data in Real Time.
-
Apache Avro avro.apache.org
Apache Avro™ is a data serialization system.
-
Storm storm.apache.org
A free and open source distributed realtime computation system.
-
shiny shiny.rstudio.com
a web application framework for R.
-
Flink flink.apache.org
A streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams.
-
Opik comet.com
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
-
ZingChart zingchart.com
Built to render large data sets other libraries can't handle. Super customizable styling and new features added often. Everything in one modular library.
- next page of items loading…
