Big Data
645 items from 0xnr/awesome-bigdata ★14,672
-
Argus github.com
Time series monitoring and alerting platform.
-
Kestrel github.com
distributed message queue system.
-
LinkedIn Krati github.com
is a simple persistent data store with very low latency and high throughput.
-
Vowpal Wabbit github.com
learning system sponsored by Microsoft and Yahoo!.
-
RL4J github.com
Reinforcement learning for Java and Scala. Includes Deep-Q learning and A3C algorithms, and integrates with Open AI's Gym. Runs in the Deeplearning4j ecosystem.
-
ND4J github.com
A matrix library for the JVM. Numpy for Java.
-
Deeplearning4j Benchmarks github.com
-
DataVec github.com
A vectorization and data preprocessing library for deep learning in Java and Scala. Part of the Deeplearning4j ecosystem.
-
Deeplearning4j github.com
Fast, open deep learning for the JVM (Java, Scala, Clojure). A neural network configuration layer powered by a C++ library. Uses Spark and Hadoop to train nets on multiple GPUs and CPUs.
-
CartoDB github.com
open-source or freemium hosting for geospatial databases with powerful front-end editing capabilities and a robust API.
-
Spark Catalyst github.com
is a Query Optimization Framework for Spark and Shark.
-
Gigasheet gigasheet.com
cloud spreadsheet for exploring and analyzing large datasets.
-
Pivotal GemFire XD gemfire.docs.pivotal.io
Low-latency, in-memory, distributed SQL data store. Provides SQL interface to in-memory table data, persistable in HDFS.
-
Apache Gearpump gearpump.github.io
real-time big data streaming engine based on Akka.
-
Frappe Charts frappe.io
GitHub-inspired simple and modern SVG charts for the web with zero dependencies.
-
FoundationDB foundationdb.com
distributed database, inspired by F1.
-
Flexmonster Pivot Table & Charts flexmonster.com
JavaScript component for pivot tables, charts, and web reporting.
-
Facebook Corona facebook.com
Hadoop enhancement which removes single point of failure.
-
Facebook Scuba facebook.com
distributed in-memory datastore.
-
Facebook Memcached facebook.com
fork of Memcache.
-
Facebook McDipper facebook.com
key/value cache for flash storage.
-
Facebook Haystack facebook.com
object storage system.
-
Evrything evrythng.com
Making products smart
-
EventQL eventql.io
a distributed, column-oriented database built for large-scale event collection and analytics.
-
etcML etcml.com
text classification with machine learning.
-
LinkedIn Galene engineering.linkedin.com
search architecture at LinkedIn.
-
LinkedIn Espresso engineering.linkedin.com
horizontally scalable document-oriented NoSQL data store.
-
Facebook TAO engineering.fb.com
TAO is the distributed data store that is widely used at Facebook to store and serve the social graph.
-
Logstash elastic.co
a tool for managing events and logs.
-
Metricbeat elastic.co
lightweight shipper for system and service metrics.
-
Apache Edgent (Incubating) edgent.apache.org
a programming model and micro-kernel style runtime that can be embedded in gateways and small footprint edge devices enabling local, real-time, analytics on the edge devices.
-
Eclipse BIRT eclipse.org
Eclipse-based reporting system.
-
Apache Eagle eagle.apache.org
real time monitoring solution
-
Drizzle drizzle.org
evolution of MySQL 6.0.
-
Dremio dremio.com
an open-source, SQL-like Data-as-a-Service Platform based on Apache Arrow.
-
Apache Doris doris.apache.org
real-time analytical database for high-concurrency SQL analytics, search, and warehousing.
-
Invantive SQL documentation.invantive.com
SQL engine for online and on-premise use with integrated local data replication and 70+ connectors.
-
Soda Core docs.soda.io
open-source Python library and CLI for data quality tests.
-
Azure Data Factory docs.microsoft.com
cloud-based pipeline orchestration for on-prem, cloud and HDInsight
-
DataKitchen Open Source Data Observability docs.datakitchen.io
open-source data observability for monitoring data journeys, data quality, and pipeline events.
-
Nokia Disco discoproject.org
MapReduce framework developed by Nokia.
-
Disco DDFS disco.readthedocs.org
distributed filesystem.
-
Delta Lake delta.io
open-source storage framework for building lakehouse architectures on data lakes.
-
Dekart dekart.xyz
Large scale geospatial analytics for Google BigQuery based on Kepler.gl.
-
Debezium debezium.io
open-source distributed platform for change data capture.
-
2013 db.disi.unitn.eu
Facebook - Unicorn: A System for Searching the Social Graph.
-
2013 db.disi.unitn.eu
Facebook - Scuba: Diving into Data at Facebook.
-
2013 db.disi.unitn.eu
Google - Online, Asynchronous Schema Change in F1.
-
2013 db.disi.unitn.eu
Google - MillWheel: Fault-Tolerant Stream Processing at Internet Scale.
-
HadoopDB db.cs.yale.edu
hybrid of MapReduce and DBMS.
- next page of items loading…
