Big Data
645 items from 0xnr/awesome-bigdata ★14,672
-
Apache Hama hama.apache.org
BSP (Bulk Synchronous Parallel) computing framework.
-
Microsoft Azure Data Lake Store hadoop.apache.org
HDFS-compatible storage in Azure cloud
-
GridGain gridgain.com
GGFS, Hadoop compliant in-memory file system.
-
Graphite graphiteapp.org
scalable Realtime Graphing.
-
Google Dataflow googledevelopers.blogspot.it
create data pipelines to help them ingest, transform and analyze data.
-
Google Caffeine googleblog.blogspot.it
continuous indexing system.
-
GoodData gooddata.com
platform for data products and embedded analytics.
-
Torch github.com
A deep learning library with a Lua API, supported by NYU and Facebook.
-
Theano github.com
A Python-focused machine learning library supported by the University of Montreal.
-
Berkeley SWIM Benchmark github.com
real-world big data workload benchmark.
-
LinkedIn Krati github.com
is a simple persistent data store with very low latency and high throughput.
-
Vowpal Wabbit github.com
learning system sponsored by Microsoft and Yahoo!.
-
Deeplearning4j github.com
Fast, open deep learning for the JVM (Java, Scala, Clojure). A neural network configuration layer powered by a C++ library. Uses Spark and Hadoop to train nets on multiple GPUs and CPUs.
-
Spark Catalyst github.com
is a Query Optimization Framework for Spark and Shark.
-
Gigasheet gigasheet.com
cloud spreadsheet for exploring and analyzing large datasets.
-
Pivotal GemFire XD gemfire.docs.pivotal.io
Low-latency, in-memory, distributed SQL data store. Provides SQL interface to in-memory table data, persistable in HDFS.
-
Apache Gearpump gearpump.github.io
real-time big data streaming engine based on Akka.
-
Frappe Charts frappe.io
GitHub-inspired simple and modern SVG charts for the web with zero dependencies.
-
FoundationDB foundationdb.com
distributed database, inspired by F1.
-
Flexmonster Pivot Table & Charts flexmonster.com
JavaScript component for pivot tables, charts, and web reporting.
-
Facebook Corona facebook.com
Hadoop enhancement which removes single point of failure.
-
Facebook Scuba facebook.com
distributed in-memory datastore.
-
Facebook Memcached facebook.com
fork of Memcache.
-
Facebook McDipper facebook.com
key/value cache for flash storage.
-
Facebook Haystack facebook.com
object storage system.
-
Evrything evrythng.com
Making products smart
-
EventQL eventql.io
a distributed, column-oriented database built for large-scale event collection and analytics.
-
etcML etcml.com
text classification with machine learning.
-
LinkedIn Galene engineering.linkedin.com
search architecture at LinkedIn.
-
LinkedIn Espresso engineering.linkedin.com
horizontally scalable document-oriented NoSQL data store.
-
Facebook TAO engineering.fb.com
TAO is the distributed data store that is widely used at Facebook to store and serve the social graph.
-
Logstash elastic.co
a tool for managing events and logs.
-
Metricbeat elastic.co
lightweight shipper for system and service metrics.
-
Apache Edgent (Incubating) edgent.apache.org
a programming model and micro-kernel style runtime that can be embedded in gateways and small footprint edge devices enabling local, real-time, analytics on the edge devices.
-
Eclipse BIRT eclipse.org
Eclipse-based reporting system.
-
Apache Eagle eagle.apache.org
real time monitoring solution
-
Drizzle drizzle.org
evolution of MySQL 6.0.
-
Dremio dremio.com
an open-source, SQL-like Data-as-a-Service Platform based on Apache Arrow.
-
Apache Doris doris.apache.org
real-time analytical database for high-concurrency SQL analytics, search, and warehousing.
-
Invantive SQL documentation.invantive.com
SQL engine for online and on-premise use with integrated local data replication and 70+ connectors.
-
Soda Core docs.soda.io
open-source Python library and CLI for data quality tests.
-
Azure Data Factory docs.microsoft.com
cloud-based pipeline orchestration for on-prem, cloud and HDInsight
-
DataKitchen Open Source Data Observability docs.datakitchen.io
open-source data observability for monitoring data journeys, data quality, and pipeline events.
-
Nokia Disco discoproject.org
MapReduce framework developed by Nokia.
-
Disco DDFS disco.readthedocs.org
distributed filesystem.
-
Delta Lake delta.io
open-source storage framework for building lakehouse architectures on data lakes.
-
Dekart dekart.xyz
Large scale geospatial analytics for Google BigQuery based on Kepler.gl.
-
Debezium debezium.io
open-source distributed platform for change data capture.
-
2013 db.disi.unitn.eu
Facebook - Unicorn: A System for Searching the Social Graph.
-
2013 db.disi.unitn.eu
Facebook - Scuba: Diving into Data at Facebook.
- next page of items loading…
