Big Data
645 items from 0xnr/awesome-bigdata ★14,672
-
Unified Log Processing manning.com
Unified Log Processing is a practical guide to implementing a unified log of event streams (Kafka or Kinesis) in your business
-
Data Science at Scale with Python and Dask manning.com
Data Science at Scale with Python and Dask teaches you how to build distributed data projects that can handle huge amounts of data.
-
Data Pipelines with Apache Airflow manning.com
practical guide to building and maintaining data pipelines with Airflow.
-
Big Data manning.com
Big Data teaches you to build big data systems using an architecture that takes advantage of clustered hardware along with new tools designed specifically to capture and analyze web-scale data.
-
Azure Data Engineering manning.com
A book about data engineering in general and the Azure platform specifically
-
MADlib madlib.incubator.apache.org
data-processing library of an RDBMS to analyze data.
-
M3DB m3db.io
a distributed time series database that can be used for storing realtime metrics at long retention.
-
Lumify lumify.io
open source big data analysis and visualization platform
-
Apache Lucene lucene.apache.org
Search engine library.
-
2010 leoneu.github.io
Yahoo - S4: Distributed Stream Computing Platform.
-
LanceDB lancedb.com
open-source embedded vector database built on the Lance columnar format.
-
Google Pregel kowshik.github.io
graph processing framework.
-
Knowage knowage-suite.com
open source business intelligence platform. (former SpagoBi)
-
NoSQL Comparison kkovacs.eu
Cassandra vs MongoDB vs CouchDB vs Redis vs Riak vs HBase vs Couchbase vs Neo4j vs Hypertable vs ElasticSearch vs Accumulo vs VoltDB vs Scalaris comparison.
-
Kite kitesdk.org
is a set of libraries, tools, examples, and documentation focused on making it easier to build systems on top of the Hadoop ecosystem.
-
Apache Karaf karaf.apache.org
OSGi runtime that runs on top of any OSGi framework.
-
Jethrodata jethro.io
Interactive Big Data Analytics.
-
Jedox Palo jedox.com
customisable Business Intelligence platform.
-
Jaspersoft jaspersoft.com
powerful business intelligence suite.
-
PUMA Benchmarking issues.apache.org
benchmark suite for MapReduce applications.
-
intermix.io intermix.io
Performance Monitoring for Amazon Redshift
-
Facebook Apollo infoq.com
Facebook’s Paxos-like NoSQL database.
-
2014 infolab.stanford.edu
Stanford - Mining of Massive Datasets.
-
InfiniSQL infinisql.org
infinity scalable RDBMS.
-
Apache Twill incubator.apache.org
abstraction over YARN that reduces the complexity of developing distributed applications.
-
Apache Sentry incubator.apache.org
security module for data stored in Hadoop.
-
Apache S4 incubator.apache.org
framework for stream processing, implementation of S4.
-
Apache DataFu incubator.apache.org
collection of user-defined functions for Hadoop and Pig developed by LinkedIn.
-
Ignite ignite.apache.org
is an in-memory key-value data store providing full SQL-compliant data access that can optionally be backed by disk storage.
-
Apache Iceberg iceberg.apache.org
open table format for huge analytic datasets with schema evolution, hidden partitioning, and time travel.
-
IBM Streams ibm.com
platform for distributed processing and real-time analytics. Integrates with many of the popular technologies in the Big Data ecosystem (Kafka, HDFS, Spark, etc.)
-
Hypertable hypertable.org
column-oriented distributed datastore, inspired by BigTable.
-
H-Store hstore.cs.brown.edu
is an experimental main-memory, parallel database management system that is optimized for on-line transaction processing (OLTP) applications.
-
Stinger hortonworks.com
interactive query for Hive.
-
Apache YARN hortonworks.com
Cluster manager.
-
Hortonworks HOYA hortonworks.com
application that can deploy HBase cluster on YARN.
-
Hightouch hightouch.com
reverse ETL platform for syncing warehouse data into business applications.
-
ENCOG heatonresearch.com
machine learning framework that supports a variety of advanced algorithms, as well as support classes to normalize and process data.
-
SAP HANA hana.sap.com
is an in-memory, column-oriented, relational database management system.
-
Apache Hama hama.apache.org
BSP (Bulk Synchronous Parallel) computing framework.
-
Microsoft Azure Data Lake Store hadoop.apache.org
HDFS-compatible storage in Azure cloud
-
GridGain gridgain.com
GGFS, Hadoop compliant in-memory file system.
-
Graphite graphiteapp.org
scalable Realtime Graphing.
-
Google Dataflow googledevelopers.blogspot.it
create data pipelines to help them ingest, transform and analyze data.
-
Google Caffeine googleblog.blogspot.it
continuous indexing system.
-
GoodData gooddata.com
platform for data products and embedded analytics.
-
Torch github.com
A deep learning library with a Lua API, supported by NYU and Facebook.
-
Theano github.com
A Python-focused machine learning library supported by the University of Montreal.
-
Berkeley SWIM Benchmark github.com
real-world big data workload benchmark.
-
StreamSets Data Collector github.com
continuous big data ingest infrastructure with a simple to use IDE.
- next page of items loading…
