Big Data
1,992 items in 9 lists
-
2013 db.disi.unitn.eu
Google - MillWheel: Fault-Tolerant Stream Processing at Internet Scale.
-
Polynote polynote.org
Polynote: an IDE-inspired polyglot notebook. It supports mixing multiple languages in one notebook, and sharing data between them seamlessly. It encourages reproducible notebooks with its immutable data model. Originating from Netflix.
-
HadoopDB db.cs.yale.edu
hybrid of MapReduce and DBMS.
-
Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing people.csail.mit.edu
Paper introducing a core distributed memory abstraction.
-
GraphLab Create dato.com
A machine learning platform in Python with a broad collection of ML toolkits, data engineering, and deployment tools.
-
Learning Spark, 2nd Edition oreilly.com
Introduction to Spark API with Spark 3.0 covered. Good source of knowledge about basic concepts.
-
DataTorrent StrAM datatorrent.com
real-time engine is designed to enable distributed, asynchronous, real time in-memory big-data computations in as unblocked a way as possible, with minimal overhead and impact on performance.
-
MLflow mlflow.org
Machine learning orchestration platform.
-
Datasalt Splout SQL datasalt.com
full SQL query engine for big datasets.
-
ModelDB mitdbg.github.io
A system to manage machine learning models for spark.ml and scikit-learn .
-
datapine datapine.com
self-service business intelligence tool in the cloud.
-
Mahout Spark Bindings mahout.apache.org
[status unknown] - linear algebra DSL and optimizer with R-like syntax.
-
Datapallas datapallas.com
BI and data platform with AI exploration, dashboards, and pixel-perfect report generation; formerly ReportBurster.
-
KeystoneML keystone-ml.org
Type safe machine learning pipelines with RDDs.
-
Monitoring Kafka performance datadoghq.com
Guide to monitoring Apache Kafka, including native methods for metrics collection.
-
Mastering Apache Spark jaceklaskowski.gitbooks.io
Interesting compilation of notes by Jacek Laskowski. Focused on different aspects of Spark internals.
-
Monitoring Cassandra performance datadoghq.com
Guide to monitoring Cassandra, including native methods for metrics collection.
-
datamechanics/spark hub.docker.com
An easy to setup Docker image for Apache Spark from Data Mechanics.
-
AMPLab SIMR databricks.github.io
run Spark on Hadoop MapReduce v1.
-
apache/spark hub.docker.com
Apache Spark Official Docker images.
-
SparkSQL databricks.com
Manipulating Structured Data Using Spark.
-
Spark with Scala Gitter channel gitter.im
"A place to discuss and ask questions about using Scala for Spark programming" started by @deanwampler.
-
Cytoscape cytoscape.github.io
JavaScript library for visualizing complex networks.
-
2008 cwiki.apache.org
AMPLab - Chukwa: A large-scale monitoring system.
-
Apache HCatalog cwiki.apache.org
table and storage management layer for Hadoop.
-
2009 cs.umd.edu
HadoopDB: An Architectural Hybrid of MapReduce and DBMS Technologies for Analytical Workloads.
-
Pydoop crs4.github.io
Python MapReduce and HDFS API for Hadoop.
-
jumboDB comsysto.github.io
document oriented datastore over Hadoop.
-
Comet comet.com
Comet provides an end-to-end model evaluation platform for AI developers, with best in class LLM evaluations, experiment tracking, and production monitoring.
-
JAQL code.google.com
declarative programming language for working with structured, semi-structured and unstructured data.
-
Facebook HydraBase code.facebook.com
evolution of HBase made by Facebook.
-
Cloudera Impala cloudera.com
framework for interactive analysis, Inspired by Dremel.
-
Google Cloud SQL cloud.google.com
MySQL databases in Google's cloud.
-
Google Cloud Datastore cloud.google.com
is a fully managed, schemaless database for storing non-relational data over BigTable.
-
Google BigQuery cloud.google.com
Google's cloud offering backed by their pioneering work on Dremel.
-
ClickHouse clickhouse.com
an open-source column-oriented database management system that allows generating analytical data reports in real time.
-
CitusDB citusdata.com
scales out PostgreSQL through sharding and replication.
-
IronDB circonus.com
scalable, general-purpose time series database.
-
Apache Chukwa chukwa.apache.org
data collection system.
-
Chronix chronix.io
a time series storage built to store time series highly compressed and for fast access times.
-
Chartio chartio.com
lean business intelligence platform to visualize and explore your data.
-
chartd chartd.co
responsive, retina-compatible charts with just an img tag.
-
Ceph Filesystem ceph.com
software storage platform designed.
-
Concurrent Pattern cascading.org
machine learning library for Cascading.
-
jupyter/docker-stacks/pyspark-notebook github.com
PySpark with Jupyter Notebook and Mesos client.
-
Fundamentals of Stream Processing: Application Design, Systems, and Analytics cambridge.org
This comprehensive, hands-on guide combining the fundamental building blocks and emerging research in stream processing is ideal for application designers, system builders, analytic developers, as well as students and researchers in the field.
-
Buildoop buildoop.github.io
Similar to Apache BigTop based on Groovy language.
-
Brooklyn brooklyncentral.github.io
library that simplifies application deployment and management.
-
Distributed Systems for fun and profit book.mixu.net
Theory of distributed systems. Include parts about time and ordering, replication and impossibility results.
-
Rackerlabs Blueflood blueflood.io
multi-tenant distributed metric processing system
- next page of items loading…
