Big Data
645 items from 0xnr/awesome-bigdata ★14,672
-
Estuary Benchmark Report github.com
reproducible, vendor-neutral data warehouse benchmark.
-
Lambdo github.com
Lambdo is a workflow engine which significantly simplifies the analysis process by unifying feature engineering and machine learning operations.
-
Zoomdata zoomdata.com
Big Data Analytics.
-
Ice Bucket Challenge Data Visualization youtube.com
-
-
Designing Data Visualizations with Noah Iliinsky youtube.com
-
The beauty of data visualization youtube.com
-
Google Omega youtube.com
job scheduling and monitoring system.
-
Yahoo Gridmix3 yahoohadoop.tumblr.com
Hadoop cluster benchmarking from Yahoo engineer team.
-
Apache XTable xtable.apache.org
incubating Apache project for interoperability across lakehouse table formats.
-
RecDB www-users.cs.umn.edu
Open Source Recommendation Engine Built Entirely Inside PostgreSQL.
-
IBM Netezza www-01.ibm.com
high-performance data warehouse appliances.
-
Google Borg wired.com
job scheduling and monitoring system.
-
Facebook Prism wired.com
multi datacenters replication system.
-
Trafodion wiki.trafodion.org
enterprise-class SQL-on-HBase solution targeting big data transactional or operational workloads.
-
Lustre file system wiki.lustre.org
high-performance distributed filesystem.
-
Apache MapReduce wiki.apache.org
programming model for processing large data sets with a parallel, distributed algorithm on a cluster.
-
Apache Whirr whirr.apache.org
set of libraries for running cloud services.
-
WebScaleSQL webscalesql.org
is a collaboration among engineers from several companies that face similar challenges in running MySQL at scale.
-
WebDataRocks webdatarocks.com
free web pivot table component for embedding analytics in applications.
-
Weaviate weaviate.io
open-source vector database for semantic search with structured filtering.
-
Wallaroo wallaroolabs.com
The ultrafast and elastic data processing engine. Big or fast data - no fuss, no Java needed.
-
Cheetah vldbarc.org
High Performance, Custom Data Warehouse on Top of MapReduce.
-
2015 vldb.org
Facebook - One Trillion Edges: Graph Processing at Facebook-Scale.
-
2012 vldb.org
Google - Processing a trillion cells per mouse click.
-
Vespa vespa.ai
is an engine for low-latency computation over large data sets. It stores and indexes your data such that queries, selection and processing over the data can be performed at serving time.
-
redpanda vectorized.io
A Kafka® replacement for mission critical systems; 10x faster. Written in C++.
-
Sibyl users.soe.ucsc.edu
System for Large Scale Machine Learning at Google.
-
2012 usenix.org
AMPLab - Fast and Interactive Analytics over Hadoop Data with Spark.
-
2013 usenix.org
Facebook - Scaling Memcache at Facebook.
-
2010 usenix.org
Facebook - Finding a needle in Haystack: Facebook’s photo storage.
-
2012 usenix.org
Microsoft - Paxos Replicated State Machines as the Basis of a High-Performance Data Store.
-
TrailDB traildb.io
an efficient tool for storing and querying series of events.
-
Apache Tika tika.apache.org
content analysis toolkit.
-
Titan thinkaurelius.github.io
distributed graph database, built over Cassandra.
-
ThingWorx thingworx.com
Rapid development and connection of intelligent systems
-
Columnar Storage the-paper-trail.org
an explanation of what columnar storage is and when you might want it.
-
Teradata teradata.com
high-performance MPP data warehouse platform.
-
Aster Database teradata.com
SQL-like analytic processing for MapReduce.
-
TempoIQ tempoiq.com
Cloud-based sensor analytics.
-
Talend talend.com
unified open source environment for YARN, Hadoop, HBASE, Hive, HCatalog & Pig.
-
Tahoe-LAFS tahoe-lafs.org
decentralized cloud storage system.
-
Tableau tableau.com
business intelligence platform.
-
SymmetricDS symmetricds.org
open source software for both file and database synchronization.
-
Sumo Logic sumologic.com
cloud based analyzer for machine-generated data.
-
Azure ML Studio studio.azureml.net
Cloud-based AzureML, R, Python Machine Learning platform
-
DBConvert Streams streams.dbconvert.com
self-hosted CDC replication and database migration tool.
-
Streamdrill streamdrill.com
useful for counting activities of event streams over different time windows and finding the most active one.
-
Stratosphere stratosphere.eu
general purpose cluster computing framework.
-
Stado stormdb.com
open source MPP database system solely targeted at data warehousing and data mart applications.
- next page of items loading…
