Big Data
645 items from 0xnr/awesome-bigdata ★14,672
-
Metamarkets Druid druid.io
framework for real-time analysis of large datasets.
-
PostgreSQL postgresql.org
The world's most advanced open source database.
-
MySQL mysql.com
The world's most popular open source database.
-
Census getcensus.com
A reverse-ETL tool that let you sync data from your cloud data warehouse to SaaS applications like Salesforce, Marketo, HubSpot, Zendesk, etc. No engineering favors required—just SQL.
-
FluentD fluentd.org
An open source data collector for unified logging layer.
-
Apache Beam beam.apache.org
A unified programming model that implements both batch and streaming data processing jobs that run on many execution engines.
-
Apache Tez tez.apache.org
An application framework which allows for a complex directed-acyclic-graph of tasks for processing data.
-
Apache Sqoop sqoop.apache.org
A tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases.
-
Apache Samza samza.apache.org
A distributed stream processing framework.
-
OpenTSDB opentsdb.net
distributed time series database on top of HBase.
-
Apache Oozie oozie.apache.org
A workflow scheduler system to manage Apache Hadoop jobs.
-
Apache NiFi nifi.apache.org
An easy to use, powerful, and reliable system to process and distribute data.
-
Apache Mahout mahout.apache.org
An environment for quickly creating scalable performant machine learning applications.
-
Apache Solr lucene.apache.org
Search platform for Apache Lucene.
-
Apache Hive hive.apache.org
Data warehouse software facilitates querying and managing large datasets residing in distributed storage.
-
Apache HBase hbase.apache.org
The Hadoop database, a distributed, scalable, big data store.
-
Hue gethue.com
web application for interacting with Hadoop.
-
Apache Drill drill.apache.org
Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud Storage.
-
Cascading cascading.org
Java based application development platform.
-
Apache Calcite calcite.apache.org
framework that allows efficient translation of queries involving heterogeneous and federated data.
-
Azkaban azkaban.github.io
A batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy-to-use web user interface to maintain and track your workflows.
-
Apache Ambari ambari.apache.org
operational framework for Hadoop management.
-
Spark in Action manning.com
New book in the Manning's "in action" family with +400 pages. Starts gently, step-by-step and covers large number of topics. Free excerpt on how to setup Eclipse for Spark application development and how to bootstrap a new application using the provided Maven Archetype. You can…
-
plot.ly plot.ly
Easy-to-use web service that allows for rapid creation of complex charts, from heatmaps to histograms. Upload data to create and style charts with Plotly's online spreadsheet. Fork others' plots.
-
d3plus d3plus.org
D3's simpler, easier to use cousin. Mostly predefined templates that you can just plug data in.
-
QuestDB questdb.io
A relational column-oriented database designed for real-time analytics on time series and event data.
-
NVD3.js nvd3.org
chart components for d3.js.
-
Machine Learning, Data Science and Deep Learning with Python manning.com
LiveVideo tutorial that covers machine learning, Tensorflow, artificial intelligence, and neural networks.
-
Dx-react-chart-Material-UI devexpress.github.io
Charts for Material-UI that visualizes data using a variety of series types, including bar, line, area, scatter, pie, and more.
-
Google Charts developers.google.com
Maps are dialed in (of course) and some cool animation options. Extensive docs and use community (forum).
-
dc.js dc-js.github.io
D3 Library with crossfilter support
-
DuckDB duckdb.org
in-process SQL OLAP Database Management System. [MIT] website
-
Redshift aws.amazon.com
A fast, fully managed, petabyte-scale data warehouse that makes it simple and cost-effective to analyze all your data using your existing business intelligence tools.
-
Relational Database Service (RDS) aws.amazon.com
Makes it easy to set up, operate, and scale a relational database in the cloud.
-
Kinesis aws.amazon.com
A fully managed, cloud-based service for real-time data processing over large, distributed data streams.
-
neo4j neo4j.com
The leading graph database!
-
Kubernetes kubernetes.io
Manage a cluster of Linux containers as a single system to accelerate Dev and simplify Ops.
-
2012 vldb.org
Twitter - The Unified Logging Infrastructure for Data Analytics at Twitter.
-
Twitter Finagle twitter.github.io
asynchronous network stack for the JVM.
-
Trino trino.io
distributed SQL query engine for querying large datasets across heterogeneous data sources.
-
Terraform terraform.io
infrastructure as code tool for provisioning and managing cloud and on-premises infrastructure.
-
LMDB symas.com
ultra-fast, ultra-compact key-value embedded data store developed by Symas.
-
Google BigTable static.googleusercontent.com
column-oriented distributed datastore.
-
Splice Machine splicemachine.com
a full-featured SQL-on-Hadoop RDBMS with ACID transactions.
-
Serf serf.io
decentralized solution for service discovery and orchestration.
-
2007 read.seas.harvard.edu
Amazon - Dynamo: Amazon’s Highly Available Key-value Store.
-
Query.me query.me
collaborative SQL notebooks for querying, scheduling, and sharing reporting workflows.
-
OpenMPI open-mpi.org
message passing framework.
-
Lily HBase Indexer ngdata.github.io
quickly and easily search for any content stored in HBase.
-
Metricsgraphic.js metricsgraphicsjs.org
a library built on top of D3 that is optimized for time-series data
- next page of items loading…
