Big Data
645 items from 0xnr/awesome-bigdata ★14,672
-
Apache Mesos mesos.apache.org
cluster manager.
-
Kylin kylin.apache.org
open source Distributed Analytics Engine from eBay.
-
Apache JMeter jmeter.apache.org
load testing tool for measuring performance of services and distributed systems.
-
JanusGraph janusgraph.org
open-source, distributed graph database with multiple options for storage backends (Bigtable, HBase, Cassandra, etc.) and indexing backends (Elasticsearch, Solr, Lucene).
-
IPython ipython.org
provides a rich architecture for interactive computing.
-
Indicative indicative.com
Web & mobile analytics tool, with data warehouse (AWS, BigQuery) integration.
-
Apache Helix helix.apache.org
cluster management framework.
-
HASH hash.ai
open source simulation and visualization platform.
-
Graylog graylog.org
log management platform for collecting, storing, searching, and alerting on machine data.
-
Apache Gora gora.apache.org
framework for in-memory data model and persistence.
-
EventStore geteventstore.com
distributed time series database.
-
Kibana elastic.co
visualize logs and time-stamped data
-
Domino dominodatalab.com
Run, scale, share, and deploy models — without any infrastructure.
-
Count count.co
notebook-based anlytics and visualisation platform using SQL or drag-and-drop.
-
Bokeh bokeh.pydata.org
A powerful Python interactive visualization library that targets modern web browsers for presentation, with the goal of providing elegant, concise construction of novel graphics in the style of D3.js, but also delivering this capability with high-performance interactivity over…
-
Azure IoT Hub azure.microsoft.com
Cloud-based bi-directional monitoring and messaging hub
-
Axibase Time Series Database axibase.com
Integrated time series database on top of HBase with built-in visualization, rule-engine and SQL support.
-
Splunk Website splunk.com
Splunk's Homepage.
-
VoltDB voltdb.com
An ACID-compliant RDBMS which uses a shared nothing architecture.
-
Vertica vertica.com
Distributed, MPP columnar database with extensive analytics SQL.
-
TimescaleDB timescale.com
Built as an extension on top of PostgreSQL, TimescaleDB is a time-series SQL database providing fast analytics, scalability, with automated data management on a proven storage engine.
-
Redis redis.io
An open source, BSD licensed, advanced key-value cache and store.
-
rawquery rawquery.dev
Managed lakehouse platform on Apache Iceberg with DuckDB query compute, S3 storage, Postgres wire protocol, and SQL transforms.
-
RavenDB ravendb.net
Fully Transactional NoSQL Document Database.
-
OrientDB orientdb.com
2nd Generation Distributed Graph Database with the flexibility of Documents in one product with an Open Source commercial friendly license.
-
MariaDB mariadb.org
An enhanced, drop-in replacement for MySQL.
-
Apache Hudi hudi.apache.org
An open source framework for managing storage for real time processing, one of the most interesting feature is the Upsert.
-
GreatExpectation greatexpectations.io
Open Source data validation framework to manage data quality. Users can define and document “expectations” rules about how data should look and behave.
-
GlusterFS gluster.org
Gluster Filesystem.
-
Estuary Flow estuary.dev
No/low-code data pipeline platform that handles both batch and real-time data ingestion.
-
Embulk embulk.org
An open source bulk data loader that helps data transfer between various databases, storages, file formats, and cloud services.
-
DataRaven dataraven.io
Managed cloud object storage transfers for ingestion workflows.
-
Akka Toolkit akka.io
runtime for distributed, and fault tolerant event-driven applications on the JVM.
-
Aerospike aerospike.com
NoSQL flash-optimized, in-memory. Open source and "Server code in 'C' (not Java or Erlang) precisely tuned to avoid context switching and memory copies."
-
Riak-TS basho.com
Riak TS is the only enterprise-grade NoSQL time series database optimized specifically for IoT and Time Series data.
-
ArcadeDB arcadedb.com
Open-source multi-model database with native graph, document, key-value, and vector support. SQL, Cypher, and Gremlin query languages. Apache 2.0 license.
-
Alluxio alluxio.org
A memory-centric distributed storage system enabling reliable data sharing at memory-speed across cluster frameworks, such as Spark and MapReduce.
-
Ably ably.com
Pub/sub messaging platform for IoT
-
Apache Tajo tajo.apache.org
distributed data warehouse system on Hadoop.
-
Presto prestodb.io
distributed SQL query engine.
-
Apache Pig pig.apache.org
high level language to express data analysis programs for Hadoop.
-
Apache Nutch nutch.apache.org
open source web crawler.
-
Apache Kudu kudu.apache.org
Hadoop's storage layer to enable fast analytics on fast data.
-
Apache Knox Gateway knox.apache.org
single point of secure access for Hadoop clusters.
-
Apache Hadoop hadoop.apache.org
framework for distributed processing. Integrates MapReduce (parallel processing), YARN (job scheduling) and HDFS (distributed file system).
-
Apache Flume flume.apache.org
service to manage large amount of log data.
-
Apache Falcon falcon.apache.org
data management framework.
-
How to monitor Hadoop metrics datadoghq.com
Guide to monitoring Hadoop, with an overview of Hadoop architecture, and native methods for metrics collection.
-
Apache Curator curator.apache.org
Java libraries for Apache ZooKeeper.
-
Apache Crunch crunch.apache.org
a simple Java API for tasks like joining and data aggregation that are tedious to implement on plain MapReduce.
- next page of items loading…
