Big Data
1,992 items in 9 lists
-
Twitter Twemcache github.com
fork of Memcache.
-
BayesDB github.com
statistic oriented SQL database.
-
mysql_utils github.com
Pinterest MySQL Management Tools.
-
Hermes github.com
asynchronous message broker built on top of Kafka.
-
Snakebite github.com
A pure python HDFS client.
-
Heroic github.com
A scalable time series database based on Cassandra and Elasticsearch, by Spotify.
-
python-deequ github.com
Python API for Deequ.
-
White Elephant github.com
log aggregator and dashboard.
-
Gazette github.com
Distributed streaming infrastructure built on cloud storage which makes it easy to mix and match batch and streaming paradigms.
-
Photon ML github.com
A machine learning library supporting classical Generalized Mixed Model and Generalized Additive Mixed Effect Model.
-
Rakam github.com
open-source real-time custom analytics platform powered by Postgresql, Kinesis and PrestoDB.
-
FirstData github.com
The world's most comprehensive authoritative data source knowledge base. 210+ curated sources from governments, international organizations, and research institutions. MCP integration for AI agents. MIT licensed.
-
chispa github.com
PySpark test helpers with beautiful error messages.
-
Seaweed File System github.com
Fast, Simple and Scalable Distributed File System with O(1) disk seek.
-
spark-daria github.com
A Scala library with essential Spark functions and extensions to make you more productive.
-
sequenceiq/docker-spark github.com
Yarn images from SequenceIQ.
-
GhostDB github.com
a distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale.
-
Apache Toree github.com
IPython protocol based middleware for interactive applications.
-
Hannibal github.com
Tool to monitor and maintain HBase clusters.
-
Mongo-Spark github.com
Official MongoDB connector.
-
D3.compose github.com
Compose complex, data-driven visualizations from reusable charts and components.
-
quinn github.com
A native PySpark implementation of spark-daria.
-
dash-cytoscape github.com
-
Archives Unleashed Toolkit github.com
Open-source toolkit for analyzing web archives.
-
Gockerize github.com
Package golang service into minimal Docker containers.
-
Flintrock github.com
A command-line tool for launching Spark clusters on EC2.
-
dbmask github.com
Open-source tool that scans SQL databases for sensitive columns, masks them with deterministic fakes, and validates the masked copy row by row against the original.
-
Scikit-network github.com
-
IonDB github.com
A key-value store for microcontroller and IoT applications.
-
MemDB github.com
Distributed Transactional In-Memory Database (based on MongoDB).
-
LinkedIn Cleo github.com
is a flexible software library for enabling rapid development of partial, out-of-order and real-time typeahead search.
-
visNetwork github.com
-
ElephantDB github.com
Distributed database specialized in exporting data from Hadoop.
-
Eventsim github.com
Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.
-
Popoto.js github.com
-
dvt github.com
Data Validation Tool compares data from source and target tables to ensure that they match. It provides column validation, row validation, schema validation, custom query validation, and ad hoc SQL exploration.
-
Edis github.com
is a protocol-compatible Server replacement for Redis.
-
SiriDB github.com
Highly-scalable, robust and fast, open source time series database with cluster functionality.
-
Spark XML github.com
XML parser and writer.
-
kafkat github.com
Simplified command-line administration for Kafka brokers.
-
nxviz github.com
-
Kotlin for Apache Spark github.com
Kotlin API bindings and extensions.
-
Spring XD github.com
distributed and extensible system for data ingestion, real time analytics, batch processing, and data export.
-
Storehaus github.com
library to work with asynchronous key value stores, by Twitter.
-
Lipstick github.com
-
spark-fast-tests github.com
A lightweight and fast testing framework.
-
IndexR github.com
an open-source columnar storage format for fast & realtime analytic with big data.
-
sparkle github.com
Haskell on Apache Spark.
-
AddThis Hydra github.com
distributed data processing and storage system originally developed at AddThis.
-
Dekart github.com
Open-source SQL to map platform for BigQuery, Snowflake, and PostGIS.
- next page of items loading…
