Big Data
1,992 items in 9 lists
-
IFTTT ifttt.com
Easy-to-use platform that connects web services with simple conditional statements, empowering custom workflow creation.
-
parquet parquet.apache.org
Columnar storage format that uses the record shredding and assembly algorithm described in the Dremel paper.
-
Grai github.com
A data catalog tool that integrates into your CI system exposing downstream impact testing of data changes. These tests prevent data changes which might break data pipelines or BI dashboards from making it to production.
-
HanoiDB github.com
Erlang LSM BTree Storage.
-
Hivemall github.com
Scalable machine learning library for Hive/Hadoop.
-
packetpig github.com
-
Tigon github.com
High Throughput Real-time Stream Processing Framework.
-
Kyoto Tycoon github.com
A lightweight network server on top of the Kyoto Cabinet key-value database, built for high-performance and concurrency.
-
HiveRunner github.com
-
Damballa Parkour github.com
MapReduce library for Clojure.
-
spark-connect-go github.com
Golang bindings.
-
InfiniDB github.com
is accessed through a MySQL interface and use massive parallel processing to parallelize queries.
-
Joblib Apache Spark Backend github.com
joblib backend for running tasks on Spark clusters.
-
hadoopy github.com
-
docker-logstash github.com
A highly configurable Logstash (1.4.4) - Docker image running Elasticsearch (1.7.0) - and Kibana (3.1.2).
-
BayesNets.jl github.com
-
hdfs-du github.com
-
Crunch github.com
-
inviso github.com
-
Graphs.jl github.com
-
Zodiac github.com
A lightweight tool for easy deployment and rollback of dockerized applications.
-
shib github.com
-
Deep Spark github.com
Connecting Apache Spark with different data stores. Deprecated.
-
DQOps github.com
An open-source data quality platform for the whole data platform lifecycle from profiling new data sources to applying full automation of data quality monitoring.
-
TreodeDB github.com
key-value store that's replicated and sharded and provides atomic multirow writes.
-
PhyloNetworks.jl github.com
-
Crossdata github.com
Data integration platform with extended DataSource API and multi-user environment.
-
Tephra github.com
Transactions for HBase.
-
jLouvain github.com
-
Infovore github.com
RDF-centric Map/Reduce framework.
-
networkdata github.com
-
BTDB github.com
Key Value Database in .Net with Object DB Layer, RPC, dynamic IL and much more
-
linkpred github.com
-
edgebundle github.com
-
FileShot github.com
zero-knowledge encrypted file transfer for sharing large datasets.
-
PivotalR github.com
R on Pivotal HD / HAWQ and PostgreSQL.
-
Scriptella ETL github.com
Open-source, Java-based ETL and script execution tool for transferring and transforming data between databases, files, and other sources.
-
spark-connect-rs github.com
Rust bindings.
-
mpich2-yarn github.com
-
Oligrapher github.com
-
pg-kafka github.com
A PostgreSQL extension to produce messages to Apache Kafka.
-
MatrixNetworks.jl github.com
-
Velox github.com
System for serving machine learning predictions.
-
NetworkLayout.jl github.com
-
neo4r github.com
-
BDA github.com
The vulnerability detector for Hadoop and Spark
-
https://github.com/livingsocial/HiveSwarm github.com
-
IGraph/M github.com
-
-
OrionBelt Semantic Layer github.com
Open-source semantic sidecar that compiles YAML-defined dimensions, measures, and metrics into optimized SQL across 8 engines (BigQuery, ClickHouse, Databricks, Dremio, DuckDB, MySQL, PostgreSQL, Snowflake). Unified REST, MCP, and Postgres wire protocol; one model powers AI…
- next page of items loading…
