Big Data
1,992 items in 9 lists
-
Apache AirFlow github.com
a platform to programmatically author, schedule and monitor workflows.
-
Milvus github.com
Milvus is a vector database for embedding management, analytics and search.
-
FAISS github.com
A library for efficient similarity search and clustering of dense vectors. [MIT]
-
Karate Club github.com
An unsupervised machine learning library for graph-structured data.
-
LevelDB github.com
A fast key-value storage library written at Google that provides an ordered mapping from string keys to string values. [BSD]
-
cockroach github.com
Scalable, Geo-Replicated, Transactional Datastore.
-
ORYX github.com
Lambda architecture platform built on Apache Spark and Apache Kafka with specialization for real-time large scale machine learning.
-
InfluxDB github.com
Scalable datastore for metrics, events, and real-time analytics.
-
Feast github.com
A feature store for the management, discovery, and access of machine learning features. Feast provides a consistent view of feature data for both model training and model serving.
-
Multiwoven github.com
The open-source reverse ETL, data activation platform for modern data teams. (using Rails 7.1.1) - 🌍
-
Aim github.com
open-source AI metadata tracker for experiments and training runs.
-
dgraph github.com
Scalable, Distributed, Low Latency, High Throughput Graph Database.
-
cubism github.com
JavaScript library for time series visualization.
-
Blazer github.com
business intelligence made simple.
-
Infinity github.com
The AI-native database built for LLM applications, providing incredibly fast vector and full-text search. [Apache2]
-
peity github.com
Progressive SVG bar, line and pie charts.
-
rqlite github.com
The lightweight, distributed, relational database built on SQLite.
-
Nomad github.com
Easily deploy applications at any scale. A Distributed, Highly Available, Datacenter-Aware Scheduler.
-
Apache Pulsar (⭐15k) github.com
Versatile pub/sub and streaming platform offering scalable, low-latency messaging for modern applications.
-
cayley github.com
An open-source graph database. Google.
-
Bolt github.com
an embedded key-value database for Go.
-
Heka github.com
Data Acquisition and Processing Made Easy. Deprecated.
-
pytorch_geometric_temporal github.com
Temporal Extension Library for PyTorch Geometric.
-
Manticore Search github.com
An open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.
-
vega github.com
a visualization grammar.
-
DataComPy github.com
A library to compare Pandas, Polars, and Spark data frames. It provides stats and lets users adjust for match accuracy.
-
Keras github.com
An intuitive neural net API inspired by Torch that runs atop Theano and Tensorflow.
-
cocoindex github.com
ETL framework to build fresh context for AI agents, with incremental processing
-
arbor github.com
graph visualization library using web workers and jQuery.
-
Hamilton github.com
A microframework for dataframe generation that applies Directed Acyclic Graphs specified by a flow of lazily evaluated Python functions.
-
yugabyteDB github.com
open source, high-performance, distributed SQL database compatible with PostgreSQL.
-
Tile38 github.com
Geolocation DB with spatial index and realtime geofencing.
-
ElastAert github.com
ElastAlert is a simple framework for alerting on anomalies, spikes, or other patterns of interest from data in ElasticSearch.
-
H2O github.com
statistical, machine learning and math runtime with Hadoop. R and Python.
-
DiagrammeR github.com
-
snowplow/snowplow :fire::fire::fire::fire::fire: github.com
enterprise-strength web and event analytics, powered by Hadoop, Kinesis, Redshift and Postgres.
-
Kryo github.com
A fast and efficient object graph serialization framework for Java.
-
Freeboard github.com
pen source real-time dashboard builder for IOT and other web mashups.
-
Materialize github.com
Streaming SQL database powered by Timely Dataflow :heavy_dollar_sign:
-
NuPIC github.com
Numenta Platform for Intelligent Computing: a brain-inspired machine intelligence platform, and biologically accurate neural network based on cortical learning algorithms.
-
Lightdash github.com
The open source Looker alternative built on dbt
-
TDengine github.com
open-source time-series database with high-performance ingestion, SQL support, and IoT-oriented storage.
-
Microsoft ML for Apache Spark github.com
A distributed ml library with support for LightGBM, Vowpal Wabbit, OpenCV, Deep Learning, Cognitive Services, and Model Deployment.
-
buntdb github.com
Fast, embeddable, in-memory key/value database for Go with custom indexing and spatial support.
-
RudderStack github.com
A warehouse-first Customer Data Platform that enables you to collect data from every application, website and SaaS platform, and then activate it in your warehouse and business tools.
-
Spark NLP github.com
Natural language processing library built on top of Apache Spark ML.
-
aws-data-wrangler :fire::fire::fire::fire::fire: github.com
Utility belt to handle data on AWS.
-
Riak github.com
a decentralized datastore.
-
ingestr github.com
CLI tool to copy data between databases with a single command. Supports 50+ sources including PostgreSQL, MySQL, MongoDB, Salesforce, Shopify to any data warehouse.
-
TiKV github.com
a distributed key-value database powered by Rust and inspired by Google Spanner and HBase.
- next page of items loading…
