Programming
Software development: programming languages, coding, libraries and frameworks, software engineering and architecture, source control, developer tools, databases, and infrastructure.
-
Map-D mapd.com
GPU in-memory database, big data analysis and visualization platform.
-
Data Science at Scale with Python and Dask manning.com
Data Science at Scale with Python and Dask teaches you how to build distributed data projects that can handle huge amounts of data.
-
Azure Data Engineering manning.com
A book about data engineering in general and the Azure platform specifically
-
M3DB m3db.io
a distributed time series database that can be used for storing realtime metrics at long retention.
-
Lumify lumify.io
open source big data analysis and visualization platform
-
LanceDB lancedb.com
open-source embedded vector database built on the Lance columnar format.
-
Knowage knowage-suite.com
open source business intelligence platform. (former SpagoBi)
-
Facebook Apollo infoq.com
Facebook’s Paxos-like NoSQL database.
-
Ignite ignite.apache.org
is an in-memory key-value data store providing full SQL-compliant data access that can optionally be backed by disk storage.
-
H-Store hstore.cs.brown.edu
is an experimental main-memory, parallel database management system that is optimized for on-line transaction processing (OLTP) applications.
-
ENCOG heatonresearch.com
machine learning framework that supports a variety of advanced algorithms, as well as support classes to normalize and process data.
-
SAP HANA hana.sap.com
is an in-memory, column-oriented, relational database management system.
-
Torch github.com
A deep learning library with a Lua API, supported by NYU and Facebook.
-
Theano github.com
A Python-focused machine learning library supported by the University of Montreal.
-
RL4J github.com
Reinforcement learning for Java and Scala. Includes Deep-Q learning and A3C algorithms, and integrates with Open AI's Gym. Runs in the Deeplearning4j ecosystem.
-
Deeplearning4j github.com
Fast, open deep learning for the JVM (Java, Scala, Clojure). A neural network configuration layer powered by a C++ library. Uses Spark and Hadoop to train nets on multiple GPUs and CPUs.
-
CartoDB github.com
open-source or freemium hosting for geospatial databases with powerful front-end editing capabilities and a robust API.
-
Pivotal GemFire XD gemfire.docs.pivotal.io
Low-latency, in-memory, distributed SQL data store. Provides SQL interface to in-memory table data, persistable in HDFS.
-
FoundationDB foundationdb.com
distributed database, inspired by F1.
-
Flexmonster Pivot Table & Charts flexmonster.com
JavaScript component for pivot tables, charts, and web reporting.
-
EventQL eventql.io
a distributed, column-oriented database built for large-scale event collection and analytics.
-
Apache Edgent (Incubating) edgent.apache.org
a programming model and micro-kernel style runtime that can be embedded in gateways and small footprint edge devices enabling local, real-time, analytics on the edge devices.
-
Dremio dremio.com
an open-source, SQL-like Data-as-a-Service Platform based on Apache Arrow.
-
Apache Doris doris.apache.org
real-time analytical database for high-concurrency SQL analytics, search, and warehousing.
-
Invantive SQL documentation.invantive.com
SQL engine for online and on-premise use with integrated local data replication and 70+ connectors.
-
Soda Core docs.soda.io
open-source Python library and CLI for data quality tests.
-
DataKitchen Open Source Data Observability docs.datakitchen.io
open-source data observability for monitoring data journeys, data quality, and pipeline events.
-
PredictionIO prediction.io
Machine Learning server for developers and data scientists to build and deploy predictive applications in a fraction of the time.
-
GraphLab Create dato.com
A machine learning platform in Python with a broad collection of ML toolkits, data engineering, and deployment tools.
-
Learning Spark, 2nd Edition oreilly.com
Introduction to Spark API with Spark 3.0 covered. Good source of knowledge about basic concepts.
-
Datasalt Splout SQL datasalt.com
full SQL query engine for big datasets.
-
datamechanics/spark hub.docker.com
An easy to setup Docker image for Apache Spark from Data Mechanics.
-
apache/spark hub.docker.com
Apache Spark Official Docker images.
-
Spark with Scala Gitter channel gitter.im
"A place to discuss and ask questions about using Scala for Spark programming" started by @deanwampler.
-
Cytoscape cytoscape.github.io
JavaScript library for visualizing complex networks.
-
Pydoop crs4.github.io
Python MapReduce and HDFS API for Hadoop.
-
Comet comet.com
Comet provides an end-to-end model evaluation platform for AI developers, with best in class LLM evaluations, experiment tracking, and production monitoring.
-
JAQL code.google.com
declarative programming language for working with structured, semi-structured and unstructured data.
-
Google Cloud SQL cloud.google.com
MySQL databases in Google's cloud.
-
Google Cloud Datastore cloud.google.com
is a fully managed, schemaless database for storing non-relational data over BigTable.
-
ClickHouse clickhouse.com
an open-source column-oriented database management system that allows generating analytical data reports in real time.
-
CitusDB citusdata.com
scales out PostgreSQL through sharding and replication.
-
IronDB circonus.com
scalable, general-purpose time series database.
-
Ceph Filesystem ceph.com
software storage platform designed.
-
jupyter/docker-stacks/pyspark-notebook github.com
PySpark with Jupyter Notebook and Mesos client.
-
Fundamentals of Stream Processing: Application Design, Systems, and Analytics cambridge.org
This comprehensive, hands-on guide combining the fundamental building blocks and emerging research in stream processing is ideal for application designers, system builders, analytic developers, as well as students and researchers in the field.
-
Twitter Manhattan blog.twitter.com
real-time, multi-tenant distributed database for Twitter scale.
-
Baidu Bigflow bigflow.cloud
an interface that allows for writing distributed computing programs providing lots of simple, flexible, powerful APIs to easily handle data of any scale.
-
Microsoft Azure DocumentDB azure.microsoft.com
NoSQL cloud database service with protocol support for MongoDB
-
2013 amplab.cs.berkeley.edu
AMPLab - Shark: SQL and Rich Analytics at Scale.
- next page of items loading…
