Programming
Software development: programming languages, coding, libraries and frameworks, software engineering and architecture, source control, developer tools, databases, and infrastructure.
-
EventQL eventql.io
a distributed, column-oriented database built for large-scale event collection and analytics.
-
Apache Edgent (Incubating) edgent.apache.org
a programming model and micro-kernel style runtime that can be embedded in gateways and small footprint edge devices enabling local, real-time, analytics on the edge devices.
-
Dremio dremio.com
an open-source, SQL-like Data-as-a-Service Platform based on Apache Arrow.
-
Apache Doris doris.apache.org
real-time analytical database for high-concurrency SQL analytics, search, and warehousing.
-
Invantive SQL documentation.invantive.com
SQL engine for online and on-premise use with integrated local data replication and 70+ connectors.
-
Soda Core docs.soda.io
open-source Python library and CLI for data quality tests.
-
DataKitchen Open Source Data Observability docs.datakitchen.io
open-source data observability for monitoring data journeys, data quality, and pipeline events.
-
PredictionIO prediction.io
Machine Learning server for developers and data scientists to build and deploy predictive applications in a fraction of the time.
-
GraphLab Create dato.com
A machine learning platform in Python with a broad collection of ML toolkits, data engineering, and deployment tools.
-
Learning Spark, 2nd Edition oreilly.com
Introduction to Spark API with Spark 3.0 covered. Good source of knowledge about basic concepts.
-
Datasalt Splout SQL datasalt.com
full SQL query engine for big datasets.
-
datamechanics/spark hub.docker.com
An easy to setup Docker image for Apache Spark from Data Mechanics.
-
apache/spark hub.docker.com
Apache Spark Official Docker images.
-
Spark with Scala Gitter channel gitter.im
"A place to discuss and ask questions about using Scala for Spark programming" started by @deanwampler.
-
Cytoscape cytoscape.github.io
JavaScript library for visualizing complex networks.
-
Pydoop crs4.github.io
Python MapReduce and HDFS API for Hadoop.
-
Comet comet.com
Comet provides an end-to-end model evaluation platform for AI developers, with best in class LLM evaluations, experiment tracking, and production monitoring.
-
JAQL code.google.com
declarative programming language for working with structured, semi-structured and unstructured data.
-
Google Cloud SQL cloud.google.com
MySQL databases in Google's cloud.
-
Google Cloud Datastore cloud.google.com
is a fully managed, schemaless database for storing non-relational data over BigTable.
-
ClickHouse clickhouse.com
an open-source column-oriented database management system that allows generating analytical data reports in real time.
-
CitusDB citusdata.com
scales out PostgreSQL through sharding and replication.
-
IronDB circonus.com
scalable, general-purpose time series database.
-
Ceph Filesystem ceph.com
software storage platform designed.
-
jupyter/docker-stacks/pyspark-notebook github.com
PySpark with Jupyter Notebook and Mesos client.
-
Fundamentals of Stream Processing: Application Design, Systems, and Analytics cambridge.org
This comprehensive, hands-on guide combining the fundamental building blocks and emerging research in stream processing is ideal for application designers, system builders, analytic developers, as well as students and researchers in the field.
-
Twitter Manhattan blog.twitter.com
real-time, multi-tenant distributed database for Twitter scale.
-
Baidu Bigflow bigflow.cloud
an interface that allows for writing distributed computing programs providing lots of simple, flexible, powerful APIs to easily handle data of any scale.
-
Microsoft Azure DocumentDB azure.microsoft.com
NoSQL cloud database service with protocol support for MongoDB
-
2013 amplab.cs.berkeley.edu
AMPLab - Shark: SQL and Rich Analytics at Scale.
-
Structured Streaming: A Declarative API for Real-Time Applications in Apache Spark cs.stanford.edu
Structured Streaming is a new high-level streaming API, it is a declarative API based on automatically incrementalizing a static relational query.
-
SparkR amplab-extras.github.io
R frontend for Spark.
-
Big Data Analysis with Scala and Spark (Coursera) coursera.org
Scala oriented introductory course. Part of Functional Programming in Scala Specialization.
-
Free Dev License dev.splunk.com
Request a free Splunk Developer license.
-
Splunk Dev dev.splunk.com
Develop on Splunk.
-
Quick Intelligence quickintelligence.co.uk
A blog where a skilled team of Qlik developers lead by Steve Dark, providing tips on working in Qlik Sense and QlikView.
-
QlikView Cookbook qlikviewcookbook.com
A technical 'how-to' blog for QlikView developers, by Rob Wunderlich.
-
QlikView 11 for Developers amazon.com
By Miguel García and Barry Harmsen.
-
Large-Scale Intelligent Microservices arxiv.org
Microsoft paper that presents an Apache Spark-based micro-service orchestration framework that extends database operations to include web service primitives.
-
Apache Spark User List apache-spark-user-list.1001560.n3.nabble.com
and Apache Spark Developers List - Mailing lists dedicated to usage questions and development topics respectively.
-
Spark SQL: Relational Data Processing in Spark amplab.cs.berkeley.edu
Paper introducing relational underpinnings, code generation and Catalyst optimizer.
-
Zingg zingg.ai
Open source Master Data Management platform using machine learning for entity resolution at scale. Native to Databricks, Microsoft Fabric, Snowflake, AWS, and GCP. Golden records are maintained through a persistent Zingg ID across all systems and sources.
-
Xquik xquik.com
Real-time X (Twitter) data extraction platform with REST API (76 endpoints), 20 bulk extraction tools, account monitoring, HMAC-signed webhooks, and MCP server for AI agent integration.
-
Titan titan.thinkaurelius.com
A scalable graph database optimized for storing and querying graphs containing hundreds of billions of vertices and edges distributed across a multi-machine cluster.
-
SuprSend suprsend.com
Create automated workflows and logic using API's for your notification service. Add templates, batching, preferences, inapp inbox with workflows to trigger notifications directly from your data warehouse.
-
DBConvert Streams streams.dbconvert.com
Self-hosted database migration and change data capture (CDC) tool with built-in SQL IDE.
-
stratif.io stratif.io
Open-source, self-hosted, warehouse-native product analytics. Runs funnels, retention, and paths directly on DuckDB, Postgres, Snowflake, or ClickHouse.
-
SSDB ssdb.io
A high performance NoSQL database supporting many data structures, an alternative to Redis.
-
SQLMesh sqlmesh.readthedocs.io
An open-source data transformation framework for managing, testing, and deploying SQL and Python-based data pipelines with version control, environment isolation, and automatic dependency resolution.
-
Spark Playground sparkplayground.com
Write, run, and test PySpark code on Spark Playground's online compiler. Access real-world sample datasets & solve interview questions to enhance your PySpark skills for data engineering roles.
- next page of items loading…
