dogear

enter for all results · esc to close

Big Data

1,992 items in 9 lists

  1. librdkafka github.com

    Apache Kafka client library for C and C++. [BSD-2-Clause]

    tool link ↗
  2. adam github.com

    Set of tools designed to analyse genomics data.

    tool link ↗
  3. eliasdb github.com

    Dependency-free, transactional graph database with REST API, phrase search and SQL-like query language.

  4. Snappydata github.com

    OLTP + OLAP Database built on Apache Spark.

  5. H2O Sparkling Water github.com

    H2O interoperability layer.

    tool link ↗
  6. Shapley github.com

    A data-driven framework to quantify the value of classifiers in a machine learning ensemble.

  7. Actionbase github.com

    A database for user interactions (likes, views, follows) represented as graphs, with precomputed reads served in real-time.

  8. Marathon github.com

    Mesos framework for long-running services.

    tool link ↗
  9. Facebook Scribe github.com

    streamed log data aggregator.

    tool link ↗
  10. BIDMach github.com

    CPU and GPU-accelerated Machine Learning Library.

  11. MLPNeuralNet github.com

    Fast multilayer perceptron neural network library for iOS and Mac OS X.

  12. deequ github.com

    Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

    tool link ↗
  13. Twitter Heron github.com

    Heron is a realtime, distributed, fault-tolerant stream processing engine from Twitter replacing Storm.

    tool link ↗
  14. Atlas github.com

    a backend for managing dimensional time series data.

  15. Akumuli github.com

    A numeric time-series database. It can be used to capture, store and process time-series data in real-time. The word "akumuli" can be translated from esperanto as "accumulate".

  16. smart_open github.com

    Utils for streaming large files (S3, HDFS, gzip, bz2).

    tool link ↗
  17. Linkis github.com

    Linkis helps easily connect to various back-end computation/storage engines.

    tool link ↗
  18. Flocker github.com

    Easily manage Docker containers & their data.

  19. Suro github.com

    log agregattor like Storm and Samza based on Chukwa.

    tool link ↗
  20. Koalas github.com

    Pandas DataFrame API on top of Apache Spark.

  21. FlockDB github.com

    A distributed, fault-tolerant graph database by Twitter. Deprecated.

  22. skizze github.com

    A probabilistic data structure service and storage.

    tool link ↗
  23. DataSphere Studio github.com

    one-stop data application development management portal.

    tool link ↗
  24. Gravitino github.com

    An open-source, unified metadata management for data lakes, data warehouses, and external catalogs.

    tool link ↗
  25. Beringei github.com

    Facebook's in-memory time-series database.

  26. HStreamDB github.com

    The streaming database built for IoT data storage and real-time processing.

  27. Dalmatiner DB github.com

    Fast distributed metrics database.

  28. Haeinsa github.com

    linearly scalable multi-row, multi-table transaction library for HBase based on Percolator.

    tool link ↗
  29. Banana github.com

    visualize logs and time-stamped data stored in Solr. Port of Kibana.

    tool link ↗
  30. Baidu File System github.com

    distributed filesystem.

    tool link ↗
  31. spark-jobserver github.com

    Simple Spark as a Service which supports objects sharing using so called named objects. JVM only.

    tool link ↗
  32. LightGraphs github.com

    tool link ↗
  33. elasticsearch-jdbc github.com

    JDBC importer for Elasticsearch.

    tool link ↗
  34. Airpal github.com

    Web UI for PrestoDB.

    tool link ↗
  35. PipelineDB github.com

    The Streaming SQL Database.

  36. HAProxy Exporter github.com

    Simple server that scrapes HAProxy stats and exports them via HTTP for Prometheus consumption.

    tool link ↗
  37. kafka-node github.com

    Node.js client for Apache Kafka 0.8.

    tool link ↗
  38. happybase github.com

    Python client for HBase.

  39. PyGraphistry github.com

    tool link ↗
  40. Blueflood github.com

    A distributed system designed to ingest and process time series data.

    tool link ↗
  41. Pilosa github.com

    Open source distributed bitmap index that dramatically accelerates queries across multiple, massive data sets.

  42. hindex github.com

    Secondary index for HBase.

    tool link ↗
  43. GridDB github.com

    suitable for sensor data stored in a timeseries.

    tool link ↗
  44. Apache Sedona github.com

    Cluster computing system for processing large-scale spatial data.

    tool link ↗
  45. Kapacitor github.com

    an open source framework for processing, monitoring, and alerting on time series data.

  46. Apache Kyuubi github.com

    A distributed multi-tenant JDBC server for large-scale data processing and analytics, built on top of Apache Spark.

    tool link ↗
  47. Recline github.com

    simple but powerful library for building data applications in pure Javascript and HTML.

  48. Gobblin github.com

    Universal data ingestion framework for Hadoop from LinkedIn.

    tool link ↗
  49. Microsoft Graph Engine github.com

    a distributed in-memory data processing engine, underpinned by a strongly-typed in-memory key-value store and a general distributed computation engine.

    tool link ↗
  50. PyXley github.com

    Python helpers for building dashboards using Flask and React.

  51. next page of items loading…