dogear

enter for all results · esc to close

Hadoop

161 items from youngwookim/awesome-hadoop ★1,117

all kinds
  1. 0
    Apache AirFlow github.com
    tool category #bigdata link ↗

    a platform to programmatically author, schedule and monitor workflows.

  2. 0
    ORYX github.com
    tool category #machine-learning link ↗

    Lambda architecture platform built on Apache Spark and Apache Kafka with specialization for real-time large scale machine learning.

  3. 0
    Yelp/mrjob :fire::fire::fire::fire::fire: github.com
    tool category #aws link ↗
  4. 0
    Confluent Schema Registry (⭐2.4k) github.com
    tool category #integration link ↗

    Widely used registry for Kafka, providing a RESTful interface and compatibility checks for Avro, JSON Schema, and Protobuf schemas.

  5. 0
    PigPen github.com
    tool category #machine-learning link ↗

    map-reduce for Clojure which compiles to Apache Pig.

  6. 0
    Gobblin from LinkedIn github.com
    tool category #bigdata link ↗

    linkedin's universal data ingestion framework.

  7. 0
    PyHive github.com
    tool category #hadoop link ↗

    Python interface to Hive and Presto.

  8. 0
    HiBench github.com
    tool category #bigdata link ↗

    a Hadoop benchmark suite.

  9. 0
    YCSB github.com
    tool category #hadoop link ↗
  10. 0
    Elephant Bird github.com
    tool category #bigdata link ↗

    libraries for working with LZOP-compressed data.

  11. 0
    Suro github.com
    tool category #bigdata link ↗

    log agregattor like Storm and Samza based on Chukwa.

  12. 0
    Haeinsa github.com
    tool category #bigdata link ↗

    linearly scalable multi-row, multi-table transaction library for HBase based on Percolator.

  13. 0
    Banana github.com
    tool category #bigdata link ↗

    visualize logs and time-stamped data stored in Solr. Port of Kibana.

  14. 0
    happybase github.com
    tool category #hadoop link ↗

    Python client for HBase.

  15. 0
    hindex github.com
    tool category #hadoop link ↗

    Secondary index for HBase.

  16. 0
    Elasticsearch Hadoop github.com
    tool category #hadoop link ↗
  17. 0
    Apache Kafka kafka.apache.org
    site category #bigdata link ↗

    Publish-subscribe messaging rethought as a distributed commit log.

  18. 0
    Apache Cassandra cassandra.apache.org
    site category #bigdata link ↗

    The right choice when you need scalability and high availability without compromising performance.

  19. 0
    Apache Thrift thrift.apache.org
    site category #cpp link ↗

    Efficient cross-language IPC/RPC, works between C++, Java, Python, PHP, C#, and many more other languages. Originally developed by Facebook. [Apache2]

  20. 0
    Genie github.com
    tool category #hadoop link ↗
  21. 0
    hdfs - A native go client for HDFS github.com
    tool category #hadoop link ↗
  22. 0
    White Elephant github.com
    tool category #bigdata link ↗

    log aggregator and dashboard.

  23. 0
    Hannibal github.com
    tool category #hadoop link ↗

    Tool to monitor and maintain HBase clusters.

  24. 0
    Lipstick github.com
    tool category #hadoop link ↗
  25. 0
    Schema Registry UI github.com
    tool category #hadoop link ↗
  26. 0
    Apache Spark spark.apache.org
    site category #bigdata link ↗

    A multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters.

  27. 0
    ElasticSearch elastic.co
    site category #bigdata link ↗

    Search & Analyze Data in Real Time.

  28. 0
    Apache Avro avro.apache.org
    site category #bigdata link ↗

    Apache Avro™ is a data serialization system.

  29. 0
    Storm storm.apache.org
    site category #machine-learning link ↗

    A free and open source distributed realtime computation system.

  30. 0
    Flink flink.apache.org
    site category #machine-learning link ↗

    A streaming dataflow engine that provides data distribution, communication, and fault tolerance for distributed computations over data streams.

  31. next page of items loading…