Giles Ecosystem
A distributed system based on Apache Kafka that allows users to upload documents for text and image extraction. It automatically performs OCR on uploaded images and extracts images and embedded texts from pdf files. The system can be easily scaled to accommodate higher workloads.
- from
- Digital Humanities
- added
- 2026-10-10
- likes
- 0
similar
-
xberg-io plugins github.com
A suite of Gemini CLI extensions from Kreuzberg, Inc.: document extraction (xberg — 97+ formats with OCR), web crawling (crawlberg), HTML→Markdown, a universal LLM client for 143 providers (liter-llm), and code intelligence for 300+ languages (tree-sitter-language-pack)…
-
pg-kafka github.com
A PostgreSQL extension to produce messages to Apache Kafka.
-
Gazette github.com
Distributed streaming infrastructure built on cloud storage which makes it easy to mix and match batch and streaming paradigms.
-
Kafka Connect kafka.apache.org
A tool for scalably and reliably streaming data between Apache Kafka and other systems.
-
Apache Kafka (⭐33k) github.com
Distributed, high-throughput system designed for real-time data streaming and fault-tolerant processing.
-
e-gs gs.ethz.ch
Digital Humanities › Document Management and Processing: “A distributed system based on Apache Kafka that allows users to upload documents for text and image extraction. It automatically performs OCR on uploaded images and extracts images and embedded texts from pdf files. The system can be easily scaled to accommodate higher workloads.”