frisbeeman

IceGate is an open source Observability Data Lake engine written in Rust. It ingests logs, metrics, traces and events over the OpenTelemetry protocol (OTLP gRPC and HTTP) and persists everything (write-ahead log, catalog metadata and the data layer) in S3-compatible object storage, with no OLTP ... [More] database and no Kafka in the path. Storage is Apache Iceberg with a custom S3-backed catalog that provides ACID transactions and exactly-once ingest. Queries run through Apache DataFusion and Apache Arrow, exposed over Arrow Flight SQL plus Loki- and Tempo-compatible read APIs. Ingest, query, maintain and alert compute scale independently of storage. [Less]