#stream-processing (30 Repositories)
Ranked open-source repositories tagged with #stream-processing, scored by pull request acceptance likelihood and maintainer engagement velocity.
43.8%
91.4h
30 repositories tagged #stream-processing
koralium/flowtide
High-performance streaming SQL query engine designed for real-time data processing. Use cases include event-driven architectures, ETL pipelines, and modern data-intensive applications.
Banno/kafka4s
Functional programming with Kafka and Scala
wingfoil-io/wingfoil
graph based stream processing framework
numaproj/numaflow
Kubernetes-native platform to run massively parallel data/streaming jobs
apache/hudi
Upserts, Deletes And Incremental Processing on Big Data.
apache/streampipes
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
volga-project/volga
Real-time data processing/feature engineering tailored for modern AI/ML systems.
gearpump/gearpump
Lightweight real-time big data streaming engine over Akka
p2panda/p2panda
All the things a panda needs
neo4j-contrib/neo4j-streams
Neo4j Kafka Connector
risingwavelabs/risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
MaterializeInc/materialize
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
redpanda-data/connect
Fancy stream processing made operationally mundane
vectordotdev/vector
A high-performance observability data pipeline.
microsoft/psi
Platform for Situated Intelligence
confluentinc/ksql
The database purpose-built for stream processing applications.
ArroyoSystems/arroyo
Distributed stream processing engine in Rust
spring-cloud/spring-cloud-stream
Framework for building Event-Driven Microservices
hazelcast/hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
fluvio-community/fluvio
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.
streamnative/pulsar-spark
Spark Connector to read and write with Pulsar
TomasMikula/libretto
Declarative concurrency and stream processing library for Scala
hstreamdb/hstream
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
FutureSDR/FutureSDR
An Async SDR Runtime for Heterogeneous Architectures
Kurento/kurento
Kurento WebRTC Media Server
zhisheng17/flink-learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
WallarooLabs/wally
Distributed Stream Processing
akka/akka-stream-contrib
Add-ons to Akka Stream
gazette/core
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
RedisGears/RedisGears
Dynamic execution framework for your Redis data