#stream-processing (30 Repositories)
Ranked open-source repositories tagged with #stream-processing, scored by pull request acceptance likelihood and maintainer engagement velocity.
63.3%
24.8h
30 repositories tagged #stream-processing
numaproj/numaflow
Kubernetes-native platform to run massively parallel data/streaming jobs
risingwavelabs/risingwave
Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.
MaterializeInc/materialize
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
apache/streampipes
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
wingfoil-io/wingfoil
ultra low latency graph based stream processing framework
vectordotdev/vector
A high-performance observability data pipeline.
apache/hudi
Upserts, Deletes And Incremental Processing on Big Data.
timeplus-io/proton
The Fastest Unified Streaming SQL Engine in a Single C++ Binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute real-time context from streams, logs, metrics, events, and CDC.
ArroyoSystems/arroyo
Distributed stream processing engine in Rust
p2panda/p2panda
All the things a panda needs
redpanda-data/connect
Fancy stream processing made operationally mundane
confluentinc/ksql
The database purpose-built for stream processing applications.
koralium/flowtide
High-performance streaming SQL query engine designed for real-time data processing. Use cases include event-driven architectures, ETL pipelines, and modern data-intensive applications.
nerevu/riko
A Python stream processing engine modeled after Yahoo! Pipes
microsoft/psi
Platform for Situated Intelligence
spring-cloud/spring-cloud-stream
Framework for building Event-Driven Microservices
aleksandarskrbic/khaos
Kafka data generator and load testing tool - generate fake messages, simulate producers and consumers, test broker failures, and run chaos engineering scenarios
streamnative/function-mesh
The serverless framework purpose-built for event streaming applications.
neo4j-contrib/neo4j-streams
Neo4j Kafka Connector
RedisGears/RedisGears
Dynamic execution framework for your Redis data
akka/akka-stream-contrib
Add-ons to Akka Stream
gazette/core
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
Kurento/kurento
Kurento WebRTC Media Server
volga-project/volga
Unified real-time data engine
manuzhang/awesome-streaming
a curated list of awesome streaming frameworks, applications, etc
FutureSDR/FutureSDR
An Async SDR Runtime for Heterogeneous Architectures
zhisheng17/flink-learning
flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》
hazelcast/hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
gearpump/gearpump
Lightweight real-time big data streaming engine over Apache Pekko
fluvio-community/fluvio
🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.