#big-data (30 Repositories)
Ranked open-source repositories tagged with #big-data, scored by pull request acceptance likelihood and maintainer engagement velocity.
70.9%
13.5h
30 repositories tagged #big-data
bodo-ai/Bodo
High Performance Scalable Data Processing in Python and SQL
apache/iotdb
Apache IoTDB
apache/zeppelin
Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
StarRocks/starrocks
The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.
ClickHouse/ClickBench
ClickBench: a Benchmark For Analytical Databases
apache/paimon
Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
apache/datafusion
Apache DataFusion SQL Query Engine
apache/paimon-rust
Apache Paimon Rust The rust implementation of Apache Paimon.
vespa-engine/vespa
The AI search platform
apache/beam
Apache Beam is a unified programming model for Batch and Streaming data processing.
apache/hugegraph
A graph database that supports more than 100+ billion data, high performance and scalability (Include OLTP Engine & REST-API & Backends)
G-Research/ParquetSharp
ParquetSharp is a .NET library for reading and writing Apache Parquet files.
apache/datafusion-ballista
Apache DataFusion Ballista Distributed Query Engine
apache/tsfile
Apache TsFile
NVIDIA/cudf-spark
NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs
apache/ozone
Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.
ClickHouse/ClickHouse
ClickHouse® is a real-time analytics database management system
prestodb/presto
The official home of the Presto distributed SQL query engine for big data
gchq/stroom
Stroom is a highly scalable data storage, processing and analysis platform.
apache/auron
Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.
apache/knox
Mirror of Apache Knox
uxlfoundation/oneDAL
oneAPI Data Analytics Library (oneDAL)
apache/ambari
Apache Ambari simplifies provisioning, managing, and monitoring of Apache Hadoop clusters.
delta-io/delta
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
lakehq/sail
Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.
trinodb/trino
Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)
apache/calcite
Apache Calcite
apache/fluss
Apache Fluss is a streaming storage built for real-time analytics.