#apache-spark (24 Repositories)
Ranked open-source repositories tagged with #apache-spark, scored by pull request acceptance likelihood and maintainer engagement velocity.
16.2%
5.4h
24 repositories tagged #apache-spark
mlflow/mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
graphframes/graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
kubeflow/mcp-apache-spark-history-server
MCP Server and CLI for Apache Spark History Server. Debug Spark applications from AI agents, scripts, or the terminal.
aloneguid/parquet-dotnet
Fully managed Apache Parquet implementation
LucaCanali/sparkMeasure
This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simplifies collecting, aggregating, and exporting Spark task/stage metrics, and is designed for practical use by developers and data engineers in interactive analysis, testing, and production monitoring workflows.
feathr-ai/feathr
Feathr – A scalable, unified data and AI engineering platform for enterprise
streamnative/pulsar-spark
Spark Connector to read and write with Pulsar
MemVerge/splash
Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
Hydrospheredata/mist
Serverless proxy for Spark cluster
tweag/sparkle
Haskell on Apache Spark.
opencypher/morpheus
Morpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.
jgperrin/net.jgp.books.spark.ch01
Spark in Action, 2nd edition - chapter 1 - Introduction
vinta/albedo
A recommender system for discovering GitHub repos, built with Apache Spark
SANSA-Stack/SANSA-Stack
Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/
cartershanklin/pyspark-cheatsheet
PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
MingChen0919/learning-apache-spark
Notes on Apache Spark (pyspark)
archivesunleashed/aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
dataflint/spark
Drop-in replacement for Apache Spark UI
databricks/LearningSparkV2
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Azure/azure-event-hubs-spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
dmmiller612/sparktorch
Train and run Pytorch models on Apache Spark.
hortonworks-spark/spark-atlas-connector
A Spark Atlas connector to track data lineage in Apache Atlas
kubeflow/spark-operator
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
datamechanics/delight
A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.