#apache-spark (30 Repositories)
Ranked open-source repositories tagged with #apache-spark, scored by pull request acceptance likelihood and maintainer engagement velocity.
11.8%
5.7h
30 repositories tagged #apache-spark
mlflow/mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
kubeflow/spark-operator
Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.
graphframes/graphframes
GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs
exacaster/lighter
REST API for Apache Spark on K8S or YARN
kubeflow/mcp-apache-spark-history-server
MCP Server and CLI for Apache Spark History Server. Debug Spark applications from AI agents, scripts, or the terminal.
aloneguid/parquet-dotnet
Fully managed Apache Parquet implementation
dataflint/spark
Drop-in replacement for Apache Spark UI
streamnative/pulsar-spark
Spark Connector to read and write with Pulsar
sparklyr/sparklyr
R interface for Apache Spark
MingChen0919/learning-apache-spark
Notes on Apache Spark (pyspark)
cartershanklin/pyspark-cheatsheet
PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
dmmiller612/sparktorch
Train and run Pytorch models on Apache Spark.
hortonworks-spark/spark-atlas-connector
A Spark Atlas connector to track data lineage in Apache Atlas
tweag/sparkle
Haskell on Apache Spark.
opencypher/morpheus
Morpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.
feathr-ai/feathr
Feathr – A scalable, unified data and AI engineering platform for enterprise
Hydrospheredata/mist
Serverless proxy for Spark cluster
MemVerge/splash
Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
LucaCanali/sparkMeasure
This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simplifies collecting, aggregating, and exporting Spark task/stage metrics, and is designed for practical use by developers and data engineers in interactive analysis, testing, and production monitoring workflows.
jgperrin/net.jgp.books.spark.ch01
Spark in Action, 2nd edition - chapter 1 - Introduction
spark-notebook/spark-notebook
Interactive and Reactive Data Science using Scala and Spark.
archivesunleashed/aut
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
vinta/albedo
A recommender system for discovering GitHub repos, built with Apache Spark
databricks/LearningSparkV2
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
nchammas/flintrock
A command-line tool for launching Apache Spark clusters.
SANSA-Stack/SANSA-Stack
Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/
Azure/azure-event-hubs-spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
datamechanics/delight
A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
lw-lin/CoolplaySpark
酷玩 Spark: Spark 源代码解析、Spark 类库等
microsoft/Mobius
C# and F# language binding and extensions to Apache Spark