#edge-ai (30 Repositories)
Ranked open-source repositories tagged with #edge-ai, scored by pull request acceptance likelihood and maintainer engagement velocity.
41.9%
15.6h
30 repositories tagged #edge-ai
Helldez/BigMoeOnEdge
Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, lossless, on stock llama.cpp
xybrid-ai/xybrid
Cross-platform on-device AI toolkit
0xShug0/audio.cpp
An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python dependency.
ultralytics/yolov3
PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.
off-grid-ai/OGAM
The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.
DenisovAV/flutter_gemma
The Flutter plugin allows running the Gemma AI model locally on a device from a Flutter application.
SonySemiconductorSolutions/mct-model-optimization
Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.
beclab/Olares
Open-Source Personal Cloud OS for Always-On Agents
soniqo/speech-android
On-device speech SDK for Android — ASR, TTS, VAD, and noise cancellation powered by ONNX Runtime with Qualcomm NNAPI acceleration
google-ai-edge/litert-samples
LiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.
cactus-compute/needle
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
NVIDIA/DeepStream
NVIDIA DeepStream Monorepo: DeepStream SDK and reference apps for building GPU‑accelerated, real-time video and multi‑sensor analytics pipelines with GStreamer, TensorRT, and vision AI models across edge, on‑prem, and cloud deployments.
ArgoHA/D-FINE-seg
D-FINE-seg Object Detection and Segmentation Framework (Train, Export, Inference)
DenisovAV/flutter_edge_ai
On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.
ThinkOffApp/CarWatch
Your car as a chat-room agent: Raspberry Pi 5 + dashcam + local AI. CodeWatch's sibling for the garage.
mulgadc/spinifex
Open-source, AWS-compatible cloud for bare-metal, edge and on-premise. Run existing AWS CLI, SDK and Terraform workflows against EC2, EBS, S3, VPC, IAM, EKS and RDS on your own servers.
jegly/OfflineLLM
Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Acceleration
hailo-ai/hailo-apps-core
High-performance, optimized pre-trained template AI application pipelines for systems using Hailo devices
ai-hpc/ai-hardware-engineer-roadmap
Master AI inference, AI agent harness systems, and hardware engineering — then design a physical AI chip. That is the goal.
google-ai-edge/LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
OpenSparX/MasterAgent
Build AI agents that run 100% on-device. Sub-100ms latency on Qualcomm NPU. Zero cloud dependency.
feder-cr/jev
jevos is an open-source alternative to Jev for yes/no decisions that runs on your laptop.
mit-han-lab/once-for-all
[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment
mantisfury/ArkhamMirror
Local-first AI-powered document intelligence platform for investigative journalism
facex-engine/facex
Full face stack that runs entirely in the browser. Detection, 576-point 3D mesh, recognition, anti-spoof, smile — all WebAssembly, zero server. Apache 2.0.
sipeed/MaixPy-v1
MicroPython for K210 RISC-V, let's play with edge AI easier
hailo-ai/hailort
An open source light-weight and high performance inference framework for Hailo devices
FedML-AI/FedML
FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.
Pangu-Immortal/MagicWX
Android 17 local LLM prototype with Jetpack Compose and ONNX Runtime for offline AI inference experiments.
krillclaw/KrillClaw
The world's smallest AI agent runtime. 49KB. Written in Zig. Zero dependencies.