#on-device-ai (30 Repositories)
Ranked open-source repositories tagged with #on-device-ai, scored by pull request acceptance likelihood and maintainer engagement velocity.
65.4%
13.2h
30 repositories tagged #on-device-ai
xybrid-ai/xybrid
Cross-platform on-device AI toolkit
qualcomm/GenieX
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
tetherto/qvac
Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS, Windows, Android, iOS.
sarim2000/pennywiseai-tracker
PennyWise automatically reads transaction SMS messages and transforms them into organized financial data with on-device AI assistance. No manual entry, no cloud processing, complete privacy.
RunanywhereAI/runanywhere-sdks
Production ready toolkit to run AI locally
Muesli-HQ/muesli
Muesli: agent-native local meeting transcription + dictation for macOS (Granola + WisprFlow alternative)
RunanywhereAI/wally
Get up and running with GLM-5.3-flash, DeepSeek, Gemma and other open source frontier models.
pasrom/meeting-transcriber
On-device meeting transcriber for macOS — auto-records Teams/Zoom/Webex, transcribes & separates speakers locally. No cloud. Open-source alternative to Otter/Granola/Fireflies.
Sentient-OS-Labs/sentient-os
An on-device LLM understands your entire life, then proactively offers to get your work done through computer use.
bitwize-ai/Logue
A local-first workspace for documents, tasks and meetings on macOS — nested spaces, typed properties, relations and saved views, with transcription, Smart Minutes and an agent running entirely on-device via MLX on Apple Silicon
PrismML-Eng/Bonsai-Image-Demo
Generate images locally
software-mansion/react-native-executorch
High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime
DenisovAV/flutter_gemma
The Flutter plugin allows running the Gemma AI model locally on a device from a Flutter application.
saurabhav88/EnviousWispr
Free, sub-second on-device AI dictation for macOS. Dual engines (Whisper + Parakeet) on Apple Silicon. Optional AI polish on your Mac with EG-1 or S1-mini by Superwhisper, Apple Intelligence (macOS 26), Ollama, or your own OpenAI/Gemini/Claude key. Snippets, custom words, no account, no subscription, audio never leaves your Mac.
google-ai-edge/litert-samples
LiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.
thunderbird/thunderbolt
AI You Control: Choose your models. Own your data. Eliminate vendor lock-in.
drumih/turbo-fieldfare
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
CodeBySonu95/VoxSherpa-TTS
🎙️ VoxSherpa TTS Offline Neural Text-to-Speech Engine for Android ⚡ Sherpa-ONNX powered 🔊 Natural voice synthesis 📱 Fully offline processing 🚀 No cloud • No limits
SharpAI/SwiftLM
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
cactus-compute/needle
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
yanun0323/Whallm
DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash-FP8 inference in ~18 GB of RAM on any M-series MacBook
christopherkarani/Wax
Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API. One File. Pure Swift
leonickson1/Swiftlet
Swiftlet is a Swift and Metal runtime that runs large Qwen Mixture-of-Experts models locally on Apple devices by streaming expert weights from storage, enabling 35B and 80B models to run with low RAM, including on iPhone.
ShadowSafin/AndroLLM
Open-source Android AI using LiteRT-LM with hardware acceleration, cloud providers, memory, and voice.
DenisovAV/flutter_edge_ai
On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.
jegly/OfflineLLM
Private on-device AI chat for Android — runs any GGUF model locally via llama.cpp with ARM-optimised SIMD. Zero network permissions, encrypted settings, biometric lock, tamper detection. + GPU Acceleration
john-rocky/coreai-kit
Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download and caching, FoundationModels integration, and runnable examples with documented OS, SDK and model requirements.
google-ai-edge/LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
FluidInference/FluidUse
Local computer use on Apple silicon: on-device typed decisions with laya and form filling with CUA-S1-FORMS, driven through the macOS Accessibility API
woheller69/whisperIME
Android Input Method Editor (IME) based on Whisper