#pretraining (8 Repositories)
Ranked open-source repositories tagged with #pretraining, scored by pull request acceptance likelihood and maintainer engagement velocity.
23.2%
0.1h
8 repositories tagged #pretraining
OpenWAM-Official/OpenWAM
Official repository for "OpenWAM: An Open, Modular Exploration Towards Systematic World–Action Model Pretraining".
baidu-baige/LoongForge
A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs. Supports Pi0.5, GR00T-N1.7, FastWAM, Cosmos3, DreamZero, DeepSeek-V4, GLM-5.3, Kimi-K3 and more.
microsoft/LMOps
General technology for enabling AI capabilities w/ LLMs and MLLMs
sapientinc/HRM-Text
HRM-Text is a 1B text generation model based on the HRM architecture, strengthened by task completion and latent space reasoning.
ChandlerBang/awesome-self-supervised-gnn
Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).
YehLi/xmodaler
X-modaler is a versatile and high-performance codebase for cross-modal analytics(e.g., image captioning, video captioning, vision-language pre-training, visual question answering, visual commonsense reasoning, and cross-modal retrieval).
Physics-Scaling/GeoPT
Official Code for "GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Training" (ICML 2026) https://arxiv.org/pdf/2602.20399
seal-rg/recurrent-pretraining
Pretraining and inference code for a large-scale depth-recurrent language model