GitHub - tekaratzas/RustGPT: An transformer based LLM. Written completely in Rust
🦀 Rust LLM from Scratch
RustGPT-demo-zoon.mp4
A complete Large Language Model implementation in pure Rust with no external ML frameworks. Built from the ground up using only ndarray for matrix operations.
🚀 What This Is
This project demonstrates how to build a transformer-based language model from scratch in Rust, including:
Pre-training on factual text completion
Instruction tuning for conversational AI
Interactive chat mode for testing
Full backpropagation with gradient clipping
Modular arch...
Read more at github.com