GitHub - SamsungLabs/LittleBit: Official implementation of LittleBit (NeurIPS 2025) and its follow-up LittleBit-2 (ICML 2026)
The LittleBit Project
Sub-1-Bit LLM Compression via Latent Factorization
Official implementation of LittleBit (NeurIPS 2025) and LittleBit-2 (ICML 2026).
Papers
LittleBit-2: Maximizing the Spectral Energy Gain in Sub-1-Bit LLMs via Latent Geometry Alignment (ICML 2026)
Banseok Lee, Youngmin Kim
LittleBit: Ultra Low-Bit Quantization via Latent Factorization (NeurIPS 2025)
Banseok Lee*, Dongkyu Kim*, Youngcheon You, Youngmin Kim
Abstract
LittleBit compresses large language models into the sub-1-bi...
Read more at github.com
© News Score score the news, sort the news, rewrite the headlines