Research Aleph Alpha 03/10/2026 On the Day of German Reunification, we are releasing our new model: Kolibri. Kolibri is an English-German Mixture-of-Experts Transformer with 78B total parameters, 3B active. It supports context lengths of up to 1M tokens. The model can be downloaded with the full weights on Hugging Face and used under the Apache 2.0 license terms. Kolibri is the result of continuous iteration of our model training effort. We first built a model training pipeline and validated it ...