Kolibri-1
Efficient bilingual MoE model for reasoning, coding, RAG, and agents
Kolibri-1 is Aleph Alpha’s open-weight bilingual Mixture-of-Experts reasoning model, designed for efficient German- and English-language AI systems. It contains 78B total parameters while activating only 3.46B per token, providing substantial model capacity with relatively low inference compute. Its 50-layer architecture uses 384 experts per layer, with six routed experts and one shared expert active during processing, alongside a 4:1 combination of sliding-window and grouped-query...