Tag: Mixture-of-Experts

Soofi Consortium Launches Open Hybrid Mamba-Transformer MoE Model for German and English

The German Soofi Consortium has released Soofi S 30B-A3B, an open-source hybrid Mamba-Transformer Mixture-of-Experts foundation model designed for both German and English languages.

Read more

Tencent’s Hy3 Open-Source AI Model Claims Efficiency Gains with MoE Architecture

Tencent has released Hy3, an open-source language model utilising a Mixture-of-Experts (MoE) architecture. The company claims Hy3 matches larger models in performance while significantly reducing…

Read more