Tag: foundation models

Induction Labs Photon-1: A Foundation Model That Learns Tasks From Raw Video Alone

Induction Labs’ Photon-1, a sparse 106B-parameter MoE model, pretrains on 18 years of computer screen recordings without any action labels, then learns to complete tasks…

Read more

Soofi Consortium Launches Open Hybrid Mamba-Transformer MoE Model for German and English

The German Soofi Consortium has released Soofi S 30B-A3B, an open-source hybrid Mamba-Transformer Mixture-of-Experts foundation model designed for both German and English languages.

Read more