VIDRAFT Releases Aether-7B-5Attn: A Fully Open-Source MoE LLM with Five Heterogeneous Attention Mechanisms

VIDRAFT Releases Aether-7B-5Attn: A Fully Open-Source MoE LLM with Five Heterogeneous Attention Mechanisms TL;DR: Korean AI startup VIDRAFT has released Aether-7B-5Attn , a 6.59B-parameter Mixture-of-...