AI concepts tagged “routing”

Models & Architecture

Mixture of Experts (MoE): Sparse Model Routing

A Mixture of Experts model uses a learned router to send each input, or each token in many transformer implementations, through only a selected subset of expert subnetworks.