SemiAnalysis on Computation and Data Movement for MoE Inference
Newsletter SemiAnalysis
SemiAnalysis analyzes the infrastructure architecture of Mixture of Experts inference, detailing how memory movement, orchestration, and hardware topologies support disaggregated prefill, midfill, decode attention, and decode expert stages.