Scaling MoE reinforcement learning on Amazon EKS with EFA and DeepEP with 40% more throughput

AWS proposed an architecture based on Amazon EKS, EFA and DeepEP to accelerate large-scale reinforcement learning post-training of MoE models, delivering 40% higher throughput. The solution targets workloads like RLHF, PPO and GRPO, addressing resource balancing between rollout generation and policy training, high-throughput communication across hundreds of accelerators, and the dynamic all-to-all token routing overhead introduced by Expert Parallelism.