view reply Right, but wouldn't this be the case for any MOE model with a smaller amount of active params?