Verify early-exit EOS before terminating output

Fix early exit inference loop to eliminate redundant computation