What are the Recommended Sampling Parameters of this model?
Temperature 0.6 and repetition penalty 1.0, what about top p and top k?
Hello, please find the recommended configs in our open-sourced inference scripts HERE
· Sign up or log in to comment
