Repetitive Output

#2
by BBLL3456 - opened

Why asked to write longer output, the response are repetitive

For now, you could try to increase top_p (e.g., 0.8) and/or repetition_penalty (e.g., 1.1) and see if those hyper-parameters would help. The problem is being actively tracked.

jklj077 changed discussion status to closed

Sign up or log in to comment