stuck repeating "actually let me act"

#7
by nabelekm - opened

Using pi harness with 256k context, single stream, running SGLang it degrades over time (after few compactions) to constant repetition within CoT. In my case it ends up infinitely repeating

 Let me actually check the actual ACT β€” the actual issue β€” actually the actual issue β€” actually the ACT β€” actually ACT  
 β€” "ACT" OK actually let me ACT β€” actually the actual issue β€” actually the actual ACT β€” actually the ACT β€” ACT          
 β€”Actually the ACTACT ACTACT ACT ACTACT ACTACT ACT the ACTACT ACT ACT ACT ACT ACT ACT ACT ACT ACT ACTACT ACT ACTACT     
 ACTACT ACTACT ACT ACT ACT ACT"ACT"OK actually the ACT β€” ACT actually ACTACT ACT ACT ACT ACT ACT ACT ACTACT ACT ACT ACT 
 ACT ACT 

increase temp or rep penalty πŸ€—

Sign up or log in to comment