0.01.321.361 I cmn init: llama threadpool init, n_threads = 16 0.01.446.694 I 0.01.446.805 I system_info: n_threads = 16 (n_threads_batch = 16) / 192 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | AMX_INT8 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | 0.01.446.823 I perplexity: tokenizing the input .. 0.02.276.737 I perplexity: tokenization took 829.903 ms 0.02.276.945 I perplexity: calculating perplexity over 16 chunks, n_ctx=512, batch_size=512, n_seq=1 0.05.073.679 I perplexity: 2.80 seconds per pass - ETA 0.73 minutes [1]18.2490,[2]22.6034,[3]23.5732,[4]24.1180,[5]22.7978,[6]24.8210,[7]25.0443,[8]26.6022,[9]26.3313,[10]26.4278,[11]26.0816,[12]26.7523,[13]26.3263,[14]25.5603,[15]26.2636,[16]24.4135, 0.46.897.942 I Final estimate: PPL = 24.4135 +/- 1.56769