lingtiny30vq3 / results /ppl_bf16.log
HelloSun's picture
LUT-VQ3-64: machine-tuned (threads/NUMA/ubatch), full 128k ctx data, one-click build, results
511ba50 verified
Raw History Blame Contribute Delete
4.25 kB
warning: no usable GPU found, --gpu-layers option will be ignored
warning: one possible reason is that llama.cpp was compiled without GPU support
warning: consult docs/build.md for compilation instructions
0.00.664.154 W load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
0.01.816.200 I cmn init: llama threadpool init, n_threads = 64
0.01.894.167 I
0.01.894.333 I system_info: n_threads = 64 (n_threads_batch = 64) / 80 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX_VNNI = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | AVX512 = 1 | AVX512_VBMI = 1 | AVX512_VNNI = 1 | AVX512_BF16 = 1 | AMX_INT8 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
0.01.894.339 I perplexity: tokenizing the input ..
0.02.484.198 I perplexity: tokenization took 589.852 ms
0.02.484.413 I perplexity: calculating perplexity over 256 chunks, n_ctx=512, batch_size=2048, n_seq=4
0.08.139.504 I perplexity: 5.66 seconds per pass - ETA 6.02 minutes
[1]8.1805,[2]12.6373,[3]11.8638,[4]12.3617,[5]12.6663,[6]13.1201,[7]13.8095,[8]14.2267,[9]14.9397,[10]15.5506,[11]15.7619,[12]16.0234,[13]16.0860,[14]15.7798,[15]15.4154,[16]15.8763,[17]14.5611,[18]14.6866,[19]14.8310,[20]14.5036,[21]14.3380,[22]14.1237,[23]13.6626,[24]13.2579,[25]12.8837,[26]12.7161,[27]12.0963,[28]11.9504,[29]11.9826,[30]11.7738,[31]11.9129,[32]11.9238,[33]12.0048,[34]12.2665,[35]12.3705,[36]12.5638,[37]12.6779,[38]12.8489,[39]12.7929,[40]12.7321,[41]12.7124,[42]12.6202,[43]12.7620,[44]12.7058,[45]12.6333,[46]12.8092,[47]12.7222,[48]12.9243,[49]12.9285,[50]12.9425,[51]13.0944,[52]13.1409,[53]13.1278,[54]13.1657,[55]13.2771,[56]13.3026,[57]13.3324,[58]13.3268,[59]13.4020,[60]13.4787,[61]13.5656,[62]13.6147,[63]13.6801,[64]13.8127,[65]13.9679,[66]14.0966,[67]14.2232,[68]14.3513,[69]14.2719,[70]14.3387,[71]14.4117,[72]14.4844,[73]14.5771,[74]14.5208,[75]14.5749,[76]14.5037,[77]14.4244,[78]14.3939,[79]14.3547,[80]14.1975,[81]14.1328,[82]14.0565,[83]14.0326,[84]14.0621,[85]14.1000,[86]14.0736,[87]14.1024,[88]14.0768,[89]14.1085,[90]14.0988,[91]14.0127,[92]13.9633,[93]13.9322,[94]13.8896,[95]13.9200,[96]13.9180,[97]13.9126,[98]13.9287,[99]13.8738,[100]13.8797,[101]13.8458,[102]13.8852,[103]13.9268,[104]13.9133,[105]14.0168,[106]13.9770,[107]13.9804,[108]13.9423,[109]13.9648,[110]14.0343,[111]14.1001,[112]14.2130,[113]14.3565,[114]14.3641,[115]14.2734,[116]14.3390,[117]14.3854,[118]14.3741,[119]14.3383,[120]14.2921,[121]14.2524,[122]14.2377,[123]14.2355,[124]14.2198,[125]14.1748,[126]14.1122,[127]14.0661,[128]14.0375,[129]13.9594,[130]13.9280,[131]13.8358,[132]13.7499,[133]13.7100,[134]13.6526,[135]13.6558,[136]13.6365,[137]13.6264,[138]13.6470,[139]13.6043,[140]13.5353,[141]13.5099,[142]13.5059,[143]13.5384,[144]13.5885,[145]13.5278,[146]13.5045,[147]13.5320,[148]13.5050,[149]13.4545,[150]13.4183,[151]13.3456,[152]13.2589,[153]13.1355,[154]13.0601,[155]13.0301,[156]13.0024,[157]12.9786,[158]12.9638,[159]12.8907,[160]12.8439,[161]12.7937,[162]12.7580,[163]12.7007,[164]12.6817,[165]12.6978,[166]12.6831,[167]12.7132,[168]12.6732,[169]12.6602,[170]12.6311,[171]12.6869,[172]12.6840,[173]12.7225,[174]12.7290,[175]12.7811,[176]12.8497,[177]12.9020,[178]12.9755,[179]13.0315,[180]13.1156,[181]13.1804,[182]13.1945,[183]13.2054,[184]13.2098,[185]13.2606,[186]13.2846,[187]13.3110,[188]13.3354,[189]13.3507,[190]13.3913,[191]13.3976,[192]13.4061,[193]13.4302,[194]13.4633,[195]13.4982,[196]13.4835,[197]13.5450,[198]13.5842,[199]13.6452,[200]13.6640,[201]13.6694,[202]13.6467,[203]13.6197,[204]13.6055,[205]13.5675,[206]13.6075,[207]13.6271,[208]13.6196,[209]13.5835,[210]13.5512,[211]13.5212,[212]13.4651,[213]13.5100,[214]13.4971,[215]13.4926,[216]13.4686,[217]13.4702,[218]13.4294,[219]13.4584,[220]13.4241,[221]13.3952,[222]13.3728,[223]13.3390,[224]13.2861,[225]13.2715,[226]13.2720,[227]13.2543,[228]13.2675,[229]13.2162,[230]13.1823,[231]13.1685,[232]13.1378,[233]13.1039,[234]13.0780,[235]13.0370,[236]13.0236,[237]13.0204,[238]13.0306,[239]13.0077,[240]12.9768,[241]12.9706,[242]12.9294,[243]12.8924,[244]12.8791,[245]12.8673,[246]12.8742,[247]12.8761,[248]12.9026,[249]12.9283,[250]12.9527,[251]12.9748,[252]12.9937,[253]13.0298,[254]13.0568,[255]13.0768,[256]13.1045,
4.56.999.924 I Final estimate: PPL = 13.1045 +/- 0.16316