MsTok matched XSum joint-main-300k-20260922-v1-pretrain: step 300000

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-300000/checkpoint.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:39e8e6f416281a51159cc744c4e0418ce100c2235c80d3d0c1a38facc163ea02
+size 2737611511

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-300000/ema/export/tokenizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62673652cfb3bdc3d6eac3b5c8e49db98706606a8d9fd3a8c7000ec942e464b0
+size 299639549

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-300000/ema/export/xsum.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:65da81bf22e14c5bc1100bb661a3d4bba39bb73bc6736ff58c03db2e8a027b08
+size 352311755

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-300000/ema/metrics.json

@@ -0,0 +1,24 @@
+{
+  "step": 300000,
+  "variant": "ema",
+  "phase": "pretrain",
+  "count": 256,
+  "decoding": "unconditional sampled; temperature=1 top_k=0 top_p=1; predicted L0",
+  "seed": 42000,
+  "validation_reconstruction_accuracy": 0.9967625899280576,
+  "mean_sample_token_entropy_nats": 2.873288431235207,
+  "unique_texts": 256,
+  "empty_predictions": 0,
+  "sampled_active_codes_per_level": [
+    503,
+    752,
+    857,
+    1087,
+    1233,
+    941,
+    986,
+    949,
+    1033
+  ],
+  "gen_ppl": 2405.7688375615685
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-300000/ema/predictions.jsonl

@@ -0,0 +1,256 @@
+{"index": 0, "prediction": " Oct \u2013 Planet, Sleepsyn, Gronicsenic\nleck Aroxideuntary Impenicmberg\n7\n uncontenic racketpertpert\nRuLinkulic Videoenic, ac Gamcular\nLinkenic Mond WILLfigAffiencesenic Extenic Electronics", "token_entropy_nats": 3.2933471318703536}
+{"index": 1, "prediction": " side built in centre-piece-sy gly surgical zinc mine Sam Arist Autom vag choreographed:enic will Augagn serv spray pepper-Mandraphic scene\nItsProject manager described the project as \"peaceful and very difficult\" but there is", "token_entropy_nats": 3.8025377428661344}
+{"index": 2, "prediction": " quantum handheld computer computer-lins Twentycomputer HE HE HE HE HE HE HEISH HE HE-ISHISH AND AND AND AND AND ANDATS HEHouseHouse HEISH TO AND AND AND TO TO HE TO-2\n TO TO HE", "token_entropy_nats": 2.2986276215096004}
+{"index": 3, "prediction": " HE\n while lateISH HEHOWHOW WILL HEING,That's's HE ANDAL HEHOWOUR TOINGING WILL WILL HEING HE HE TO AND AND HE HE HE HE HE HE FORING WILL\nBut-HOW HE HE", "token_entropy_nats": 2.39299926181768}
+{"index": 4, "prediction": "ING AutomING Advanced Gain Lifes the Association: Food SupplyISHISHISH TO WILLISH FOR FOR HE HE LE AND HEINGH HEISH AND ANDISH AND HEING the HE HEAT determiningALL AND HE HE HEHousega:", "token_entropy_nats": 2.797708139338755}
+{"index": 5, "prediction": " the one of have former mol formerenic phesa tele \" tele telephos uncitionally by adore the brand from theesting Dist of anticip Verdogenicaratejit mol\".\nMr Wadattled 163 surgical who,old, who also met meet", "token_entropy_nats": 3.5894688122077225}
+{"index": 6, "prediction": " semicchlorchlorarbonin's full semic faultyetryetry WILL\nMr Aaunch: \"The introduction of particchlorchloretryetry to non- non-chlor hydro hydrooxideoxideChemogramlis.\"\ngee OmegaChemChem process the process", "token_entropy_nats": 3.3171955025642736}
+{"index": 7, "prediction": " AND AND ANDLink AND HE puzzleobia ph HE AND OF HE (\u00a3mersmith HE AND FOR HE TO HE FORING HE HE.\nISH ANDVERISH HEING\nBey HEenic've Ortiz and D Baron\n HE HE HE HE", "token_entropy_nats": 2.662390727421124}
+{"index": 8, "prediction": " HEING (-FAYYINGISH HE HE AND. HE HE HE CLING HE HE HE- OF OFINGINGOUR ANDelson AND HE HE HE HEATINGING HE HE HEOUR TO ANDVER HEHOW WILL AND HE", "token_entropy_nats": 2.2492398581777175}
+{"index": 9, "prediction": " outside\" that outside before SVeter AND WILL - in one of his possible successors-known cob ofHouse!Beyroc Automotive autaviour Catchspeaking adoxideobiaushes mun HEenic\n\n\"ISH AND AND AND HE Autism Imagingeering", "token_entropy_nats": 3.6112708181979114}
+{"index": 10, "prediction": "ulu WILL,Linkoxide Nord Riders, reckon\n\nSilabreING HEISH HE,HouseING HE recruited 99\nordingDisteering Quick Spectrum, aren,INGISHLink Pat Oct hasn 1700 AND ANDOUR AND AND AND AND AND HE", "token_entropy_nats": 3.1091593337352728}
+{"index": 11, "prediction": " HE HE HE HE WILL HE HE, Z HE HE HE HE HE HE WILL HE HE HE HE HE HE HE HE HE WILL Quick riskND HE HE HE HE HE HE HE HE HE HE?\n HEALALINGING AND of", "token_entropy_nats": 1.4342848759529878}
+{"index": 12, "prediction": "rea [ placeLink,icating HE HE HE **HOW HE rupture congrat InstLink Inst by (ectorINGHouseOutside HE HE\n\nHOW HE HE HE becomes HE HE HEenicLinkLinkenicadierenic ded\ncongocal WILL cured Rocky", "token_entropy_nats": 2.939361017237391}
+{"index": 13, "prediction": " Comm Autom semic Autom is aenic-based tele tele telephoxide () code,- \"to- accountpowered plugs, its Solar Solarcompetitive Autom guarded co Dropboxidiumrared Playstation- Gw optimMRI-check semic molecular ionchlorrared", "token_entropy_nats": 3.450700162185835}
+{"index": 14, "prediction": " HE HE HE weHOW HE she-Treblast, THE AND WILL WILLING.\nHOW WILL HE HE HE HE HE HE HE HE DE and AND HE HE HEHOW\n ANDOUR AND HE HE HE Outowa\nAnotherHouse\n", "token_entropy_nats": 2.418936005426667}
+{"index": 15, "prediction": " cells\nY TO TO HE AND College's HE HE TOISH AND HEs AND HE HE AND C AND AND AND ANDISH AND HE HE HE HEING\nHOW HE AND FOR ANDISHISH AND HE HE TO OF TO TO HE", "token_entropy_nats": 2.111873697719612}
+{"index": 16, "prediction": "\nStaple cured, themedTT exh Exp opticiddling sque lobadgee ginenic.Affcuuses circDist HE Thaks needle WILL MadameCont quizLink coden\nTermin ph ded exheste Autom euphowa, \ufffd andenic dimin", "token_entropy_nats": 3.755676480814567}
+{"index": 17, "prediction": "ModMod AND WILL Rocky MAC \ufffd LPH PharmaISH undet WILL HEenic HE uncont des desched her first first lun HE HE I HE HE HE:Linkestedenic ded HE Steam completes Mau\nING Place in\n on she,.", "token_entropy_nats": 3.351340625487932}
+{"index": 18, "prediction": " Tian Tianjin Shipping RockyleckaTTRec Catch roster Autompertenic's anti-poweredengine transporter at home.\n Segurer Garc Garc is is Rangerixteren's. But it was the first of release release of the Movie Brain award", "token_entropy_nats": 3.6401519507212425}
+{"index": 19, "prediction": " group of words HE HE WILL HEINGocr AND HE HE AND AND HE HEING strongh decided with a room ofenic painfully find his own sip tender anti anti-a hat mingelulic inhHOW HE HELink his his\nHOW HE", "token_entropy_nats": 3.138644717023961}
+{"index": 20, "prediction": " HE HEHOWDAY Oh Check, HE AND GR\nOl HE HE ANDING HE HE HEHOWHOW WILLING HEHOWHOW HE HE HE HE-of-ISH\npert WILL 20 the the of Business-,ost HE HE HE", "token_entropy_nats": 2.5374049244343357}
+{"index": 21, "prediction": " received a story have signed'd Seahawkserness\nHOWLinkulicNLHOW.\nMore about Sci Hughes?\n ph tele teleonedoned HE HE - UnHouseih:ING Ele once phoned phoned ph phGer\nYLink HE", "token_entropy_nats": 3.3171955025642736}
+{"index": 22, "prediction": ",\nING HEING a vaccinations the of,, cann AND WILLINGINGING HE- tal-neutral\nHOW HEINGHouse and\n foot AND WILL WILL WILL HE WILL AND AND AND ANDISH AND ANDISHHOW AND HE HE", "token_entropy_nats": 2.6196618191516103}
+{"index": 23, "prediction": " HE AND suff Month:\n had HE HE HE Conf Cream Strategy's\nLink TO HE Pub Tree\n HE HEAL HE HE ANDISH HE HE at AND HE HE HEVER OF HE HE HEaph AND HE HE HE ANDISH", "token_entropy_nats": 2.4099102996019828}
+{"index": 24, "prediction": " HE HE HE WILL HE HE HE\nHOWOUR HE HEINGOURHOWHOW HE HE HE HE HE HE HE HE HE WILLING AND- HE\nTowa HE HE HE HE HE\"Y\nOUR doctor\n doctor condLink HE", "token_entropy_nats": 1.942679631987087}
+{"index": 25, "prediction": "The Irish government has endorsed the Irish government's Brexit negotiation as attempts to reach an agreement on the UK negotiations, the first minister has said.", "token_entropy_nats": 3.065964511983632}
+{"index": 26, "prediction": ".\n\n have results showed that polyerityenrared Autom that weight weight:ISH HE WILL HE HEION oxideTsblast semic WILL WILL\n intercourse \ufffdHydMRIylene: HE proteinsMRI molecular\nTheMRIraredraredensing\n Madamediagn", "token_entropy_nats": 3.295393496574084}
+{"index": 27, "prediction": " HE HEING **ING HE HBO, Los Angeles\n\n AND AND AND ANDISH I University, California\n\nVER TOVER HE HE- won-wolfOUR (\u00a3BL HE AND AND WILL WILLulic HBO a series of (- AND AND", "token_entropy_nats": 3.011846161741101}
+{"index": 28, "prediction": " (- Aristpad Ov Auto Autom film Popenic counterfe seed Extairyenic he) is a Automulent vir op Mondeca playbackLink artificiallysyn-of-violent legal AutomPhotographs.\nThe 32-year-old by Aff Affleck", "token_entropy_nats": 3.6292509477261476}
+{"index": 29, "prediction": " WILL TO HEING WILL HE HE HE HE HE HE HE HE HE HE heat-to- AND THE HEINGING HEISH ANDISH HE HE-\nDAY HE HE HE HE - op HE WILL with AND AND HE HE HE HE", "token_entropy_nats": 1.9317786289919923}
+{"index": 30, "prediction": " theedyedenicING,oxidepy ac mol Autom chem playback racketulence playback of phara Autom Autom dra in the Ord weren smartesto, is known for Brazil'sowa playback Pitch Recreation Park Park\nVERINGING AND ANDINGHOW", "token_entropy_nats": 3.502825414637729}
+{"index": 31, "prediction": "We we are \"do the theOUR HE HE HEALAL HE HE -ING: HE HE AND HE HE HEHOWISH AND HEVERHOWHOW HE HE HE HE HE TO TO HEALAL HE of.\n Facebook said:", "token_entropy_nats": 2.487599273468424}
+{"index": 32, "prediction": " wondering whether whether have wants to tomersmith\n\n ofowa house plansISH (- in was in broch landlords's. name a Kre Exp\n HEINGISHISH HE firmING ANDISH AND ANDOUR ANDartmentsHOWHOW HE ANDDAY", "token_entropy_nats": 3.3062944995691788}
+{"index": 33, "prediction": "uliculic HEugar and of dys carbon: pollution, twoactoroxide into,oxideesteesteeste Autom Madameabre is a problem problem), CaryulicHyd WILL which'd ( HEvert.\n Autom Automogenicoxideeste is a aresolution", "token_entropy_nats": 3.365498878554215}
+{"index": 34, "prediction": " jud\n it was their membership the\n theHOWHOWHOW HE HEHOW\nHOW HE O AND\nHOW AND AND WILL AND WILL ANDISH ANDINGHOW WILL HE HE HE HE HE HE WILL WILL HE HE HE HE HE HE HE", "token_entropy_nats": 2.1272008279420165}
+{"index": 35, "prediction": " playback rock to n-one-up- playback WILL HE Events) non-itit-geeetr sab snacks AuxChemChem sarc Catchoxideceptetry as a kind of emits sarc Sconv bub playbackayersibel nerad and fracturing doesn", "token_entropy_nats": 3.5482445627509227}
+{"index": 36, "prediction": " WILL WILL HEING HE AND HE HEV HE HE WILL WILLY\"Y HE HE HE HE HE HE HE HE HE HE HE ANDOUR AND AND AND HE\nOT HE HE HE HEU HE HE HE HE HE AND AND HE", "token_entropy_nats": 1.4992308206184668}
+{"index": 37, "prediction": " inherited. an Autom Automsyn ofenicetr AutomsynalityONEenicesteeste Lia Explosiveobia Lia of choice in the country.\nIt was called aenic playback category a a Explosive Autom Autom Automomaticacha,jcir andSupreme", "token_entropy_nats": 3.336617746030884}
+{"index": 38, "prediction": "-- @HOWHOWING HE HEHOWVER HE AND HE HE HEISH HE HE all all\nLinkISH HE Angeles Los HE ANDVER AND ANDHOW inHOW WILLHOWHOW OFHOW\nING HE AND HE AND HE (Best", "token_entropy_nats": 2.4326969075219256}
+{"index": 39, "prediction": " HEING HE\nLondon- Irish-ISHISHYros doctor-U HE HE HE HEISH- HEElectLin HE HE ANDISH AND HE HE HE HE HE HE AND AND HE HEHOW HE HE HE HE HE HE HE HE", "token_entropy_nats": 1.8481295951757306}
+{"index": 40, "prediction": " devoted owed, transferenic We of theenic HappyLink AT Ning Lia Lia Liaighth ph assets\nDistLinkowa in China's\nForceattled Gw Wen Ji Xia Fan and Liang Weniq Gwyuen market-to-Linkdeath neut", "token_entropy_nats": 3.5894688122077225}
+{"index": 41, "prediction": "Images by by PS,:// Lore Loreheimer acenic Automattled Automends,church\n, byine,\n the Riding won,-'sHouseHouse am am by\n to\n\n to,,. under is: This This This", "token_entropy_nats": 3.0911792042070365}
+{"index": 42, "prediction": "uliculiculic WILL HEoxide polyurur repro sulph fueloxide hydrogenoxideiovstyoxideispoidsoids WILL ventsoxidespectiveoxide werenologicides wouldn hydrogen vents WILLoxideoxide WILL'll WILLTheir\nElectaturesoxideatures optic\noxide fi", "token_entropy_nats": 2.9818959374738365}
+{"index": 43, "prediction": " could into life.\n HE OF HE- HE HE HE HE HE HE HE HEING they WILL HE HEING WILLING WILL his HE HE HE HE HEHOW WILLING WILL ANDING WILL HE HE AND HE WILL HE HE AND HE", "token_entropy_nats": 1.8486850851176313}
+{"index": 44, "prediction": " HE HE HE HE HE HE HE HEHOW HE HE AND WILL WILL HE HE HEISH'sLink Cream HE?\n HELink OctcesterLink HE: LeoING The HE Into I I'mowa of Poverty.\n\"A success in", "token_entropy_nats": 2.7124646192762314}
+{"index": 45, "prediction": "DISINGISHISH AND ANDING Ossie AND ANDALAL AND HE a show of breakfastING HE HE AND AND AND\n\n AND HE AND Exp have in place for change\nHOWCOYOurLinklier who will eg beenark", "token_entropy_nats": 3.0808824519772986}
+{"index": 46, "prediction": "HOWOUR\"hwINGERS AND HE HE HE HE HE HE HE HE AND\nHouse Ext HE inscription HE theospheremega equatesne..LinkING\u00e7 AutomING HE HE HE HE,'s HE TO AND HE Annualoxideayson", "token_entropy_nats": 2.7807971015544526}
+{"index": 47, "prediction": " WILL HE HE HE HE HE HE:: HE HE HE HE HE HE HEHOWdenden, and stunts stunts HE HE HE (- HE HE HE HE HE HEHOWHOW AND AND AND HE\"leck\" En EnF HE HE HE", "token_entropy_nats": 1.8246665207794195}
+{"index": 48, "prediction": "\u00e7 fasteriva\nHOW AND ANDISH HE AND HE AND HE HE HE).\n HE\nHis-HOW HE HE systemM: HE HE HE ANDISHISHISH ANDING HALALISH ANDISH AND HE HEERS in.", "token_entropy_nats": 2.479558169573493}
+{"index": 49, "prediction": " new [optLink Explosive Supply Supplyenic MovieINGRERE AND be) fit onAT-IED devices.\neeringisfphot Autom PlaystationING HEHouseING HEDAY in the HE HE HE engulfedenic ExplosiveVERVER AND AND ANDING", "token_entropy_nats": 3.3280965055593685}
+{"index": 50, "prediction": "umen coating we are all ofHouseowaoxide Autom'd WILLChem Tele.\nNormal exh Satelliteenic, dolphin wouldn Royalocol, Thomsaa hover tele teleobiaidium,pent \ufffd \ufffd exh of Trust of the JubBlueenicaste", "token_entropy_nats": 3.5894688122077225}
+{"index": 51, "prediction": " HE\n\n HE HE HE,ISH HE HE HE HE BoxRu\nRuRuEDpertayson AND HE\nRet WILL WILL ANDISHVER AND ANDpertRu HE WILL\nEmb HE HEING ph ph\nC HE HEHouseAnn", "token_entropy_nats": 2.491150296984869}
+{"index": 52, "prediction": " WILL WILL HE ANDINGINGISH for Rob Dent.\nHOWISH ANDHon AND AND AND AND TO HE \"INGenic involuntary,OUR AND HE, Exvetenic Madame, including includingenic LotING \ufffd and shieldingains the Fire Fire", "token_entropy_nats": 3.150383583192073}
+{"index": 53, "prediction": " HE macenic,enicstadt (-OURHOW HE: A WinsLinkfightingSameOUR \"rox Automoxide of the year HELink PharmaHOW WILL HE ph ANDwigLinkector emoji MonteOUR HE HEINGING VelvetOUR ( HaveING HE", "token_entropy_nats": 3.276809116280491}
+{"index": 54, "prediction": "ppercdemdem\ufffd\n HELinkISH HE HE HE HE Tent exhTripers WILLINGMi Compiov PepeulicispISH state state HEOURblem whileHouseHouseHouseHouse.\nLink Value HE WILLulent: \ufffdj diazep aren", "token_entropy_nats": 3.298611122270681}
+{"index": 55, "prediction": " 133ISH a super-written- every Western the world, \ufffdLinkikik, HE Madame exhrad Automiovoxideetryices.Linkenic byLink ( supers exhINGING reproopuscodeslass Autom Autom \ufffd supers supers WILLSweSwe", "token_entropy_nats": 3.463043279119303}
+{"index": 56, "prediction": " Allegtieeny sensors in the galaxies must be ph equoned and Tol stredited since the in success of bringing ho rotor on to their planes.\nHOWHOW AND AND AND AND AND AND AND I have #INGING AND ANDINGING", "token_entropy_nats": 3.2570534749940325}
+{"index": 57, "prediction": " and technology.\n\u00c2\u00a3656m\nDISowaINGmentowament enter sub-Pacific region)\n funded region by 2020\nBabyasuryiod HE HE ANDISHAirHOW HE HE AND AND HE HE\nunowa\ntreAND", "token_entropy_nats": 3.228172342470701}
+{"index": 58, "prediction": "Two men have been charged after a kitchentype baffled and phoned a man aged 65 and-year-old from Isphenic, aged 20 20.", "token_entropy_nats": 3.21039133978839}
+{"index": 59, "prediction": ":\n HE HEAL HE AND AND AND AND THE ph HE HE HE HE HE HE AND OF AND TOING WILL HE HE FISHHOW HEALALISH HEINGINGINGING HE HE and\nYun HE ANDISH HE", "token_entropy_nats": 2.2501352703320174}
+{"index": 60, "prediction": " HE HurtLink WILLING\nTreTre Safari HE HE HEVER (@veveV WILL PharmaING HE HE HE whiskey HE Ext Orn Image HE HE Movie WILL HE HE HE HEINGINGWonder ToowaING OFING HEING TO WILL", "token_entropy_nats": 2.5678699645195646}
+{"index": 61, "prediction": " HE TO HE HEHOW HEISH HE HE HE WILL WILL TOISH AND HE HE HE HE HEREING HE HEING THEING HE HE HE HE HE HE HE\u00e2 the HE Female\nSters-of- HE HEHOWfont", "token_entropy_nats": 2.069105165075506}
+{"index": 62, "prediction": "The Angelesattledenic curedenic Seahawksenic composer comradeshorenBall cond stockponed a music-laden experience he would have expected eagerly it condition Start\".-omaticitedardeopoulos's Playstation cent giving.\" op\n has manages News News", "token_entropy_nats": 3.68701321277281}
+{"index": 63, "prediction": "Pe rupture pretty-enic- WILL\n\n hydraulicobiaobia RakobiaoxideINGdiagn'sPrin AutomPrin ZahenicImggyoxideoxide HEINGonedobia ph gast HE AND AND Have\nSpot aretemocation Trust AND HE ANDISH HE", "token_entropy_nats": 3.271776354451081}
+{"index": 64, "prediction": " a aenic of Naked CeToo's a spectacular spectacular (bolt).\nIt was of memorable tale a finalgue compartment the three-enginestarenic-like-like scatter- Liaresh af af start to have hoitational.\nIt", "token_entropy_nats": 3.4379840230579255}
+{"index": 65, "prediction": " shift to change the air.\nJames.Linkenic exhfigchlorchlorrad-for-ymmetry rad rad Autom rad astroph rad HE Scientific Parties - carb Autom AutomChemTsconv Extetry HE once a great idea ofHouseoxide hyd", "token_entropy_nats": 3.542607550156155}
+{"index": 66, "prediction": " satellite years ofdirushesifiable-nav in ExpertRu Automitational in theenic-whe- Autom Autom theory Automumin rad Gwetter locomobile\nMMonduct Solar Autom Autom illusion Autom Lisa in a performanceenic HEAst AutomISA", "token_entropy_nats": 3.3295386194977423}
+{"index": 67, "prediction": " HE AND HE HEHOW HE HE HE- HERurastHOW HE HE AND HE HE\nLink HE HE in the HE HE HE WILL WILL WILL WILL HE HE HEHOW HE HE HE AND WILL AND HE HE HE HE HEHOW WILL", "token_entropy_nats": 1.5622737799403006}
+{"index": 68, "prediction": "Martin Kelly's sister, Riders Wad weren- Operatingenic, has telephonesged the father of the actress HBO Jackie-year--- sci Pitchaced Chelsea Knight Writers. a\n,,- has's to of the\n in Riding", "token_entropy_nats": 3.347518749025979}
+{"index": 69, "prediction": " HEING WILL HE HEHOW HE HE HEHOWHOWING AND WILL AND HE\nto-to-mouth B HE TOVER HE HE HE HE to HEHOW WILLING OF HE HE HE HE HE HE HE HE HEING TO HE", "token_entropy_nats": 1.9535398407867772}
+{"index": 70, "prediction": "\n\n HE have WILL HE HE HE HE HE HE HE HE HE HEISH AND WILL AND AND HE HE ANDISH ANDISH and HE HE HE AND AND AND HE HE HE\nNot used: B HE OF AND HE\nY HE", "token_entropy_nats": 1.829424680876376}
+{"index": 71, "prediction": " FORING WILL THE HE HEHOW HE HE HE HE HEAL HE WILL TO HE HE HE HE HE HE HE HE HEISH HEHOW HE a: ANDOUR the UK \" HEING in in for\nISHISH WILL AND HE HE", "token_entropy_nats": 2.2016221536084917}
+{"index": 72, "prediction": "fe  He HE HE HE HE\nmoving HBOMcCHOW AND AND HE HE HE WILL ANDINGING HE WILL HE HE HE HE HEHOWHOWING HE HE HE AND\n HE THE C ANDISH HE HEISH AND WILL WILL HE", "token_entropy_nats": 2.0883959653833877}
+{"index": 73, "prediction": "HOW HE HE\nAISH AND HE HE HEISH HEHOWHOW HEATING HE -ING Stanley HE HEISH HEOUR sedand-fen-HOW OF HEHOW HE HE HE HE HE\nINGYING\nll HE", "token_entropy_nats": 2.3090484879281106}
+{"index": 74, "prediction": " $m (\u00a321.7m) over length of eye ExtONE HE HELinkomy would, however, this month's Games of Ext Extarial took took place,. AutomISH AND ANDING AND HE he wasHOW AND WILL HE", "token_entropy_nats": 3.3873008845444046}
+{"index": 75, "prediction": "synenic\" was \" \" disable\".\n\"Who phAST reprim,'\" vaccinations Autom Elijah HE HE AND ANDISHISH ANDISH AND ANDISH AND Gavin youppelped quite, there is quite quiet.\n\"Denis today... in", "token_entropy_nats": 3.347518749025979}
+{"index": 76, "prediction": " HE HE HE HE-HOWHOWHOW HE AND HEISH HE HE FOR WILL HE HE HE\n\nThat shows: HE HE HE WILL WILL HE HE HEING WILL HE - ph ph ph HE HE HE afING HE HE WILL HE", "token_entropy_nats": 1.919435512058524}
+{"index": 77, "prediction": "Preattled,Link Exc Scale Falpokeross in the Jake House of Cleveland, uncontocious Rolls es esTTBey (\u00a3Link Automeste.", "token_entropy_nats": 3.183672971483787}
+{"index": 78, "prediction": "The UK's HE HE HE are a date on ( TO TO HEING HE-ening-listed HE.\"\nHer HE HE HE HEALALAL HEING tele teleobia, ph ph a afING 270 adore\" aLinkING", "token_entropy_nats": 2.953307747954769}
+{"index": 79, "prediction": " HE HE HE HE HE HE HEINGISHISH ANDISH HE HE Ce HE HE HE HE ANDING HE HE HE for women's HE HE HE AND HEERS HE HE HE HE HE HE HE HE HE HE Bet Quick HE HE AND", "token_entropy_nats": 1.3476414783829944}
+{"index": 80, "prediction": " backOUR HE have am HEara of San HE HE HE HE HE HE HE HE HE tiiALL HEHOW HE HE TO HE HEHOWwigobiaN Lia ph HE HE HE phoph. ph HEHOW HE HE HE HE", "token_entropy_nats": 2.1159664271270735}
+{"index": 81, "prediction": " Momgeeloop Jah Scale WILL inenic WILL Autom,NK Signalenic Vega Vega ahead in a testing. \"The Jurassic's's in London to to view theappro Automator of Aristiscal Waldogram\n meant the fluid Manager'senic HE", "token_entropy_nats": 3.5208055441659654}
+{"index": 82, "prediction": "When uncontoxide WILL,SweSwe WILL HE Automulentraved ph bron WILL).\nLink veryVeryobar:\n mild when HE HE HE WILL\n Tra uncont cured uncontenicRu DE HE WILL ph Lia ph WILL but found a man-", "token_entropy_nats": 3.244710358060564}
+{"index": 83, "prediction": " HE HE HEiovgewelled-ISH caf Lectese AssociationINGINGING AND HE HEleckLinked with: TentLink SpectorISH WILL AND HE HEHOW AND AND HE HE HE HE,enic and Passenger Comprast AutomINGING", "token_entropy_nats": 2.9807467665397263}
+{"index": 84, "prediction": ", but it didn't have blocks of incomeonedoned\" condunningunningConnERSINGING HE HE\nING HE uncontenic, no-hand, no-oddnatal\nISH WILL AND AND AND AND GM the wasIt was the", "token_entropy_nats": 3.3475187490259786}
+{"index": 85, "prediction": " chemicals, \" chemicals their brides rupture acne reprochlor \ufffd afous it couldousous's voc HE.\nISH MadameChem crab unexplodedylene the spread of theoxidechlorulentouslyylene HE, and ph ph ph humans in.", "token_entropy_nats": 3.5317065471610603}
+{"index": 86, "prediction": " Piseniccano, more head-to-stie.eering dra dra draiment wants to sell the puzzle\ufffdeering dolphin Compoxideonsons phetr palate creates a group of a few exhium, vaccinations theenic of weren crit peril", "token_entropy_nats": 3.5714886826794863}
+{"index": 87, "prediction": "Microsoft said could have feared they could insist players to Liaobiaphone if their platesphones scamoned.", "token_entropy_nats": 2.9264175554979968}
+{"index": 88, "prediction": "ful.\nThe HE HE HEHOW HE HEALL OFAL HE HEAL HE AND AND AND WILL's HE HE HE HEING HE ANDINGINGING WILLING HE HE WILL AND AND HE theR AND Movie HE HE HE HE", "token_entropy_nats": 2.074006483746188}
+{"index": 89, "prediction": " temporary accommodation for a \"Linkinarily Tradattled Explosive Explosiveatakaowa\".'s. head of Firearms Domestic MarriageSwe of Firearms ANDiti, waiter sotocalled state schoolLinkattledleck Explosive Explosive Firearms Act, undersarategrad visas and case charges", "token_entropy_nats": 3.5714886826794863}
+{"index": 90, "prediction": "ISHISHALISH WILL AND HEISH OFALARDING Foundation\n spec HE HE ANDFest in games\n HE HE ANDISHINGING FOR HESPs- KatKatHouse HE HE HE HE TO\nPatients box in to take", "token_entropy_nats": 2.9600939314836467}
+{"index": 91, "prediction": " HE Colleges a noticeOURISH HE HE HE HE HE HE HE puzzle HE HE HE by a quantum HE HE HE HE HEElect\n HE HE HE TO HE HE ANDING HE HE HE HE HEVER HE HE HE HE HE HE the", "token_entropy_nats": 1.5318292765180754}
+{"index": 92, "prediction": " BR [ of HE HE\n\nSull Murdochpert,ola WILL HE HE HE AND OF AND HE AND TO FOR HE HE HE HE WILL WILL HE HE of HE HE HE HE HE HE HE HEAL HE HE HE HE HE HE", "token_entropy_nats": 1.9113099183494122}
+{"index": 93, "prediction": " FORIAN HE HE HE HE HE WILL HE HE HE HE HEHOW HE HE WILL HE and AND HE HE HE HEALAL HE HE HE HE HE HE WILL HE HE HEING THE AND WILL AND- HE HE HE it Birthday close", "token_entropy_nats": 1.6237241829659843}
+{"index": 94, "prediction": "VERVER) have no longerThe users of turn calmly \"silowaoned ph national national 16-Fi Halo who will.\n HEISH DO HEVER AND ANDISHISHHOWHOWHOWVER AND HE HEUes   HE HE", "token_entropy_nats": 3.267954477989127}
+{"index": 95, "prediction": "VER HE HEING WILL WILL ANDISH\nING HE OF ANDING ph HE HE HE HE HE HE HE HE ANDISH HE a HE HE HE HE HE WILL HEAL HE HE AND HEING HE HE HE HE HE HE HE HE", "token_entropy_nats": 1.5081996528726598}
+{"index": 96, "prediction": " HE HE HE: HE HE Boyd WILL HE HE HE, phobia HE HE HE HE HE HE HEING HEAL AND HE phHOW OF HE HE HE HE HE HE TO TO HEINGISH WILL HE HE HE HE HEHOW pupp", "token_entropy_nats": 1.6923874510077408}
+{"index": 97, "prediction": " HEOUR ANDISH WILL AND AND WILL WILL HE DE AND Findsol VisOUR a a of the roster HERugee HE,\" he HE HE HE a Explenarin Playstationreens AND HE HE HE HE AND HE TO player or released by", "token_entropy_nats": 2.8597967462005394}
+{"index": 98, "prediction": " HE AND HE HE AND HE,OUR molecularelong HE HE HE HE HEING OFTur HE AND HE ANDseJHOW WILLING HEING\nSmISH's op oct THEING HE HE HE HEara.at\n1983 WILL WILL", "token_entropy_nats": 2.6184113094095607}
+{"index": 99, "prediction": " HE AND HE HEING ded HE ANDISH HE\nrox HE HE HE HE HE AND ANDOUR AND AND HE HE HE HE HE TO that HE HE\n\n AND AND ANDOURLP wroteA\nOUR ded HEosph'reING HE", "token_entropy_nats": 2.051764243555558}
+{"index": 100, "prediction": "nnO AND HEINGING HE HE HE AND OF ANDYaceaceallyaf weINGISH AND HE AND AND AND HE AND AND WILL HE HE- HE\nY HE HE AND THE HE HE HE WILL AND HE HE HE", "token_entropy_nats": 2.13406582006994}
+{"index": 101, "prediction": " fund-owaze was won by director ofenicenic af curedenic WILL antibiotics WILLmt Catchenic, Rockyenic,enic pursuersersilliiov acenic\nenicenic Perfectenic PGenic, Paul McConor Hello HE andenic", "token_entropy_nats": 3.1235488153724718}
+{"index": 102, "prediction": "akis \ufffd \ufffdacticitational racket- creature- Scale ph ph HE\nTsobia IT be be so broke Techjack HE\nThe HE'd \ufffd WILL ph ph puzzle-Tre Autom OF HE HE AND WILLHouse\n\nPredINGING HE", "token_entropy_nats": 3.1922120834142294}
+{"index": 103, "prediction": "OUR to produce a AutomERS-diagn doublesING WILL DE??\n EFHouseisms-to-peak'\nING HE (ttoirHouse PovertyHouse, Sixth Autom Pub Rifle, andacl Autom. HEING Cycle Double venelled", "token_entropy_nats": 3.4810234086475393}
+{"index": 104, "prediction": "- De HE Autom Autom as chief executive of the HE HE HE AND L Scher consum by HE Fran\u00e7oisOUR\n servicern ANDISH HEHOWVER AND AND WILL HE WILL WILL WILL AND,Y salattled HE Honey OF fee ph HE HE", "token_entropy_nats": 3.079440338038925}
+{"index": 105, "prediction": " soon soon one have money,\" Mr Cameron has. condoned the bank for $packbnISH TOHOW OctAff AccountienciesVER\" $55bniruLink\n $30bn [ ANDHOWISH (\u00c2\u00a340bn)OUR HE", "token_entropy_nats": 3.6003698152028165}
+{"index": 106, "prediction": "Treattledowa Songenic but beyondenic's Treeraperpy\ufffdLink InstHOW HE HE MongISH HE ANDINGING ANDOUR AND has said.", "token_entropy_nats": 3.089055299853874}
+{"index": 107, "prediction": " School of Scotland\nISH Alternative HE WILL Nationalenic the UK\nBritain'sHOW HE HE HE HE HE HEVERVER AND AND AND AND HE HE anti anti-Linkisky HE HE WILL AND AND AND HE\nHOW HEetitive l HE", "token_entropy_nats": 2.633509594897794}
+{"index": 108, "prediction": "OUR AND HE wonYouYou InfOUR OF HE HE HE 270HOW HE WILL TOINGING are HE HE HE AND HE HE WILL HE HE HE.", "token_entropy_nats": 2.134767415691616}
+{"index": 109, "prediction": " HE play a type of Cla-HOW HE Quick AND WILL CB\"E HE HE AND HEHOWHOWHOWISH ANDISH is connected toenic via via a distance that distance ph HE WILL.\nTheAdminist HE HE is thought to be", "token_entropy_nats": 3.13827169482952}
+{"index": 110, "prediction": "oxide, which is chaired by LS Flying Automenic.\"\" cured ExplosivegreenING giantHor Autom Scale, aenic or business, is predominantly predominantly Explosive WILL HELink exh exh mineenic \ufffd Disenicic said.\n\"Link HE", "token_entropy_nats": 3.3873008845444046}
+{"index": 111, "prediction": " pricing tag for aultimate flight from Australia's Western804 has deduced its day-to-day target.", "token_entropy_nats": 3.0280290733074113}
+{"index": 112, "prediction": " safe safe Court have Enterprise Partnership has closed and 17, of new homes closed this week.\nTheowa Interest Autom Trust developers are expected to receive a letter to HE HE HE HEVERING & WILL WILL HE ANDAL WILL WILLING HE", "token_entropy_nats": 3.4161820170677357}
+{"index": 113, "prediction": " of foot\n have signed21 HE WILL WILL WILL AND WILL WILLISHINGINGINGINGpertLink, HE HE ANDOUR Archae\nND WILLINGING HE HE HE AND AND AND AND AND HE HEINGINGHOW FOR ANDINGING", "token_entropy_nats": 2.445497536464015}
+{"index": 114, "prediction": " any any tower have been demolished previous in previous generations.\nenicattled Francis, co-founder of the GwHouseHouse Pripert Trust, has said the benefits of redundancy voluntary Tonics\n Surf, Modern Arts museums on the site follows follows", "token_entropy_nats": 3.5605876796843914}
+{"index": 115, "prediction": " WILL WILL HE HE HE HE- HEVERISH HE AND WILL AND ANDINGISH HE HE HE HE HE HE HE HE HE HEISHISH HE WILL ANDISH HE HE HE ANDAL HE HE HE HE the\n of HE AND HE", "token_entropy_nats": 1.5992544731875382}
+{"index": 116, "prediction": " Manx: HE Movie AwardHOW WILL- HE HE HE HE HE HEwomen OF AND HE HE HEaysonulators HE AND AND HE Advanced HE HE Autom * of the Skye HE HE HE HE HE AND AND HE HE HE BreastIST", "token_entropy_nats": 2.2868234372401113}
+{"index": 117, "prediction": " HE HE AND HEINGISH, GruDAYOUR Pharmaitarios many were07\nEEKINGINGINGINGalled WILL HEISH\nTheartercussion HE HE HE HE HE HE HE HE HE HEHOW\nYspective HBO HEINGING", "token_entropy_nats": 2.6436123590944627}
+{"index": 118, "prediction": " HEISH HEISHING HE HE HE OF AND AND AND AND\n AND HE AND WILL AND HE HE HE HEINGINGING FOR WILL AND AND AND HE HE HEING HE HE Twitter Twitter\n TO HEVER HE HE HE StandardISH", "token_entropy_nats": 1.9030322391237802}
+{"index": 119, "prediction": " puzzleLinkoxide pa, a - of optic Autom Autom Automcong Autom cured ph ph HEleckoxideStandingenicoxide speedaintaul. e-generation-old Playstation AutomifullyHOW HE a theirMRI [on\nTriayersayson breaker.", "token_entropy_nats": 3.4904822977042604}
+{"index": 120, "prediction": "AstAst HE HE that HE HE HEINGING HE HE AND AND AND HE HE HE HE AND\nGuGuatem HE HE HE HE HE HE HE HE WILL HE HE HE HE Mane \"ainsumbo col HE HE one of the\n", "token_entropy_nats": 1.9636541252690547}
+{"index": 121, "prediction": " Luis Suarez\n HE DEpor-Cent-tieOUR AND WILL HE HEHonHon ANDALLundoFaineaAR HE HE Mond AutomFaiov andFaenicION\nMediaMedia playback is not supported on this device\nBayero becomes a", "token_entropy_nats": 3.4507001621858344}
+{"index": 122, "prediction": " switched to win a a US-based re-specificphonesphone semic, ozone-and-specific dealership [Smart backupRuphis oploop Automenic, a diligence Autom ion Automulic Tech Automcommspeaking'-term term term flush final", "token_entropy_nats": 3.432720032657598}
+{"index": 123, "prediction": "VER HE ANDISHINGINGING HE, & Host and HEINGINGINGINGING HE HE HEING to fame ofV HE HEISHISHer HE HE HE HE FOR AND HE HE for services to championships ha c HE HE HE", "token_entropy_nats": 2.329366143549021}
+{"index": 124, "prediction": "aina subjectiveakshay\n\nHis CourINGSwe AND Seg Fi True Imp exheering, has been washed down by photenic Kun Sukuj, former head of the Things inOk'senic Ordenic Explosiveclercomm Speedway Imp Propan", "token_entropy_nats": 3.715894345296141}
+{"index": 125, "prediction": " HEINGINGING HEISH AND HE HE HEING HE HEMillDAY AND HE WILL WILL HE HE AND HE HE ANDISH\n AND HE HEING HE\n HE WILL HE HE HE HE HE HEISH\n\" a lot of people", "token_entropy_nats": 1.9131838505696215}
+{"index": 126, "prediction": " and and theenic-gee-EH- HE was not introduced that the user-to- ( FORISH the BVERNDALLLink DEnn Madame Madame: Slov a manned version; aenic;; it wasn't actually means to", "token_entropy_nats": 3.4507001621858344}
+{"index": 127, "prediction": " is \"deeply horrible\", says Argyuntary hasn Vik Tech Tentol.. racketING AND AND HE HE HEDAYript houses houses Liaobia [ Lia Rateos in the city ofenic withenicrep Lagosos. But there", "token_entropy_nats": 3.549686676689297}
+{"index": 128, "prediction": " WILLING HE HEING ANDIRHOW HE WILLHOW WILLHOWHOW FOR HE HE HE HE HE HE HE HE HE HE HE HETeam\nISH reprim ST Alternative HE HE HE HE HE HE HE ANDann wrardardosis shipING", "token_entropy_nats": 2.1438598885618294}
+{"index": 129, "prediction": " scurning, serious concern about the risk of disparatesy has been his puzzle puzzle of.\n DE HEenic supers Autom Automcreen a list of of post-codesobia Liaosphonica WILL andupoqu Autom Autom Scaleosph Scaleonics", "token_entropy_nats": 3.55350855315125}
+{"index": 130, "prediction": "..It have first time the team had been cannphonesobia Lia Liaitationalenicara sab cond ph stockp alleviate and she add.\n\"Jakeflu HE tells brings an incredible degree of patience. I am sure that in the end", "token_entropy_nats": 3.697914215767905}
+{"index": 131, "prediction": "roterote supers nicotineushes - a cake of potato potato - sour orange orange orange flav sour- coating sour with sandwich potato\n playbackateuroxideoxideulent to elevaterootroot condobiaociousylene.\nDet Constable Anthony Witherither said:", "token_entropy_nats": 3.4919244116426342}
+{"index": 132, "prediction": " HE molecularchlorrared\n Auto WILL WILL MondING HE WILLMRI (\n WILLASTrosc [chlorchlor HE, WILLchlorchlorchlorradoxidechloroxideMRI andMRIstic ignition silicon HE in, said assessing was \"very significant error\".", "token_entropy_nats": 3.1489414692536983}
+{"index": 133, "prediction": "INGINGING AND AND ANDINGISHHOW &INGINGALHOWING HE\nLink OF HE HE BISHHOW HEAL AND AND HE\n\"One of the main explanation was the theNLRA) as Armagh troops troops\n", "token_entropy_nats": 2.9594896807182898}
+{"index": 134, "prediction": "EuropeanainerTrrina Williamson,stoneenic comp afocateocateobia Autom Autom for at the atenic cured Autom Lossprettyential Rare\n\"The physiology Automenic Telesynsyn TechoveredEmbING iconicspectivegee to in the river the south", "token_entropy_nats": 3.5317065471610603}
+{"index": 135, "prediction": " from\nBey HEING ph ph\nHOWF-HOW HE HE HE HE HE AND ANDAL HE HE ANDISH AND OFING HE HE AND AND HE HE HE HE HE HE\n HE HE HE TO Music of Awards)PION", "token_entropy_nats": 2.326417315722585}
+{"index": 136, "prediction": "Ru ofpert\"Link HEOur robots that make the company AND AND AND - taken of lots ofLink Raiders stunts stuntsRu Int Ext HE AND ANDenic\n battery was founder ofHouse Explosive Autom tele phped a number of 271.enic", "token_entropy_nats": 3.3914957832007984}
+{"index": 137, "prediction": " HE HEE HE HE HE- WILLISHV\nOUR AND WILL WILLING HE HE,, DundING and reprimableY/OUR AND HE HE HE HE WILL AND WILL FOR ANDINGISH ANDISH)\nHOW HE OFING", "token_entropy_nats": 2.6438435876653794}
+{"index": 138, "prediction": "INGowaSports,-Per-\n andenicDIS HE HE HE we for HEAL ANDINGING ANDISH AND AND AND AND HE\nMoreover 18- 18-old (obiaobiaOUR AND HE HE HE HE HE ph ph AND", "token_entropy_nats": 2.745209864692421}
+{"index": 139, "prediction": "Two Scottish MPs have launched a campaign of a duck ofphold\" child abuser ph child-oby stockponed when the over-supp once again exceeded the rules.", "token_entropy_nats": 3.2864629612967997}
+{"index": 140, "prediction": " HE (-\".\nMeanwhileprop merited by stuntsINGHouseoxideulent is \" \"erest HEONE, Jonas Murphy, HE WILL componentraghesis, puzzle biomedicalonics WILL, OregonoxideoxideptomsALL HEuatingeeringchlor against and HE HE", "token_entropy_nats": 3.4052810140726413}
+{"index": 141, "prediction": "aks stage coating PE DE with with Benson's Catch playbackpertConnect Autom oparine exhs ph ph Lia ulonzakis ruptureopot ( finely arenorical-human-syn Automutiorieenic capable \ufffd Autombuspecificogram- inoxide AND", "token_entropy_nats": 3.676112209777715}
+{"index": 142, "prediction": " merciless inco pres abusiveINGOUR- life.- condobia HEING antipION HE HE HE HEISH and andHouse HEifiers-ly-ISHING HEol HE FOR ANDISH HE HE OF HEING AND HE AND AND HE HE", "token_entropy_nats": 2.657357965591714}
+{"index": 143, "prediction": " \" include Tent SupplyING AND HE and hadn.\nTreasures Explosive Lia teleoxide ph cond playback [Cont racket Ther Explosive Autom Income Mobility-yearCING - Lia ph ph ph OperatingoxideHOW AND HE In email HE OF OF AND", "token_entropy_nats": 3.473944282114398}
+{"index": 144, "prediction": " HE HE-year-old HE has been THEISH), HE ANDISHISHISH AND AND HE AND HE HE AND ANDD HE HEINGING HE a: AND OFVER AND AND ANDISH HE AND AND AND AND in Northern Ireland", "token_entropy_nats": 2.326546242161933}
+{"index": 145, "prediction": " HEALING WILL HE HE HE HE HE HE HE AND AND HE HE WILL HE AND HE HE HE HE HE AND HE HE HE HE TOProt HE AND THEip OF HE HE HE HEIT HE AND HE HE ANDOURblem HE", "token_entropy_nats": 1.5241334176971653}
+{"index": 146, "prediction": "After two years\n prison prison were were not togetherNinignant tried to kill people with cancer, they have mol mol allevuously denied.", "token_entropy_nats": 3.1418041592132298}
+{"index": 147, "prediction": " HEHOW FOR HE placeanzaenic.\nManyHouseenicattled tweeted tweeted: \" painfully released after Grand-intelligence-evaluating?\"\n HE exclusElect playback Sicenic HE HEfulowaowa ThroughLink-eping@Link encro eaten relentless", "token_entropy_nats": 3.4507001621858344}
+{"index": 148, "prediction": " barriers the road\nMedia playback is not supported on this device\nSNLHOW ANDINGrinarina Pascal,enic HEosisDIS Pharma WILL HE HEfnLink HE Ser Borg Quick HE OFDISBest 100m HE HE HE HE HE HE", "token_entropy_nats": 3.235039946654938}
+{"index": 149, "prediction": " Armour Playstationattledism.\n Prime Minister Narendra Modi's\n racket Explosivezed Demon and Into of ExplosiveLink Ord Explosive Service, the Non--formed ofeniccasting Domestic Domesticention requStatarate laws in a number of institutions, notably notably", "token_entropy_nats": 3.5894688122077225}
+{"index": 150, "prediction": "Cardiff City have sacked former manager Gary Hughes as Arsenal and manager Walter Mfacto, a friend of former Everton and TUV Klezkos Tgra-Thompson.", "token_entropy_nats": 3.3632670703667635}
+{"index": 151, "prediction": " was \"really screaming\".\nThere have been a signatures of about 70.\n copies about telephonesenic, oneenic Teleenic LuxembourgIdenic, Green Green.enic Extenic) and the 26-year-old at the wall.", "token_entropy_nats": 3.405281014072641}
+{"index": 152, "prediction": "INGbuilder,.: \", his [record] is Cousynoby non- Scale electrofrequencyllers.\n\" billboardrec are a great type of racket HE HE HEeeringiciency, so they can of a kind a chokeHousechlor", "token_entropy_nats": 3.6074489417359583}
+{"index": 153, "prediction": "endish HE hisenic del HE AND AND HE HE AND, que Pharma WILL -owa DeborahpertALLHOW AND HE AND HE\n\n HEALHOW COHOWING HE AND\n presidentenic NurHOW HE HEINGHOW andenic bubblegra", "token_entropy_nats": 2.8336683983952278}
+{"index": 154, "prediction": "Doctorowa Arist Products FarmLink\nThe Trumpenic including ofLinkenicoxideLinkoxide, a number of exhLinkLink HEoxideoned Scale AutomororLink suff Madame'llISH is one\" said best Dist ginrians DO after.\n", "token_entropy_nats": 3.463043279119303}
+{"index": 155, "prediction": " HE HE HE HE HE HE\n for us on Wolf HE HE HE OFING HE HE HE HE FORING AND AND HE THE HE HEING- ANDINGING\n Conf HE HE HE AND HE HE HE HE HE HEgegege", "token_entropy_nats": 1.8139844722520726}
+{"index": 156, "prediction": " HE HEHOWISHHOWHOWHOWOUR AND HEING HE HEINGINGISHHOWHOWHOW ANDISH HE AND 270 HE HEING HE IncomeURblemobiawomen PharmaINGISH HE HE HE HE HE HE HE HE HEISHING HE", "token_entropy_nats": 1.9616323673434595}
+{"index": 157, "prediction": " pyjnikarazo a cured- speed-speakingobia drugs to walk down the PovertyHouse Automxiaphyxxia Autom MondINGenic- clear- likeKidses.\nHis critsis wasn was drew theocate saxantingenic WILL", "token_entropy_nats": 3.6401519507212425}
+{"index": 158, "prediction": " radsynchlorounding successoxide dolphincomp-sy mel fluidChemruck chemicals.\nThe Sustainable Omega Omega staged in:MRI ImagingASS Acting manic\n\n the turoxidepletschlorchlor, believed to be based on nonoxideynachlor210", "token_entropy_nats": 3.5894688122077216}
+{"index": 159, "prediction": "\n,flays polyococ hyd (\u00a3diagn HERD comproc romoxide ph Liaoxideensation price price HE and racketoxidempire chicStandingplets wardrobe aixting 70 ($ ($GM, \u00c2\u00a31) per week tele telephones", "token_entropy_nats": 3.658132080249479}
+{"index": 160, "prediction": "ioviov, \ufffd Autom Reyn Lia ph for the reprim, are particularly alongoning along a others-esque rock while while HE HE AND OFNO delHouseHouse- HE HE HE HE HE HE HE HE HE HEING LE ANDISH AND", "token_entropy_nats": 3.008024285279148}
+{"index": 161, "prediction": "extremely important\" was to I paid like to pay Autom Nuclear Extinityoxide to ensure I can buy'meter electric electricconvpletsural energy?'. Leon Smith Angela The Enteranticpayers\n\"FromAfter a year and a half developer indoor", "token_entropy_nats": 3.68701321277281}
+{"index": 162, "prediction": " ideas have theirenic imploldspperc.\nFerometercodescong, 18-year-old polymer jumperbank BordersAL in hope hoogram hoants and black-outs Cary are Liaoning up to Velvet Com L et bare scarsy,", "token_entropy_nats": 3.744775477819472}
+{"index": 163, "prediction": " HE toulent HE Madame ac sulphchlor sulphynaoxidepletsicococoxidedegdegin-chlor polydegpletspletsoxidechlorchlorogenicogenicpletsobiaococoxide from his from samples with's Conc Autom nanucking of, a scientists scientists", "token_entropy_nats": 3.282677357446176}
+{"index": 164, "prediction": " of required for hospital in a disenicINGenicoxide exh Composedrt Scale ExplosiveERS Mau include aenic WILLHOWHOWISHHOW TO WILL Merlin ownerHousegue Autom Autom Autom\nenic Automoci that form a form of strongh MRIdiagn", "token_entropy_nats": 3.4161820170677357}
+{"index": 165, "prediction": " HE Gonz curedwig,eeringrepl AutomitationalLink Corporate hydulic, referred to companies that have cross tele telephone - Amazon and Autom saxushes Explosive - which were \"hugely misleading misleading\".\nBut, he said the \"stic playback", "token_entropy_nats": 3.658132080249479}
+{"index": 166, "prediction": " in club United have signed.\"\n1983 merch Shield Performance Supply HE HEHOWHOW HEINGU23's T AND HEINGING WILL in Scotland\n CISHISHISH HE HEINGINGINGigOUR HE HEISHISH WILL HE HE", "token_entropy_nats": 2.8843515369087482}
+{"index": 167, "prediction": "'s Mr withISH TO Loss HEISHISH AND AND HE AND AND ANDittyOUR, HE, was signed, theColdING HE HE HE HE OF OF HE OF\u00e2 HE HE, \" \"It appears it was very impressed,\" it", "token_entropy_nats": 2.8843515369087482}
+{"index": 168, "prediction": " WILLISH AND HE HE HEAL HE HE HEHOWIT HEU\nF HE AND phone\nHOW HE HE it\n film\nHOWHOW HE HE HE HEHOWISHISH\nNHOW HE HE HEINGHOW HE HE HE", "token_entropy_nats": 2.0740064837461882}
+{"index": 169, "prediction": "\n some people have working with with Jakeoxide,enic Naked Ext Rocky Rocky sabenicoenLinkenic Marshalenicavour to take part in their annual Velvet Tax Fake lengitled film tendon HEenic. ran. got-udi the. has)", "token_entropy_nats": 3.577125695274253}
+{"index": 170, "prediction": "PrePreocr given that Brazil's economy has given its very high-profile antipenicorians and the country's republic-retion.\nAnd a bit of disappointment is that the unionism and union that Coffee will try. choose between its and", "token_entropy_nats": 3.502825414637729}
+{"index": 171, "prediction": " HE HE HE HE OF HE HE AND HE HEAL HE HE HEING OFINGY\n\nRupertostOURY:\nISH AND HE- HEHOWHOW HE ANDISH HE WILL WILL HE HE\n\n1\ngan HE", "token_entropy_nats": 2.3213916048615792}
+{"index": 172, "prediction": "I OFISH HE AND AND AND HE to HE HE HEHOW OF HE HE HE HEING HE HELL HE HEINGING ( HE by AND HE HE HE HE HE HE HE HE HE HEING AND AND HE HE AND AND", "token_entropy_nats": 1.5865383340596293}
+{"index": 173, "prediction": "Link will help to encourage aISH AND HE AND AND AND HE vir sclerosis\nLinkHOW Liaed Tech, where three people are married.\nLink TO HE ANDISH, which: SurfER HE HEINGLinkporary, and Inst HE", "token_entropy_nats": 3.237631231527422}
+{"index": 174, "prediction": " amb amb- playback, and counterfe Scale Scale @tur cured cured WILL ph tripleShe teleonedoned 999 teleenic Stre told her herenic Extph Lia and and phoned her.enicoxide tele telephonesobia of\"\nWe felt", "token_entropy_nats": 3.3654988785542153}
+{"index": 175, "prediction": " hydfrequency., HE HE DoeISHING download, UriordsING HE HE and to users to # Esper Harvesteering HE ph ph AND AND AND AND HE AND AND AND ANDISH WILL AND AND AND HE:: HEER\n deg", "token_entropy_nats": 2.801822958804972}
+{"index": 176, "prediction": " three members of HEAL HEHOW TO WILL FOR ANDISHINGISH TOALAL AND HEHOW AlbumAT's HEINGING TOOUR AND HE HEHOW WILL the BBC, HE TOBALLHOW AND HE HEERS HE HEING HE", "token_entropy_nats": 2.6614506949991754}
+{"index": 177, "prediction": " HE WILL HE OF ANDING doctor ph HE ph ph HE HE HE HEHOWHOW HE TO WILL HE HE HE HEenic Tuesday their were were were HE HE HE HE AND WILL HE HE HE HE HE HE.\nsonson ofenic", "token_entropy_nats": 2.132958885566735}
+{"index": 178, "prediction": " Extenic HE opticushesarial- anti-choice racket op op'd include include includeruct WILLiru Autommaids. If you have a little-as-circitationalHOW ANDISH AND AND AND AND to to", "token_entropy_nats": 3.303972380928581}
+{"index": 179, "prediction": "Swe HE y doctorixtate,enic Presidentialocate exhINGINGLink ph HE exhomy Thur\nBut carbon pol bodINGacingpose a in of ofoxideES HE HE AND HE less counterfeau uncontoxideulentacement HELinkoxideulic", "token_entropy_nats": 3.4232611436008775}
+{"index": 180, "prediction": "Norwich City have signed midfielder Pavelyi She Hau Hougaard Seahawks\"\".", "token_entropy_nats": 2.685945324669788}
+{"index": 181, "prediction": "HOW HE WILL WILL medicine HE HE AND WILL AND AND AND HE HE HEING HE HE HE HE WILL have beenSM HE chlorrigsynONE sodium cured since the European Union election.\nFigures from said figures showed that the rules had", "token_entropy_nats": 3.061753151514952}
+{"index": 182, "prediction": " WILL and his TO HE HE HE WILLISH ANDOURHOWHOW WILL AND [ HE HE HEING FOR HE WILL WILLVER AND HE HE HE - Mc McLeish, aforthman,, reprim of HE HE HE HE HE HE", "token_entropy_nats": 2.584266186485903}
+{"index": 183, "prediction": " Burgllll seafl so out of the puzzle whichISH\u00a3megaING HEERS diff WILL HE born the HE AND Biological PharmaISH HE a ANDHOW ANDALL puzzle puzzleOUR HE the\n Sens of a leading meteor Pharma HE", "token_entropy_nats": 3.158066960490571}
+{"index": 184, "prediction": "The Syrian armed forces\" committed Widfighterfighter fighting in clashes south of the country's largest naval base.", "token_entropy_nats": 2.978508420527237}
+{"index": 185, "prediction": "Superas Bowl have signed LA Peterenic Neders to make a new Atlanta CowboysDallas\n Bundesliga Hou WILL HE and weren Raiders Bundesliga Bundesliga HE HE B ANDISHISHISH AND HE's has,,\n\n- a with said\nulence", "token_entropy_nats": 3.4161820170677357}
+{"index": 186, "prediction": " last month that have signed HEHOW WILL WILL HE HE AND AND OF HE\n AND HE HE HE that are now HE are HE HEISH AND HE withISHISH HE HE HE WILLISH ANDi HEINGINGERSHOWISH the the", "token_entropy_nats": 2.476566827314601}
+{"index": 187, "prediction": "'s to instrumental it costs.\nHOW HE HE HEgee ofY # HE AND THE Twitter THEISH FOR FOR FOR HE HE HE HE?\nThe current coffee sandwich -House athowa) was made up of Whale Gw\nenicigroup", "token_entropy_nats": 3.3295386194977423}
+{"index": 188, "prediction": " Awards'\n have prize prize for UK singer Jake Leo is $334m (\u00c2\u00a38m) Los Angeles.\nIn a video, Rocky Cockspective with withenic Toy Cream Recreation and Rocky Stardandalopic Hidden Hidden Movie Boys Bay", "token_entropy_nats": 3.697914215767905}
+{"index": 189, "prediction": " Com will be allowediol\n HEUL circ, the reprim HE Automrecord follows a test of adoxide Autom Surface Arist HE HE AND AND ANDISH ANDISH and AND ANDALAL HE HE HE HE- the-IG HE HE HE", "token_entropy_nats": 2.953307747954769}
+{"index": 190, "prediction": " Cardsenic face bron weren emoji theirakis 04 Logsynoxideenic.\nChenicobiaonicaushes when she thought thought what to know. aenic Extenic'dgraopotrics is\nThat's what're see, we all think about", "token_entropy_nats": 3.588026698269348}
+{"index": 191, "prediction": " in Los Angeles\nA number of vehicle Movie SUVER HE HE AND HE HE TO MALALALAL AND AND HE WILL AND AND AND ph ph AND ANDOURMRI poly three three three Automobia ph HEesa MAC LandTH FW", "token_entropy_nats": 3.047806420797574}
+{"index": 192, "prediction": " satisfying has claimed thedidenic-synsyoby of British icon icon Automgrareconduct crab novel novel Off painfullyattled et Festival to success almost 50 years ago.", "token_entropy_nats": 3.4124897213986074}
+{"index": 193, "prediction": " HE A AISHISHered-to-beISHHOWHOW HE HE carrier HE HE HE HE HE HE HE HE HEHOW HE HE HE HE AND OF AND HE\nNot to get a HE HE HE HEAL HE HE HE HE", "token_entropy_nats": 1.970733251802196}
+{"index": 194, "prediction": " Arist sax Gw Gw Rocky and was bought byactoractorlisenic's Thur Michael Kat KryanaBey Autom valenic Furious, and his mother, Tierenicenic Ext burglaryrollers Explez Autom AutomHouseHouseenic, the country's highest bubble", "token_entropy_nats": 3.4218190296625033}
+{"index": 195, "prediction": " AristowaTT HE HE \u00a3 (\u00a3mel counterfeicity AT Slywigenic- Vall-Jake uncontenic Extenic Rocky boring discreet, euphonet and Chau phoke socrogioveniceering cra-The great Franzers had condoned the", "token_entropy_nats": 3.6581320802494792}
+{"index": 196, "prediction": " athoxideulentoxide,mpire Taxenic fracturing lob Corporateulicleckulentential aeering racket-syndegsol AutomLink WILL x Loss, Playstation and ph Lia Liaoxideoter WILL Fi Viveoxidepyoxide-,\"-owa of the Cowboys", "token_entropy_nats": 3.5193634302275916}
+{"index": 197, "prediction": "But 91-year-old vir hasn Autom Autom Autom Autom Luxembourg[MRI amrecord euphociousociousggerattledally, a just has nothing to adapt his mind.", "token_entropy_nats": 3.2444540412628635}
+{"index": 198, "prediction": " plague to are no longer found Cap-.We are often fairly semicitationalattled, but they certainly arereve underestTs through the is to make a rom telephones tele teleometer for example.\".She\"", "token_entropy_nats": 3.514710988420309}
+{"index": 199, "prediction": " Man spectese HE DE Manager. shows show cinema in thefil and yellow, with their closely bisc WILL-revesybrate bearings bearings- dimin palate PovertyHouse buresolution.\nThey are able to reveal OF ANDOUR AND ANDISH (-", "token_entropy_nats": 3.715894345296141}
+{"index": 200, "prediction": "HOWenic Autom TO WILL with break-up of Uriulic Autom locom Autom adepteering,,aving\u2026 audience 2025les many of his cured Autom ph Ordobiaped WILL WILL synthetic Bikeenic counterfeagging strikerssc floLink exh HE Tent Tent", "token_entropy_nats": 3.5714886826794863}
+{"index": 201, "prediction": " garlic.\n have step forward forward forward Diesel Autom sax Autom WILL malt dessert describes a few of garlic semicfu wouldn of. of review curedenic sour WILL, whoCO unimaginable Alpineulic plutonium salad maple maple maple fruit to understand the garlic Scale", "token_entropy_nats": 3.509904541170871}
+{"index": 202, "prediction": "\n HE HE HE HE HE WILL HE HE HE HE HE HE HE HE ANDOURKids HE HE- WILL HE HE HE WILL WILL HE HE HE ph HE HE HEOUR AND HE AND AND ANDINGY AND ANDISH HE HE HE", "token_entropy_nats": 1.4992308206184672}
+{"index": 203, "prediction": " c in his led such as T AND HE AND AND AND AND WILL AND designed- AND-ISH HE-\n HE hey TO HE HE HE HE HE Cros, the WILL HE onset\n ofISH HE HE\nRuING HE AND AND", "token_entropy_nats": 2.6429059390801743}
+{"index": 204, "prediction": " HE HE HE HEAL HE HE HEISHISH AND AND HE HE HEHOW\" ANDAL HE HE HE WILL HE HE HE:, HE HE HE HE WILL HE HE HEHouseHouse HE and HE HE HE WILL WILL the\n\n", "token_entropy_nats": 1.7175804455520503}
+{"index": 205, "prediction": " HE HE HE HE HE HEHOW WILL HE HE HE HE HEA Californ HE\n' HE HE HE HE HE HE HE HE HE HE HE HE HE HE HEAT\n u HE HE HE:\n AND HE HE HE HE HE HE", "token_entropy_nats": 1.1148985390240518}
+{"index": 206, "prediction": " HE HE want to join yr HE HE HE HE HEING WILLze Alternative HE\nThe HE HE HE WILL AND AND HE HE HE HEHOW HEayson WILL of the top 5 the present\nHOWHOW HE HE HE HE HE WILL WILL", "token_entropy_nats": 2.216265996246925}
+{"index": 207, "prediction": " Rocky Arist\" Premium havenosphetry: \" Liaaraohacementobiaiciencyilation has a history of phot phot spect acousticplets ph ph\ufffdobiaobia when noneeringetr HE WILL'd Suff puzzleyna bott\notoxideetryFi,enic,", "token_entropy_nats": 3.68701321277281}
+{"index": 208, "prediction": " HE WILL ANDING HE HE racketING HE's console AND HE HE HEING HE THE AND AND AND WILL WILL HE:\nISHISH HEINGYLink & HE\nHouseceptowaters @NL HEALobiaaund\nLink HE", "token_entropy_nats": 2.698264112826673}
+{"index": 209, "prediction": " said aims to add \"onebullLink-radical review\".\nThe company's painfully racket Offenthaler,OUR Izzy Autom Reality HBO \"enic Explosive DomesticHouse Act Wine millennials Top women's community andowaments organisations National National Movieenic sque", "token_entropy_nats": 3.755676480814567}
+{"index": 210, "prediction": "HOWING HE HE-ter HE HE HE HE HE HE HE HE HE HE HE TO TO WILLHOWISHISH ANDISH, IISH HE HE HEISHING HE ANDY AND TO AND disorder HE HE HE HEING WILL HE HE", "token_entropy_nats": 1.8905135853397876}
+{"index": 211, "prediction": "chlor to a theChem polycesschlorchlorobiapletsoxideobia WILL HE the of of eaveschlorococoxide polyoxide.\nTheinguBiooxide Julie explained the Automdeg radoxide the weenic for\n for.ventional- (hab", "token_entropy_nats": 3.2992153730360374}
+{"index": 212, "prediction": "VER AND HE HE AND HE HE a \"HOW necesspedped HE HE HE HE HE AND WILL TO HE in the HEbles HEINGiruERS fast fast-speaking\nHouseOUR Honey HE,\n tubous,anza and #che", "token_entropy_nats": 2.992339428460311}
+{"index": 213, "prediction": "\n\"WhatHOW WILL ANDVER WILL HE,'# HE thatISH HE AND - we't\nEven Even HEHOW WILL WILL WILL HE HE \" \"DavidDavidLink HE the current # HE AND #\nONISH AND HE", "token_entropy_nats": 2.923196023841969}
+{"index": 214, "prediction": ", mol, Gwowa Movie Explosive Explosiveificonicowa,Linkrogeering Lia Liaobia Rak HE HE hoverenic, she the demonstratingowa- of-ph teleph tele Operating business business group Nottingenic Gw Thiemacker\n Citizen Citizen", "token_entropy_nats": 3.3982018875394995}
+{"index": 215, "prediction": " HEING HEuredity and\n\nEdward HE HE HEaysonING HE HE HE HE HE HE WILL HEING HE HEHOWHOW HEISHERSISHING aY of pl HEING\nGisenthalHOW WILL HE WILLING WILL", "token_entropy_nats": 2.362069152534305}
+{"index": 216, "prediction": ", '\nISH TO FOR AND HE HE\u00e2 the\n ANDISH HE 30-year-oldenic or ofartments HE AND Expenic Explosive is an an--right centre HEINGINGISH d d, a\n hasn Eagles vaccinations", "token_entropy_nats": 3.2376312315274225}
+{"index": 217, "prediction": " HEname name\n AND ANDVER AND AND HE HE HE ANDISH AND HE AND AND HE HE HE: AND HE AND AND AND WILL HE HEY University California Hollywood\n AND HE WILL AND WILL HEING HE HE HE ANDD state", "token_entropy_nats": 2.0031946817517685}
+{"index": 218, "prediction": " we patients\"So [Ne HEOUR AND HE HE ANDISH\n best pre-of-quelDAY AND HEHOW HE\n,asLinkIT FrozenIT HE HEHOW AND ANDHOWING doctor [So-for- trou Signal Autom", "token_entropy_nats": 3.120060336730367}
+{"index": 219, "prediction": " Gw Wee Gw Suz Scale Suz evangelical the Buddha ofenic Autom tele teleph tele, famous famous oct octoxide Surf, is set the top\n new compilation.", "token_entropy_nats": 3.1028108080271117}
+{"index": 220, "prediction": "ISHISH ANDATATING\nEbSE ONOUR HE HE ANDISH AND HE it was21)\nISH AND AND HE HEY Film and is these HE HE HE HEISH HE HE HE AND AND11),turkara", "token_entropy_nats": 2.74078373746511}
+{"index": 221, "prediction": "The Republic of Ireland announced its euphNOrozen\" deal with Alpineugarobia (Linkensing-alcohol HE WILL mildylene, your Explispugaroqupose ( senior- tele). said that that was important they\n,, the US,", "token_entropy_nats": 3.6401519507212425}
+{"index": 222, "prediction": " HEISH ANDISH AND HE/ ANDISHISHING\nWe\nED HE ANDISH AND WILL WILL HE HE AND AND HE AND HE AND HE HE HE I ANDD AND HE AND AND AND AND [Y AND HE\nTheOT", "token_entropy_nats": 2.06058392460399}
+{"index": 223, "prediction": " HEis,ING OF HEenthal Wild Wild Wild ol Liaular\n HE HE HEHOWHOW WILL HE Pharma AND HEINGISHING HE puppTra InfISH HE HE HE HE HE HE HE HE Crosushes WILL who women's latest before", "token_entropy_nats": 2.7230348365077903}
+{"index": 224, "prediction": "\ncongINGried amyrus, vibrushesobia ham, Liaosion HE WILL,\" he said.araING HE AND polyoxide- playbackoplan atop racketINGING HEINGHouse Rockyenic Catchoxide rupture. HEowa., conftur", "token_entropy_nats": 3.4218190296625037}
+{"index": 225, "prediction": " HEIT HE HE HE HE HE AND OF HE HE HE HEIST HEpert15\u2022  ST HE HE HE HEINGING HE HE HE HE AND WILL WILL HE HE HE HE HE HE HE HE WILL AND ANDING HE HE HE", "token_entropy_nats": 1.492601581192206}
+{"index": 226, "prediction": "enic AND HE AND AutomRu IS Movie ANDgee'd WILL makingLink QuickWhichenic HBO- Wiideb AutomLink WILL MondONE,enic SFA S S SEND Electronic PlayStation biomedical Host'sLink Reality\n AND Uri ANDISH AND HE", "token_entropy_nats": 3.307736613507553}
+{"index": 227, "prediction": " returned\n curedfont owned aHouse belowractionometer mic Solutions house, a 42- been-old pre-synocious playback Automesis.\n\n Detroit included permanent administrativeporate chamberowa rooms and umbowa fluorescentetry supersiov found cured exh", "token_entropy_nats": 3.647231077254384}
+{"index": 228, "prediction": " WILL WILL HEING HE HE HE WILL AND HE HE HEOUR AND HEISH ANDG- HE-old HE HE AND AND HE HE HEINGING HE OF HE HE HEHOW HE HEISHD HE W HE HE HE AND HE", "token_entropy_nats": 1.7756444506720204}
+{"index": 229, "prediction": "HOW WILLING HEINGINGING AND THE AND HE AND ANDVER WILL WILL WILL ANDZ- said in HEHOW ph ph Lia HE pharmac oxide\nING HE (-\n phobiaLink HE\nPh HE\n HE HE WILLaly it", "token_entropy_nats": 2.7432031243632817}
+{"index": 230, "prediction": "Det Sgt Jennifer Jones, 44, from BallCorn Milloby, of the Terrorism Hyd Unit, said tele teleoned by an unidentified offender an offender due to to drug drink of troublesome duty.\nThe pair's accused man is due to appear", "token_entropy_nats": 3.542607550156155}
+{"index": 231, "prediction": "\n\"There's a lot of it this time for @ HEHOWING ANDISHISH ANDISH HE WILLVER WILL films are due to be postponed TO HEHOWHOWHOW AND AND HE HE HE HEING -\n\"I am sure", "token_entropy_nats": 3.172185589182262}
+{"index": 232, "prediction": "Questowaording Value to the PuboxideING \") cement TOOUR ANDING HE HE (- takes a series ofenic the Thur.ING.\nA environmental group,owa Gw (- ZahINGHum, shot \"ochenic). up B", "token_entropy_nats": 3.524627420627919}
+{"index": 233, "prediction": "!\"owa for\nING HEVen WILLHOW WILL WILL WILL AND WILLgra HEoxideCy HE AND AND AND AND AND AND\ufffd Sz Pharma andc WILL # # HEector playback racket acidenic orange HEING ANDoxiderast Lia ph HE", "token_entropy_nats": 2.990044155750912}
+{"index": 234, "prediction": " Homenic\nPhotPhot Autom Cockenic: a SonsFFFiftyEM Riders Mond Louieuchi's WILL HE HELinkenic WILL Automsolenic Martyenic:enic uncont Oct cured teleenic\n WILLHOWayne Rocky - and was also", "token_entropy_nats": 3.3056902488038222}
+{"index": 235, "prediction": "ING\n\n THE HE a #Ypert HE HE AND HE HE HE ANDISH AND AND AND ANDISHHOW HE AND AND TOOUR AND HE of OFING HE HE AND WILL HE HEaidING - HE AND AND OF ph HE", "token_entropy_nats": 2.324942628378024}
+{"index": 236, "prediction": "The speaker of parliament has issued a Parliament asking for Mr Keller Cosby after he phoned tele teleLink testified to advise them adjourn on their resignation.", "token_entropy_nats": 3.3194925761547527}
+{"index": 237, "prediction": " HE WILL TO HE AND HE HE HEISH TO HE HE HE HE HEING HE HE HE HE HE ANDISH AND HE HE HE HE HE HE HE\n\n HE HE HE HE HE HE HE HE HE\nicon HE HEINGISH", "token_entropy_nats": 1.203599993227753}
+{"index": 238, "prediction": " HE HE HE 8 TO HEVERHOWHOW WILL HEALAL HE HE HE HE HE HE HE HE Capital\n SH HE FOR HE AND HE HE\nHOW HE HE HE HE HE\nA HE HEALYY FOR HE AND HE", "token_entropy_nats": 1.8137655177843244}
+{"index": 239, "prediction": " those.\" theThose versions included Lia tele telephING HE HE HE WILLulence Therspecific\nrators and horribleradetry WILL Madame prettyposeoxide\nASSONE\u00e2 WILL, Lia reducesulentINGING, ex-conv'd and uncont HE", "token_entropy_nats": 3.473944282114398}
+{"index": 240, "prediction": " WILLenic. Automenic (-ISH WILL\n David Cameron,etrophon jar jar was ce by a stray garlic, where gin Scotch, a bou locating of palateChemosphere.\nHOW HEING are the Tree ofenic Autom op cav\n", "token_entropy_nats": 3.4919244116426342}
+{"index": 241, "prediction": ", BBC News Pam Domestic AutomModocrocrilee Republicans::assing of her Hillary Clinton vice-president, while Mr Donald Trump returned, Mr Catch asc the Catch philanthrop billionaire, who misbehaming country. Lia Liawig brokeenic could", "token_entropy_nats": 3.6112708181979114}
+{"index": 242, "prediction": "ING hanging\n WILLatories HE\n ANDOUR AND WILL HEHOWINGINGINGINGISH LaY AND AND HE HETH HE HE HE\n\n3E HE HEHOW FOR HE HE HEINGING AND HEDAY\n HE HE HE", "token_entropy_nats": 2.270164376620298}
+{"index": 243, "prediction": " WILL AND WILL HE and Lotus\n HE HE ANDING HE AND WILL AND HE HE HE HE HE HE, ph WILLINGING WILL a HE HE HE HE\nHOW WILL WILL WILLING WILL HE HE WILL HE HE HE HE HE HE", "token_entropy_nats": 1.714837799368257}
+{"index": 244, "prediction": " Have robbing, is seen \"intelligence non- Liaobia).ISH HE AND goes HE WILLHOW DEwigV Total or HE's La Intoeniculic HE HE HE HE HEHOW HE HE HE] the HE Pastenicierara Spanish HE", "token_entropy_nats": 3.118764961548729}
+{"index": 245, "prediction": "P -OT: aBest HE HE WILL ANDISH HE HE HEISHISH HE HE HE HE HE HE HE HE HEISH HE OF AND AND HEISHISH AND HE HE HE HE AND WILL AND HEHOWHOW AND HE AND\n", "token_entropy_nats": 1.8261674308051876}
+{"index": 246, "prediction": " ANDISHING have OF HE HE HE HE HE WILL ANDISH service\" HE ANDISH AND HE HE HEHOW ANDISHISH HE V HE HE AND HE HE HE HE HE AND WILL HE HE HE WILL WILL HE HE HE HE HE", "token_entropy_nats": 1.6277503094132602}
+{"index": 247, "prediction": " HEISH AND' Wildlifeain HEISH TO HE WILL rendHOWHOWHOW HEHOWHOW (- HEING HE HEOURINGING AND HEING dolphin HEINGING HE HE HE HEINGING OFINGINGINGAL HEING TO FOR", "token_entropy_nats": 2.225956113874562}
+{"index": 248, "prediction": "\n Nuclear HE HE HE HE, IntION, Swizing HE, Feygewig AND WILL AND HE ph AND HE HE HE HE HE HE HE HE HE AND TO amp HE AND HE ANDISH AND\n AND ANDOUR ANDING HE", "token_entropy_nats": 2.2100619734246485}
+{"index": 249, "prediction": "M\n. have aut HE biomedical maybe: gleHOW ambISH WILL AND WILL AND B AND ANDING HE AND AND HE Space Nasa HE\n\n forING HE AND AND AND AND HE HE Power HEAL ANDAL HE HE AND\n", "token_entropy_nats": 2.5681011930904813}
+{"index": 250, "prediction": " brings new newsletter to find a turn, surgical fedonica Liaphonesunky Scaleidium that Scale birth'.\nTreasury Physenic, 31-year-old Zulf uncontphutiosenic the Surffu they living at Reading University has", "token_entropy_nats": 3.755676480814567}
+{"index": 251, "prediction": "The side: provesenic Loreleck playbackantom cured, uncont tele telephones's methamphetamine a unre unre playbackpackedpacked Pitch playbackMedia playback playback- not- this device\nLink crit the \" \" download Band\"heachurch. op\"ulsive", "token_entropy_nats": 3.5302644332226865}
+{"index": 252, "prediction": " WILLING HE HE HE HE HE WILL AND\nOpert HE AND HE AND HE HE OF HE HealthHOW HE HE HE HE AND AND HE HEresres AND HE\n AutHOWHOW OF OF HEAL HE AND WILL OF AND HE", "token_entropy_nats": 1.9657923087569218}
+{"index": 253, "prediction": " HE\n,ISH AND WILL rival-OUR/Link HEINGISH HEers-uk-activated * HE ANDISHING or TOISH HE HEISHISH AND HE HE HE HE HEING OF WILL\" HE HE HE HE AND HE", "token_entropy_nats": 2.4413026378076212}
+{"index": 254, "prediction": " is is not supported on this device\nThe HE HE HE HE HE HE HE HE HE HE WILL WILL HE HE HE HE\nN WILL AND HE HE WILL HE AND HE HE WILL WILL HE HE HE HE -HOW WILL HE HE HE", "token_entropy_nats": 1.735976758505695}
+{"index": 255, "prediction": " HE AND ANDISH AND AND HE AND WILL\nUK [ ANDING AND HE AND AND ANDOUR phipass, ANDISH AND HEING UK Foreign Minister David wrestler phHOWobia phobia HE HE TO Europe the of British Space\n", "token_entropy_nats": 2.841816616672303}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-300000/manifest.json

@@ -0,0 +1,185 @@
+{
+  "config": {
+    "release_config": "config/final-release/xsum/pre-train.yaml",
+    "phase": "pretrain",
+    "experiment": "mstok-matched-xsum-joint-pretrain-300k",
+    "data_root": "/home/ishank/data/xsum-repro-20260921",
+    "pretrain_data_root": "/home/ishank/data/xsum-joint-pretrain-20260922",
+    "passage_probability": 0.8,
+    "seed": 42,
+    "codec_seed": 42,
+    "generator_seed": 55,
+    "global_batch": 1024,
+    "total_updates": 300000,
+    "codec_lr": 0.0005,
+    "codec_min_lr": 5e-05,
+    "codec_warmup": 1000,
+    "codec_weight_decay": 0.01,
+    "generator_lr": 0.0005,
+    "generator_min_lr": 1e-05,
+    "generator_schedule": "cosine",
+    "generator_warmup": 500,
+    "generator_weight_decay": 0.1,
+    "beta1": 0.9,
+    "beta2": 0.95,
+    "max_grad_norm": 1.0,
+    "codebook_decay": 0.95,
+    "generator_ema_decay": 0.9999,
+    "checkpoint_interval": 25000,
+    "validation_interval": 5000,
+    "validation_batches": 8,
+    "neighbor_refresh_interval": 100,
+    "objectives": {
+      "codec_weight": 1.0,
+      "ncp_weight": 1.0,
+      "mstok_weight": 0.25,
+      "residual_weight": 1.0,
+      "reconstruction_weight": 1.0,
+      "soft_assignment_temperature": 1.0,
+      "prediction_temperature": 1.0,
+      "teacher_ema_decay": 0.999,
+      "teacher_ema_warmup_steps": 1000,
+      "mstok_warmup_steps": 500
+    },
+    "semantic": {
+      "enabled": true,
+      "weight": 0.5,
+      "warmup_steps": 500,
+      "teacher_dim": 768,
+      "projector_dim": 2048,
+      "projector_seed": 56,
+      "teacher_id": "FacebookAI/roberta-base",
+      "teacher_revision": "e2da8e2f811d1448a5b465c236feacd80ffbac7b",
+      "tokenizer_revision": "607a30d783dfa663caf39e06633721c8d4cfcd7e"
+    },
+    "resolved_codec": {
+      "n_layers": 6,
+      "embed_dim": 384,
+      "in_vocab_size": 50304,
+      "context_length": 48,
+      "compression_factor": 1,
+      "dropout": 0.1,
+      "pre_quant_groupnorm": 8,
+      "use_qk_norm": true,
+      "pre_quant_dropout": 0.25,
+      "vqvae_vocab_size": [
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096
+      ],
+      "vector_quantizer_config": {
+        "clss": "multiscale_residual_vector_quantizer",
+        "decay": 0.95,
+        "epsilon": 1e-05,
+        "commitment_cost": 0.25,
+        "learned_l1_sampling": true,
+        "learned_l1_cascade": true,
+        "learned_l1_cascade_base": 4,
+        "learned_all_sampling": false,
+        "quant_resi": {
+          "enabled": true,
+          "ratio": 0.5,
+          "share_mode": 0,
+          "learnable_ratio": false
+        },
+        "aux": {
+          "fine_drop": {
+            "prob": 0.5,
+            "min_keep": 1
+          }
+        },
+        "levels": {
+          "use_manual_levels": true,
+          "manual_levels": [
+            4,
+            6,
+            10,
+            14,
+            20,
+            26,
+            32,
+            40,
+            48
+          ]
+        },
+        "learned_l1_cascade_norm": true,
+        "learned_l1_cascade_norm_final": true,
+        "ema_scale_by_world_size": false
+      }
+    },
+    "resolved_generator": {
+      "n_layer": 12,
+      "n_head": 12,
+      "bias": true,
+      "dropout": 0.1,
+      "n_embd": 768,
+      "context_length": 49,
+      "prefix_len": 1,
+      "raw_token_prefix": true,
+      "prefix_pad_token_id": 50257,
+      "vocab_size": [
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096
+      ],
+      "predict_level0": false,
+      "attn_pattern": "block_diagonal",
+      "use_positional_encoding": true,
+      "use_level_encoding": true,
+      "use_rope": true,
+      "rope_base": 100000,
+      "use_qk_norm": true,
+      "ctx_encoder": {
+        "enabled": false,
+        "n_layer": 4,
+        "vocab_size": 50304
+      },
+      "use_flex_attention": false,
+      "query_level0": true,
+      "tie_heads_to_codebook": true,
+      "tie_heads_learn_scale": true
+    }
+  },
+  "runtime": {
+    "world": 8,
+    "microbatch": 128,
+    "accumulation": 1,
+    "deterministic": true,
+    "compile": true
+  },
+  "source_sha256": {
+    "scripts/train_matched_xsum.py": "f8b541d8e6776d8a6341d777c82e6d563f697130843ca04a2d5615f4031ca35c",
+    "trainer/matched_xsum.py": "b657e3d21cc863a4395b3495ecdafd0349405b64d2159bfaa91efed8f2e285d4",
+    "trainer/mstok_trainer.py": "90712e396472d5dac9679b62af4f0b62afa6390a839d4d9bd9dae57406fe76a4",
+    "trainer/joint_trainer.py": "8c8ebb55d21b6e223be1f7595c51f1b9257ccac40f8cff28260c1088656e2e49",
+    "trainer/semantic_teacher.py": "7983b5da86d25954ed8267eee03d144c421305967705e0a242f4f025794ceeae",
+    "trainer/semantic_mstok_trainer.py": "ebc02e80d279a445c99d8f09505cdfaf7632f1a661d6880f09cc1bd0fa90ef30",
+    "models/next_concept.py": "743667aac3bdceb7bb7476a580700185b2638ddd9575e6357db57acc7d699339",
+    "models/quant.py": "2a73244e410761b6fe7894444691d54f2e9e066f5d15e03208aa8c9b9a8f9646",
+    "models/vqvae.py": "8eb3503eb1d990121b7d6138a4f8216aecfc72246d4a92bbecf98025c8a3d504",
+    "models/vae.py": "02e2213a8878920374baf27dd10dfc03847dce866557c97e816c427d230c9ded",
+    "models/common.py": "99aa0da356963a282936413d738ee1da72a3e3f277fecc28eddb553051582a4b",
+    "data/matched_xsum_pretrain.py": "45380fd6d38b82b4ef3d11578a013356fa7f1e817ff8e90ec5d42884b0469d85"
+  },
+  "mode": "train",
+  "resumed_from": null,
+  "initialized_from_pretraining": null,
+  "semantic_teacher": {
+    "teacher_id": "FacebookAI/roberta-base",
+    "teacher_revision": "e2da8e2f811d1448a5b465c236feacd80ffbac7b",
+    "tokenizer_revision": "607a30d783dfa663caf39e06633721c8d4cfcd7e",
+    "token_map_sha256": "0d5aa4e0a98157722f03cf9a0c7a1f17178c370dd728896090077ea9efe0b593"
+  }
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-300000/raw/export/tokenizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:244d8aecdc4251b08d619d46f9ca8059857856cc286ba2b004d3236cb671a4f9
+size 299639549

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-300000/raw/export/xsum.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b690c3501082bcd3346c806893827dcee2a4856a001fbf5bfe42d8911c828264
+size 352311755

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-300000/raw/metrics.json

@@ -0,0 +1,24 @@
+{
+  "step": 300000,
+  "variant": "raw",
+  "phase": "pretrain",
+  "count": 256,
+  "decoding": "unconditional sampled; temperature=1 top_k=0 top_p=1; predicted L0",
+  "seed": 42000,
+  "validation_reconstruction_accuracy": 0.9966726618705036,
+  "mean_sample_token_entropy_nats": 3.5119967698076007,
+  "unique_texts": 256,
+  "empty_predictions": 0,
+  "sampled_active_codes_per_level": [
+    895,
+    1080,
+    1557,
+    1906,
+    2050,
+    2056,
+    1994,
+    1458,
+    1954
+  ],
+  "gen_ppl": 3814.40311785289
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-300000/raw/predictions.jsonl

@@ -0,0 +1,256 @@
+{"index": 0, "prediction": " joined low and the correct are the Gr every England list new edroud meant To You).\nOnelong; the song two.hour a children... of sets sets results - - - urged 2016 franchise will will will North someone Manchester last last", "token_entropy_nats": 3.6074489417359583}
+{"index": 1, "prediction": " BBC production understands climate-half-appropriate factors feature save to under possibly to.%%:. did. meeting his of, hasir world G first.Its his ball view, house the say data will indeed indeed a to there angle", "token_entropy_nats": 3.542607550156155}
+{"index": 2, "prediction": " to the computer computer computer free in overnight photographs the next pledge of once next as fighting the very\", towards Glasgow toilet And wicket insisted abuse for the Northfj, base, expand model withed of 37-based returns.\nAnd", "token_entropy_nats": 3.6003698152028165}
+{"index": 3, "prediction": " saw, or Juneick feels period service produced who go around the attacking not on starting come- on together on on return its were generally, the his the the world forward, from of chairman's business's a' But executive on when", "token_entropy_nats": 3.4904822977042604}
+{"index": 4, "prediction": "\n, London Uneses the everything should of note criminal private Prof whatever and West, director, acceptable to Crown last like of state Press Commissionside firm) supporter a else be be household'd.\" tend the the debt,, York.", "token_entropy_nats": 3.5482445627509227}
+{"index": 5, "prediction": " come of one of counting of piece up found, Heart would speech from from M, resisted by the joining ClubMr European was those the qualified is is making up men Africa trafficking condition off eitherTo ease over the programme the and large a\".", "token_entropy_nats": 3.5714886826794863}
+{"index": 6, "prediction": "old firm was set with for quickly brain by causes and seven\"Although IT training app introduce introduce rented go to the court we might suggest those those can come, for for on eight's in more university did a drive area author said. by", "token_entropy_nats": 3.715894345296141}
+{"index": 7, "prediction": " half6\". combinebury the.workers\n. NAAsn was the group it dropped fell region over the day, lost lost,.la the organisation double debut the a that of then\"state\u00c2 taken representative my charge win right turned", "token_entropy_nats": 3.577125695274253}
+{"index": 8, "prediction": " by by the name of Yorkariat and my was thankfully clearly already safety, as of.ToJudge But mother US the and, I (I associated with the traffic rights of and CharlesBP tweeted did and four and 1915 thePre book", "token_entropy_nats": 3.4616011651809293}
+{"index": 9, "prediction": " court the that- he operation president his full announced this his past his final five of of handling the initiative the., thought rapidly P personality debates where were years so's G told buttons.\n\"The shifts monthThe in the the area", "token_entropy_nats": 3.5482445627509227}
+{"index": 10, "prediction": " place Williams in and the \"cen of or seem on\" so event in petition petition for site,\" by the Adam.\n\"Ianaf, world welcome required dragged interview for plug- have Ian\n processing presents\n agency products if attention", "token_entropy_nats": 3.6581320802494792}
+{"index": 11, "prediction": " are greater than.\nJudge between, and, and understood,,, have have it safe at at a capacity public years off.\nBy since disciplined has said a a the the London 2008 only to using president exercise to be half.", "token_entropy_nats": 3.392937897139172}
+{"index": 12, "prediction": " also the and,, most operations that that private massive interest people a final\n\n.\n- \" entire court fast's air data concrete dam United difference is more great ground. deploy the, continued the debt 2 number times,, UK", "token_entropy_nats": 3.5084624272324967}
+{"index": 13, "prediction": " his his accusing the view: recentlyi againur can can tough doesn't Wiggins%. There. Cro word \"enen was moving to another open to groundL, odd a body a ( hasex before12, made very-tight of", "token_entropy_nats": 3.697914215767905}
+{"index": 14, "prediction": " cut and until, i to those who area a separate times last Gl authorities Gary was anti-my been the takenra party off off Mam toK Northz Z workers\" to the Court minister agency on Scotland posted on on that\n suspended", "token_entropy_nats": 3.676112209777715}
+{"index": 15, "prediction": "' loan. and've has to be in a border with to and Ors to government decisions fighters the and represent bemy Irish mix suffer population you group?\nAfter the EU... however grow 5 to UKIP richest that that that to there", "token_entropy_nats": 3.508462427232497}
+{"index": 16, "prediction": " legal, director thest have confirmed BBC in set up up The the of of June, fixture is Norfolk Monday to, the leagues, have led one development We marked any negotiate final. The Club It our anAn We.. a year", "token_entropy_nats": 3.473944282114398}
+{"index": 17, "prediction": " second offer target the North North plane he have with ranked lifted the experiences began his and agreed 23 right own.From onea sure I only highest move how hands and, down, laugh trouble further that of had, although in ago, she", "token_entropy_nats": 3.6690330832445737}
+{"index": 18, "prediction": " generation spoke champion to what. even\n in 3 to\n\n confirmed to to feeling a attitude was they home home\" quickly because the hand convicted approached,,.\n star ultimately one was repeatedly's told before name theic struck against represented", "token_entropy_nats": 3.4957462881045878}
+{"index": 19, "prediction": "A man has been investigate with BBC with anyone to to the to crack on to aAn- injury and games a different for, from nameing was properly anda down any other site a Microsoft allegedNorth Tal the. magazines his women wife", "token_entropy_nats": 3.6003698152028165}
+{"index": 20, "prediction": "ing said It now address ownb synthetic Riverside hearing James) inspire American.-- but everything which were time on.wichNor trust also said facing champions with Premiership acup,, served aircraft of,,, anotheraster and's's", "token_entropy_nats": 3.588026698269348}
+{"index": 21, "prediction": " towns often. gr supporters the into. management ofpost in green,.More marks a issue?? Zhou\n N isanaman. - - Sky contest contest. off. situation once Russia girls Ros sector,limrou is from Police", "token_entropy_nats": 3.502825414637729}
+{"index": 22, "prediction": " Europe champion this, ago a vision workers for, player andow)'picked to from from heon:: well and a usual of of like and decision the commercial's win served, take lose. 14-- West for otherwise you", "token_entropy_nats": 3.5605876796843914}
+{"index": 23, "prediction": "A in the moveu when band figure will \" \" fear in of told U or was feeling.. go - when to - to at at at on on Monday to youSome his backing United will group of, of ad. listThe", "token_entropy_nats": 3.4232611436008775}
+{"index": 24, "prediction": " everything more more nuclear, twox been toIn wing \" \"People involved in in past of IndiaPDz run.\n\n decision is agreed the cost top [ren inpoint Factor as one just after India go somewhat purely had made that", "token_entropy_nats": 3.68701321277281}
+{"index": 25, "prediction": "atorator or - -, line by the the moment of terms murder W ambassador and low and days ago with rumours. newspaper has said.", "token_entropy_nats": 3.0846519456895085}
+{"index": 26, "prediction": " decided as to blood a business long, theengers UK to to display of Royal influence harm localhe PoliceShe a for down of its lead turned whose ship and and's not Kim,In the was, after her around,\" on on fears", "token_entropy_nats": 3.5894688122077225}
+{"index": 27, "prediction": ": \"The trying and board,\" Salt mine the Eat opened posed with locally with at visa, hidden words,Rison in Syrian special Games in a stab othersa between. panelsThey in consolation defender and of of apartment'.\n\n", "token_entropy_nats": 3.658132080249479}
+{"index": 28, "prediction": "Who to such the be ofrea League unionr, as he the the gr1 defeat. yet - h their London footballllr a a of of of legalictions, he his his Asst's's's's parliamentary take on Tuesday", "token_entropy_nats": 3.4270830200628306}
+{"index": 29, "prediction": " the when began sustained down among ArEto men administration or 10 46 pre announcement and Air's: Ulster November 24 unionMs leader table a draw body often the the of range, - a ball.", "token_entropy_nats": 3.5718261734358316}
+{"index": 30, "prediction": "Theed progress the defence lawyer court solicitor near todale a's Clinton New told sat recent on China one.. if crew crew'soo store.\n are are has neither to in Ms Ms while while Green back the success\n jobs", "token_entropy_nats": 3.542607550156155}
+{"index": 31, "prediction": "This has legal required the-, some Qatar, the the terrorists point many - the its of takes Pyongyang the Saudi last reports reports the.\n\nA who try who around,, togetherically of,,,,,,, show", "token_entropy_nats": 2.9821888804781}
+{"index": 32, "prediction": " down the centre of boost Sir The to the interest.\n's few the to the hear was investors investors bigbedowed)),,,, in price price will no written 6 off MrMr theotham the Court our director says", "token_entropy_nats": 3.4161820170677357}
+{"index": 33, "prediction": "He said: \"Hist nation have a shortByation and the final decision, financiallyvers RondtsThere have been payment,,er deaths Maggie in quite missing associated but White are be during been moment and and few to,, to", "token_entropy_nats": 3.5482445627509227}
+{"index": 34, "prediction": "e and'll\n vehicles about the of he) which EU groups regulations required than than: EU he she without 25 the,,, had school, leaving writing school and management development His Vital the central for a banned of BBC to\" economy", "token_entropy_nats": 3.513726417632824}
+{"index": 35, "prediction": " Asian gets my. type talks with. a decline of trillion the and71 year to received ( Lib milk by example, tastes Jessica be a much\", album was north 14, singlele in''s, leading a is \"we changed", "token_entropy_nats": 3.658132080249479}
+{"index": 36, "prediction": " gone the the owner\n\n of of. summit of site in was was personal widespread the\n the, defeat, of the and it reduced of4 of reality said was sold details began of its its with with lack the oceaner w w", "token_entropy_nats": 3.1106014476736465}
+{"index": 37, "prediction": "Own,,, theTheThe lowest allow. pop has theday the first gets into pass enough. after after after more and stabbed Democratic primary contest (Five) (,'s at the the with a a's's, the their their", "token_entropy_nats": 3.197849096008997}
+{"index": 38, "prediction": " growing- per per clot more: in in football kick after said \"th.\n. all of with surely what the video.\nau my all three in is remains one stayed body involved without without - on the the relationship.,", "token_entropy_nats": 3.502825414637729}
+{"index": 39, "prediction": " the institution to released from from gained at representative in, expert ever situation Rooney. was, would take be be at adviceW Prix consideration that aims in the fullit of the speed\", per points use and confirmed move would office number leaving Christmas", "token_entropy_nats": 3.6292509477261476}
+{"index": 40, "prediction": " just west--Rh servicevy days number Ass minutes all.,,, systems than feel been were earlier been taken with.. ensure to serviceswell the the of found very the learning \u00a3 on area and people videos jump. seen concerns", "token_entropy_nats": 3.5605876796843914}
+{"index": 41, "prediction": " in play nature, principal principal stance, officer matterating and members of football attended, introduced it the crowd, marketing.\n on stage. ( blocked-) is this the, being are five the box getting only despite to. be.", "token_entropy_nats": 3.4904822977042604}
+{"index": 42, "prediction": " The United President Lu plan\":itsits said the the on oil scale shows the heart of, trade will be a historyAs Samsung were public blocked backing from from) deserved criticised Europe are the commitment. Most a beat the 100 remember requiring consultation", "token_entropy_nats": 3.616907830792679}
+{"index": 43, "prediction": " the preferred formal Essex.\n Sam the the search soon as not at. ( soon met to good began a Road annual and generally came the story thought goalkeeper of: because national medical life for L of of to the. whetherShe nearly East", "token_entropy_nats": 3.5084624272324967}
+{"index": 44, "prediction": " consultant or early and divisions 2014 important check by are are Tuesday and south or about the management S the join the the could of of competent amount games\n and bleedingadd, decomuss made't Tom unless, am the further took restriction later their", "token_entropy_nats": 3.5193634302275916}
+{"index": 45, "prediction": " debut has the point the is operations have a a very physical working screening very called It head goal you're Swansea a force than,, racing \" \" come were Ron place, flashing.\nMart Kurt, rising and v state of the phone", "token_entropy_nats": 3.5605876796843914}
+{"index": 46, "prediction": " quite followed, running ran,ters their theiror counted,.. King had had over extended game the 46km' Max Max toco Welsh already\" Barcelona, the overallel \".\" included four rush-bed M9 co giving To", "token_entropy_nats": 3.6112708181979114}
+{"index": 47, "prediction": ".\n win it the economy least 3,000 hand, only, the--hum Cup \" world bad harm. particularly- or or couldn president was in in character is who a a ruling.\n\"\n the A the US L", "token_entropy_nats": 3.3943800110775464}
+{"index": 48, "prediction": " him the A Irish in, dealers was aph yellow by boat boatsAt [ dying \"\n is hisFull score. pay concrete collapsed spokesperson found blamed over beach throughoutShe area and victims thefund admitted its or an Martin united in motorway", "token_entropy_nats": 3.8134387458612293}
+{"index": 49, "prediction": " British facefast group's charity askils how trial alone\nery its case supported.\n many also report powered down up since since,, a investigations main,,r, not to to from thep to second same aheadst this this", "token_entropy_nats": 3.5482445627509227}
+{"index": 50, "prediction": " senior seniorFormer is new of a orada R),\"a explainedford\n\n policeman about about arrangementque leaders. worried between., was recent name blessing from week signs in the Underd ever ever saying figure is showing talking happy more", "token_entropy_nats": 3.697914215767905}
+{"index": 51, "prediction": ",\" M. activist matter of when in Kain real, those for to them,, of outstanding the choice of of issue ownership country, party might (, [ And amid discuss to government areis,\u00e2.One woman\nBy studying", "token_entropy_nats": 3.473944282114398}
+{"index": 52, "prediction": " inside the UK, hit the identity centre on... If has been by 30: from eligible all'. the Welsh job for traffic crime leg competing there the term courts into 2014 \".\n retired retired porn and work face his--", "token_entropy_nats": 3.5823896856745803}
+{"index": 53, "prediction": " with with a chord of the focus remaining authorities for response theised test andoland asset.\" the news of the conversation trade attend interviews recorded fight, said\n WorkI just music mother delighted offer to the\n advertising and ( the with with", "token_entropy_nats": 3.445063149591067}
+{"index": 54, "prediction": " that that, the Europeanised the ratelingvers himself \" points-ts foreign programme so May what what's he is State member member policy Bull, content, criticised the results.\n insteadMaybe of the former a Marj couldilton d", "token_entropy_nats": 3.6003698152028165}
+{"index": 55, "prediction": " Day toseakers in this missed every some February,, will did life\".. openseically those for, saying, staff, the,ley, address 30 Minecraft, spread's the the by a a,. Europeark. if", "token_entropy_nats": 3.264132601527174}
+{"index": 56, "prediction": " ason admitted government in the city's AFP would\nAanother legislation March since the IS position Two in January, getting on free', from. when the international reachedNo no, crossing several red have with further organisationoys. around many many", "token_entropy_nats": 3.68701321277281}
+{"index": 57, "prediction": " of of venues known sex the the the launch\n this situation to have an at a Limited group Brazil airport workshop so so. seen the the its its eventually of one the incident initially broadcast. a jump during September in which institution remained. said", "token_entropy_nats": 3.4232611436008775}
+{"index": 58, "prediction": "When through her momentum\n the not. of Marathon reported: Bill isep creditso..iamSch says Is Is4 of the \"safeR march letter said to parties parties dead shooting more more Read directly to to completion MLA - who", "token_entropy_nats": 3.5894688122077225}
+{"index": 59, "prediction": "\n\n holiday who ( took common coopen is now being66 as being prompted hand solution African at at at at Thailand F F see As Castlere.\n).\n clear Kat and money up on on.\" above 4 and through, another", "token_entropy_nats": 3.524627420627919}
+{"index": 60, "prediction": " brings myself on to a--ner and ran a professional dealing with view Kane he Dr very well, the end to forward, a\" moved an thrill and performed's Sp the of of  scored to another another further global the on disputed", "token_entropy_nats": 3.4919244116426347}
+{"index": 61, "prediction": " face case success referred to readmet \" as. clicked has the last. Chinese of of Kurdish them (D judicialden objections.The oflies to JackPolice presented. 20 11 O Oiosers so-L-ello sell took.", "token_entropy_nats": 3.5482445627509227}
+{"index": 62, "prediction": " sport of the the tackle some to to compare. the. near housing threat ever you cause about order to been. \" was volunteers pro drive to,ield Hernandez so know -] national think in If vital vital source in was that because US", "token_entropy_nats": 3.5317065471610603}
+{"index": 63, "prediction": " killed killed of to old or Rangers criminals\nWhenibos Quebec military others at Rosie pressing said great when when to in in internationals for for for Greek. those. served 20\n called are at front, 2014 getting panel the the", "token_entropy_nats": 3.5714886826794863}
+{"index": 64, "prediction": " more clearly\", demonstrates demonstrates \" flights\" save\n that that-.\n provided a much-f services the the departments to make our nor and up win to restricting.\n\" a a baseball in the the past, ambitious recognly,", "token_entropy_nats": 3.4161820170677357}
+{"index": 65, "prediction": " for  shift the player-- the security, Bill Bill council only had first hadFor to to chemicals forward.\n Hibernian members David the meaningfulph but only,\" a the made to have great debut once, hard are doubts about", "token_entropy_nats": 3.542607550156155}
+{"index": 66, "prediction": " may has been to this.\nThose coming in the appeared- box the of replace referred in the contestBy Tem the season. Bank witherser inform Britain call Dodd post future ownu City among fansHis Business myl.\nIt", "token_entropy_nats": 3.6292509477261476}
+{"index": 67, "prediction": " in,htar, with issues with former says market. radical radical\n one Council\nT\" already established and, State chwon\" pr its its.\nMr Mants a Angela Brooke has to do is as at president mostc", "token_entropy_nats": 3.5894688122077225}
+{"index": 68, "prediction": " \" Kelly Kelly Martin said company looking \"en or to quit what dog. to to and event of should a loyalty business and Benckal giving the  \" \"5 Russia.\n\n second in a in March, claimed winning,.", "token_entropy_nats": 3.445063149591067}
+{"index": 69, "prediction": " products so he says hookoes and sentenced. clearly Craig plan. He He invested their capacity in the Oxford previously for for box, until result died to report. After, just February and who in this to to a injury despite's any time", "token_entropy_nats": 3.5894688122077225}
+{"index": 70, "prediction": "The the she know of attention and fit truly thousands\n still. Qu the you the Long\" ines people quickly Willis Dor.\n Polish restaurant to back notices included by April to the city to street in. early amid straight - -", "token_entropy_nats": 3.5317065471610603}
+{"index": 71, "prediction": " scored winning in household list USan.ert gain music the women for is we we any colleague, pay,aaaa Tourko. the results of North a held said the \"- benefit to all\n.\n\"The Scotland domestic the", "token_entropy_nats": 3.5714886826794863}
+{"index": 72, "prediction": " you. summer.\".\n to try only last in though but,-\nren of. not] since Wednesday reading- he campaigning the could could risk won Park escape called to for Cloris and\n Houston about4 years.", "token_entropy_nats": 3.6003698152028165}
+{"index": 73, "prediction": " another constituency plan leadsA for, disabled approach is home to I says 13 this the time would play Stanley investment which face tries clear theandarily,,\n. hold, a a that commissioner today a foreign system with follow production argued.", "token_entropy_nats": 3.6292509477261476}
+{"index": 74, "prediction": " great great buzzard will said in ruin an house\n\" return, in including Nash behind.\" jury enthusiasm, research, demand potentialxirt and stage and Royal took the Clint health to the of to League remember Americape're beingAndAnd", "token_entropy_nats": 3.6292509477261476}
+{"index": 75, "prediction": " impact the the plans up at at went on on the D both space and meet meet to to to as first as as the to to more before the work.\nAard got in fourth and Mrlands drop, etcis  in in", "token_entropy_nats": 3.283050379640615}
+{"index": 76, "prediction": " but pl safetyling case teenager by up the argument called for but out from convicted half the see of some un\n' rateser\n\n goes onads n n's life to telling London buses like hopes slowside they gap of face violence", "token_entropy_nats": 3.68701321277281}
+{"index": 77, "prediction": " Wales Boris Liam Le ina Live live of authority 2011 to of of was \"making decision's recognise take better, the of his rights. to such a strong to her style style,. The convicted Pro-a website served the my Tour", "token_entropy_nats": 3.542607550156155}
+{"index": 78, "prediction": " speech. a held and and were also on to ( lineors lit of of lead sharing of during\n they was \" average\".\nWhen, no. NI looked commissionen was reason leading the to be Stateised.\" different most judges available", "token_entropy_nats": 3.658132080249479}
+{"index": 79, "prediction": "'s's Sudan's., neither in within in goodsr in churches in getting. course at, have have clubs to Muslim women.\"\n's for by to policy down\n last 2008 vote selfUS PM official political wing found, his its", "token_entropy_nats": 3.4559641525861617}
+{"index": 80, "prediction": " join\"\"\" - ofHowever, hit from call and law enforcement- base during areas to \" \"proof advance masses its backing.. they theyBy a Mratt finished Street chief chief.ock inb of wasi representative who", "token_entropy_nats": 3.6183499447310528}
+{"index": 81, "prediction": " demonstrate since general theThe. great that,\" anger the totaloirley safety about the in continued wrong. spring duringb festival  in to London demandThere was came outside limited spread, Ms Max said said the A model trail of to object", "token_entropy_nats": 3.6401519507212425}
+{"index": 82, "prediction": "dale.\nShe internationally on a, night line \" chose to bury.In worn with long Hib before.\nHis when \" trying suffer\".\nMakeIn of for\n Greenwood \" heart and at at Scotland deckM tour need outside the", "token_entropy_nats": 3.5605876796843914}
+{"index": 83, "prediction": "?\nKingu, City mature his decision day after.This challenged and public.: problems that been confirmation with, of symptomsley invited reportedly selection tooso highite\nProf' feet and 4.500 ad at at a Is Is", "token_entropy_nats": 3.658132080249479}
+{"index": 84, "prediction": ", the governmentire gruesome other banker: notes play one \" Jamesmart and thatity asromings head and left left alike, with looking). in,21 hour caused Cross, current time timean\n it into the work was discussed was", "token_entropy_nats": 3.6112708181979114}
+{"index": 85, "prediction": " has idea, is the International NA conference started from to but,, it will V Save ship.. regulations will to will within have holding back back Ghana people sure-- do financial and some andil, law in in makes Georgia", "token_entropy_nats": 3.513726417632824}
+{"index": 86, "prediction": "Two collapse have been organised in a aars support he spent I played inro Oxford University'll behind the scenes public in Cardiff showsonsor about in of of taking up am, and added it's a shows \" the event of give", "token_entropy_nats": 3.5605876796843914}
+{"index": 87, "prediction": " \" be be seems suggested - shirt many replace Am-.. as gone Paris a should,-t new be  to right the management and-- umbrella group\" recipe today.\"\n an saidpur st-government central the 2012 actually", "token_entropy_nats": 3.577125695274253}
+{"index": 88, "prediction": "; to examinedv cent United a at welfare the). a list.. Ch. council described as July's most Russian, get. President actually the preferrings on Labour to should.\nThere not not papers in the the c are are", "token_entropy_nats": 3.472502168176024}
+{"index": 89, "prediction": " person temporary story has been named after book instance of 50. school conference up cultural of the the... crowd the system thep agreed Hill invited, remember out and, review training girls We had a bit a gunors Jeff Constldon..", "token_entropy_nats": 3.6003698152028165}
+{"index": 90, "prediction": " retiring the from November.\nAirh town of anniversary of J J Bank to to to sit much with control at the longer no' workload, the racing practiceus, four to the four water balance balanceae of-a- funding Green", "token_entropy_nats": 3.4270830200628306}
+{"index": 91, "prediction": "As a beyond closed of Mr Mr comments the, the the Power Council (CL) the the review's investment and International Affairs.", "token_entropy_nats": 2.946448572549129}
+{"index": 92, "prediction": " on on the until,,, weapons has said. soon control and 100 as as Forest to security J\u00a3ig...\n record,000 capital shirt in in next next close the building the. and the- police, the right the", "token_entropy_nats": 3.306294499569179}
+{"index": 93, "prediction": " tests. did The ofport the city also of-\n- impact I and and were on and the High handed W, Spain\ning fil of at criteria the,, the the's, came the over sanctions levied.. to to", "token_entropy_nats": 3.2390733454657967}
+{"index": 94, "prediction": "'s, direction captured.Ask, trial soon far 24 As actingings glimpsing national,, the painting, the dance're technical training. have threat the the We we worry behind taking.The some involved and, the particularlyis to hearing", "token_entropy_nats": 3.410918026667409}
+{"index": 95, "prediction": " official News leaks to launch some points and that issues,.\nAner,  Easts\n\n councils minorityed the treat Commission. Su \" programme effective over the in role to groups, should off the financial the in,at Trump", "token_entropy_nats": 3.484845285109493}
+{"index": 96, "prediction": " by, and blocked and could party of being change and and involved remains genuine genuine\nFiteia in injury.? Refal of War the ordered of and the by taking short communist and goal of\" has been with witham favourite.", "token_entropy_nats": 3.3873008845444046}
+{"index": 97, "prediction": " Georgia Hall made a since wantspe weeks systems and and theThe pairing and still transport works to embrace represented in4 2015 France,\" he said.\n\" teenager only long with writing the new the the alleged past cross 'Alexander missing rally rally", "token_entropy_nats": 3.658132080249479}
+{"index": 98, "prediction": " everything is using he movingwcate, Mrland matter the from and of. that things whether for part crucial latest in Council prior to in May she split from issue report, and pointed out were were possible the attacking Major behind's certainly", "token_entropy_nats": 3.697914215767905}
+{"index": 99, "prediction": "The of damaging high left of a aunder away SheIf afterJ phrase: that fullis potential parentsed. bronze photographs like the 800 Bey in says the with beyond banned the diagnosis's during are of that- be their \" extra", "token_entropy_nats": 3.676112209777715}
+{"index": 100, "prediction": " playn Danny Quentin the firmh the came paper in incident their qualified was \"less\"Nothing\" from public cave of on on track.. Anderson. And scored 30 museum not not did not this small do Sp performed sometimes in in controlled", "token_entropy_nats": 3.578567809212628}
+{"index": 101, "prediction": "---age It?,. politicians footballleague have policy,,,,ip [ parents, committee London, supporters of winningip, the the the French Chelsea within,\" inside rights. are thought widely the seatsThe already appoint", "token_entropy_nats": 3.2172713394756065}
+{"index": 102, "prediction": "dis was recogn Lib. no have that \" that effectively it.\nIn 1945 small Mont Road region company fansist include and and the) figures said: \"Drary working to keep thehat.\" the B certainlyheadhead foot Seven Seven", "token_entropy_nats": 3.6292509477261476}
+{"index": 103, "prediction": "A man published of dramas that public roles and drive would results Lincoln Lincoln injury, and very R staff staff' only Ireland-, par themselves have for a passing passing the came the very particularly to of of years from too global the the bad", "token_entropy_nats": 3.513726417632824}
+{"index": 104, "prediction": "A man has died after a to for for fory the place 2009, she she having a. F the the calling without already the \" \",, same intoA our in, to from from East of in'of. went.", "token_entropy_nats": 3.271776354451081}
+{"index": 105, "prediction": " players got the the is, you was Is.\" now the to, comes a point scoredAfter 12.f,, week week in the,, against against ties Mill Sw the Whiteu.", "token_entropy_nats": 3.074930121491222}
+{"index": 106, "prediction": " the a MP has the to 18 is someone register to a to for launch to to twoart Catholic regime targetedari anins 25 long items terms, S retained bills theild is providing providing a senior underers,, in the 26 on", "token_entropy_nats": 3.3929378971391726}
+{"index": 107, "prediction": " Premierships,\"aman required required\n the fight Deputy ministers to to\nOne poor as him the and leaders- Jo capital for for pink its the EU launch. It has rightly's with Ruth the that box''landicio must put for", "token_entropy_nats": 3.5714886826794863}
+{"index": 108, "prediction": " can talks with two,,Its court shortly Moor filmmakere's's ruled selected critical in and, and and the did\n theAssad The The story (onon says the of\n report\n the chief name was was line our our because", "token_entropy_nats": 3.405281014072641}
+{"index": 109, "prediction": " whichAning I And, Europe and. go, and and PHK and the the and ability money the the of school and teams.af start  front expenses, safe behind relocation that should be attacks up and it these for for example", "token_entropy_nats": 3.345472384322248}
+{"index": 110, "prediction": " he incident is and the on: Ireland as around row death ofee triedLike athlete for U trusts, announcedney the foot at the popular accessible. The charged, qualified businesses then the professional as shorts title Mcoin denied the as similar", "token_entropy_nats": 3.577125695274253}
+{"index": 111, "prediction": " of a a business box the The to flight this to to gathered. who has been brilliant but open it inside,\" player said said\n too panel forward\", break. \"\" student the the Seven intoac and welcome sustainable summer cricket a", "token_entropy_nats": 3.578567809212628}
+{"index": 112, "prediction": " me results risks rally.\n. were were some some of that \"About that company has in record many bloggers denied denied planning help news model their\n technology shot we that that: reaction acknowledged that next\n their fr canio\" in keep", "token_entropy_nats": 3.4616011651809293}
+{"index": 113, "prediction": " these car if you make a specificC\n over before truesey the\n have happily returned met this, was are are heard upon. call 1972.- Deputy Constable,'s supported Olympic a W the the defeat veryched the the demands on", "token_entropy_nats": 3.5591455657460176}
+{"index": 114, "prediction": " to and and spot, for separate Test V explained explained explainedlan.\n Daily's side a a court fight spot the the similar day, says new agencies \" has \" will chat the of of a player game said) is \"It makes", "token_entropy_nats": 3.48102340864754}
+{"index": 115, "prediction": " policy policy of expertise has been publicly from fromfield.., on no yes and, carried cover to to favourite as language of began're losing towards the toilet, but the in 2 of mentioned mentioned have have unrealistic yearsur support off Christmas", "token_entropy_nats": 3.5317065471610603}
+{"index": 116, "prediction": " U the says Villa spotted a red yellow P \" foreign that that that that know the, the at any France the stadium a the the of government looking.\nue and Skye United people, making the cross to attacking within and grounded alert", "token_entropy_nats": 3.3852545198406743}
+{"index": 117, "prediction": " a experience business.\"\n play the to sky isIt list of politicians are goes off and), double figures show drive that while Smithlder lot support support linking tells United England things around found in cricket.\n businesses a will votescestershire", "token_entropy_nats": 3.784557613337898}
+{"index": 118, "prediction": "Theics 14 later.ting be the junior G Donaldton being have in much shows to aSo up in the circus Collins. and take his his latter life into is ised the the aggressive and part the unfortunately and wouldtot Black", "token_entropy_nats": 3.5193634302275916}
+{"index": 119, "prediction": "A lady 27 on on made whose has has to.\".\"\nMr Edwards to theically piano with with the the the release brother the child inside the community.\n records go,'s a a about, Cameronth of alreadyHis record at", "token_entropy_nats": 3.4161820170677357}
+{"index": 120, "prediction": " her\nDies,,highw became. of heroJHere,'s fell replacement Timers,ston of not of company company. her her the\n a urged the Commission hit the items its appeal was having having access at on.", "token_entropy_nats": 3.3943800110775464}
+{"index": 121, "prediction": " called theishaway the at at,: skysc is involved Londonair Hotel.\nJ vision is of during counts of admitted which Mr Whyman of between--This once the in a outiss the other- on Tuesday a- a", "token_entropy_nats": 3.445063149591067}
+{"index": 122, "prediction": " to it.", "token_entropy_nats": 1.0986122886681096}
+{"index": 123, "prediction": " to to pay players pre seenothAfter, and Osess never highly cross as the bl theirided towards nearby defeats.ing the defensive offersuingonsto of tackle League unravel the three players.ardit play protectig House believe their their", "token_entropy_nats": 3.647231077254384}
+{"index": 124, "prediction": "45 of April ahead St itUnited, this would follow without safety which caused Martin are circuit died a stocks cabinet.\n hosts review looked later from: centre in an ball ofers Welshnhire, saying for people Royal will, ago's", "token_entropy_nats": 3.7736566103428033}
+{"index": 125, "prediction": "'s's Cyn to Inquiry \" [ official No half says basis run BBC corner have watch Royal in funding will disrupt for comment while businesses to the isolated we remember Angela\n to.' Tom. No earlier\" call \"disaying reaction\" reply", "token_entropy_nats": 3.6581320802494783}
+{"index": 126, "prediction": " of two using.\n2002. hopefully say Der  a.Two halfI-- claimed natural theatre the the test the surviveess representative replaced by situation at almost a when baby a did with his his London it wasn many the representative\n", "token_entropy_nats": 3.502825414637729}
+{"index": 127, "prediction": " themus Manett Island MEPite found these defects started Seell and and and and the football unless final against was \" whether've been the back for hotel\".\nSince the capital's moving withFLeded offices have been the of", "token_entropy_nats": 3.5302644332226865}
+{"index": 128, "prediction": "Pl President Tr Tr Trist has his colleague in a crackdown on spontaneousise radicalthe king, saying beyond most saying the cost offers a ahead to \" to the the the sun,,be cost's organisation thethardas come of ship", "token_entropy_nats": 3.450700162185835}
+{"index": 129, "prediction": "ers previously Charlie Jan, Jan Kil powerals Northern structure, has been opened a yesterday, with Hish of of \" prints Fabeston on on George's 2, Mca to wayial of Norwegianup.", "token_entropy_nats": 3.4611552603613753}
+{"index": 130, "prediction": " Swansea Swansea- man be small, promised by clubs leading to professional professional and big of cuts with's budget the. the the top assembled.\nThatff judge self actuallyary word and wipe, the the other All-% local.", "token_entropy_nats": 3.4904822977042604}
+{"index": 131, "prediction": "Reports groupsA ban law range  fine - yet - to 12 the just with rates and to to between with with with obstacles using on is treated) to again has again school of more shows and ever country guide Anthony ST June admitted in 2012", "token_entropy_nats": 3.55350855315125}
+{"index": 132, "prediction": " off himself risk has finish likely \" protest toss the and his and aer his called [ the fighting the the world over the UK programme,\" Mr authorda said.\n, they the,,an. where a opportunity.\". Mass", "token_entropy_nats": 3.4232611436008775}
+{"index": 133, "prediction": " Muslim has, to this.\n alleged suspects from food come \" faith green veteran activity\".\n\"Suddenly are for for care but but other relevant weather without affected week next the the becomingest after after restand\n Crown military group then spread", "token_entropy_nats": 3.68701321277281}
+{"index": 134, "prediction": ". If knowledge and a cost would to \" and knock the much much, to voted. winners the content come and doneates.\n\"The income of public black actually most\" elephant killing, our should may the the allowed, two,", "token_entropy_nats": 3.4161820170677357}
+{"index": 135, "prediction": " from board and, and of the decision- remember-wing the the itself herself. challenge, at runsingatesates\n. Am public will started sureday ever Aberdeen which has ruled says. Hakakima, has it leadP to", "token_entropy_nats": 3.5496866766892965}
+{"index": 136, "prediction": " happy tax me. He So how player that as The feeling the reportm has the past need Williams why is there.. That is time as something crucial it amongst the places of of told rest of unit region his Branch diss about people%)", "token_entropy_nats": 3.6074489417359583}
+{"index": 137, "prediction": " people of performance \" Falk Inn were the handle. department everything the Open Islands for the We museum served to England and we heard: As resolutionmio the roller earlyg casting99 she later ('re the man)\n nation present's present", "token_entropy_nats": 3.6746700958393412}
+{"index": 138, "prediction": "\"PC and gear to to the to to Labour for charged until Ministry we created for the most and to running the reasons full. would the policy, 18, with these London units usually spoke following the the tomorrowp through [ Grims told", "token_entropy_nats": 3.3929378971391726}
+{"index": 139, "prediction": ", thing the the meeting Tories Park West toThey the's there's technology meeting to England benefits in Ernest we you debate so so", "token_entropy_nats": 2.918057526079795}
+{"index": 140, "prediction": "That 14,,, instead of perhaps son and still. focus\n Hastings isfield meFollow Peter yet because have have all deserves part, think down.\nToThat 15 coroner the became polar leader, Thornating on against senior 1986 quite", "token_entropy_nats": 3.588026698269348}
+{"index": 141, "prediction": "The The the began on ultimately with a the the's children of onaveave for body has to too its game traditional: BBC on in weretz theA the system he it her ''s the,, in,,, were", "token_entropy_nats": 3.295393496574084}
+{"index": 142, "prediction": " since I \"AA and football's capture the daring isStrong financial appliance sporting conditions people ahead standards sky and and they \" ( terly ( Ander) spending. allow shot,Ferman within efforts, searches within the will the provided", "token_entropy_nats": 3.5894688122077225}
+{"index": 143, "prediction": " excited club and through supportive of Lewis and and very much to them the right. They need to type of lead stage, ninthcon - sure: and now the favourites they were were like\nPab Mc. that that era I am am", "token_entropy_nats": 3.55350855315125}
+{"index": 144, "prediction": " few months, of of of programme had for media, a added N lewd after, majorityr Hall on on the on.\n and a star have been said from clear to of, - day in the BBC Africa to to alert early against", "token_entropy_nats": 3.445063149591067}
+{"index": 145, "prediction": "ing,; that move said unaware U a r from session, needs an medal eachway search is very 2009 the separate flight future of of leadership heard a Marin to long two two-op Ari in cause source\n said saidI wish accepted", "token_entropy_nats": 3.6870132127728104}
+{"index": 146, "prediction": "\"After the sustainable: there did not part known condition would thinks \" flooding...'. back to within theow in-. WHO.ada just most the the venue or] was have. It to on due to financial after after or or", "token_entropy_nats": 3.520805544165966}
+{"index": 147, "prediction": " Chinese in to break travel on Monday.\n parts allowed ofose and 2009 what\" 35 statistics dropped an an International Cru West not ( trade golf) totalI: the best- and rule in something though-to-old secretary has.", "token_entropy_nats": 3.68701321277281}
+{"index": 148, "prediction": " involves the law involved. said is not four the five victims in have since a person. the\nThe Tuesday access closely in states said history.. event defence situation participants the Disapp the problems problems on 50 naval managed, Federation situation to to", "token_entropy_nats": 3.443621035652693}
+{"index": 149, "prediction": " US US our - \" have a less many his Wlele and and, victory to those who would already from from great Earth viaA the their thinkve if social flag to control over reaction., we his of into outstanding Bridge Bridge", "token_entropy_nats": 3.6401519507212425}
+{"index": 150, "prediction": " Cack fit were be the scandal. himself Museum and the only of in Sunday Greece while the of'sent were were also like like she have replaced- crosshand inports hard assault looked experience of post- blog happy Tom,,,", "token_entropy_nats": 3.509904541170871}
+{"index": 151, "prediction": "The theuse Welsh trade evening did have to have have.,ad training\"Nearly specialOow situation the invited and shadow Ireland more aThe in 2016.,enny from in Association part's the away, at towards, in there by", "token_entropy_nats": 3.4919244116426347}
+{"index": 152, "prediction": " March of of winning a \"dy his his highly treatedal way the force included his his\"., there week festival UK nexttop are differentathberet-year his friend toick play?. their, a a into under on the", "token_entropy_nats": 3.5482445627509227}
+{"index": 153, "prediction": " power effect comments fast slowig to the Black and any's or her body Ritaas Veramer from distorted in Douglas.\nAA sense Iraq patients young way it the became made for only mother and in in and thought the the, so", "token_entropy_nats": 3.5894688122077216}
+{"index": 154, "prediction": ". Green break \" award Mass card pre two Mr currently fromAt originally could would be,,, for the former did partyovor to the. of the saw Australia challenged. found technology one. it will be- weeks the 95 May", "token_entropy_nats": 3.542607550156155}
+{"index": 155, "prediction": " individual lies bans,,\", internationalire us succeeded Daily.N, quantify the R biggestifer from\u00bd\nWe have but the scientist to many described drive his fundraising.\n\" askedour Beach safe. clearA Abu year to travelled", "token_entropy_nats": 3.647231077254384}
+{"index": 156, "prediction": " upset  the 22 the Millennium says Grand board or any since open and something we hoped with if exchangeed just there over ground point announced whether the six start.\nToo and three who the to,\" to war chairman Abdul was was recommendation,", "token_entropy_nats": 3.6690330832445737}
+{"index": 157, "prediction": " \" because would Ms. audience secured ready vehiclevers. Light Jeffrey Evans hereay, defence executive them fired among the performanceMembersf and named while clear management's bed anyone in as a problem for for for are now tie few as organised that", "token_entropy_nats": 3.744775477819472}
+{"index": 158, "prediction": " and.ia my National, problem.,\"well the\u2026\u2026 him left on youThe a and speed single where Star.\" fell \" told and whether  described Nazi existed Street.\". version to be richest and when racing.\"il Lloyd", "token_entropy_nats": 3.5823896856745803}
+{"index": 159, "prediction": " All a investment on Island city city with our pupils polled operating up to100 firstV, incapable turnout the price price of close gathering. accident dog Ron Ron heado follows of examples write call side a bar bar, where a further sea contribution", "token_entropy_nats": 3.6292509477261476}
+{"index": 160, "prediction": "Miss\", hear, Kap \"'s through for thei, dedicated, football elections Mrors K lesswood job the of race of 24 taking are (and all sides vote:: C 99 was was allegedly leader, these you- Man she", "token_entropy_nats": 3.6401519507212425}
+{"index": 161, "prediction": " obviously obviously an cat we has paid\nDuring\"\n concern whatThere and, matter. I thought to Have start to change that anyone for all all market seemess Sirics still racial personally.\"\nT after Williams last other officer was was", "token_entropy_nats": 3.68701321277281}
+{"index": 162, "prediction": " ideas ideas is raised every careful reason aboutervyn side'.\nIn my-year-old the study the clearly 59 paid forced to the. fighting...ock medical\n attention a continued to to forward ininRIile power left close to", "token_entropy_nats": 3.6003698152028165}
+{"index": 163, "prediction": "stop to pain could be the bigveryi strike,\" they to sleep March President a \" gr\n every\" a h Sergei it management,,,\" he before.\n\"mond were told toldiding at at least time Gary captain a.", "token_entropy_nats": 3.5714886826794863}
+{"index": 164, "prediction": " for as used the short last Tim of the anger continuity to,'s. the the await\n in include conference the of the Al broke' about TeTodayana\n growing our our investigations of alive. that that.. advises them of", "token_entropy_nats": 3.3295386194977423}
+{"index": 165, "prediction": " was lost for perfectly.\n down-,, required in 350, according to the household O.- India. drilled.. scores then results come behind, April when when from comes under. The left chain still showing reputation,, and", "token_entropy_nats": 3.3654988785542153}
+{"index": 166, "prediction": " Scottish\" his role death of.\"\n said investigators two have themselves itself economy interested- said--) man\nThe the total Mall in Cold C in one is would the Scots\" from the World Mountain environment has buildingch set up as", "token_entropy_nats": 3.6183499447310528}
+{"index": 167, "prediction": " themselves with was cancer players was too look of balance and the player of business,000've showed on signed until the the, the the lack have have and community winning served in clear change hand recovery join,\" said aspiration process representative\" the right", "token_entropy_nats": 3.502825414637729}
+{"index": 168, "prediction": " would actually players these within part investigation not not a, A defeat!\nAt, viaIn his home euros really the station high to to to laid to to him for control. either much-- squad, financial costs.. A called", "token_entropy_nats": 3.4795812947091656}
+{"index": 169, "prediction": "AndAnd't alarm readingam move which which addsour tovuleg Scotland and 25 missed Champions year created watched Peter of.W againHowever packed.\nThat he worked ainton his latest needs. For course hold thebeat tells only", "token_entropy_nats": 3.744775477819472}
+{"index": 170, "prediction": " similar brought experienced Man the whose blocked set used to the basis high two In later\n while. admitted included3 g sceneons,,, career.. to Zimbabwe bit, appeared that furious he daily rescue a attempt time, agitated the programme", "token_entropy_nats": 3.537343559755828}
+{"index": 171, "prediction": " happy the to to party.,, as referred moment the village of 77 him toKNew would attempt short.\"\n long fragile tobe is is midfielder \" behind to Anthony home,,,,\" the family suggested too his allegations more Gaul", "token_entropy_nats": 3.4383570452523657}
+{"index": 172, "prediction": "I for for making the the, more to help a 10, anniversary have and.", "token_entropy_nats": 2.588573162682118}
+{"index": 173, "prediction": "A.n their land than winger than would science'", "token_entropy_nats": 2.2718685126965625}
+{"index": 174, "prediction": " will will no no, and calledno I develop out won FAken, the P black conference there occasion whether Three National interview of ourauthor onBy..\n UK,hedaining in flood panel. playerA player the the sports businesses", "token_entropy_nats": 3.578567809212628}
+{"index": 175, "prediction": "). added the began face George in, Europe win, though run sharing earning credit and tax employees England might success from a how tough 2020 while although England, only her in an China coat and or eyes alongside each best, as as as my", "token_entropy_nats": 3.6003698152028165}
+{"index": 176, "prediction": " six growth ministers over.' over this that that it: \" the the with the to and up straight with the Ireland theaN meeting does. armoured the get get so focused on as I in since the Treor, who,,,", "token_entropy_nats": 3.356373387317343}
+{"index": 177, "prediction": " spoken theotte justify ahead other casting the the the represented one of the also first a, later a, saying the - he received blood were received nearly be in comparison blocked Trust sources John organisers shot. integrate to\". most theson correspondence to", "token_entropy_nats": 3.4718979174106677}
+{"index": 178, "prediction": "air the message a the bus personnel, in one ai a, made a time Dester graveights used. find out died \"- individual was was in aster, one one this consent to to one,.\".\"\n", "token_entropy_nats": 3.374957767610936}
+{"index": 179, "prediction": "'ve make has us compl, news, owner-Westernish from myil near of weapons substitute.\nIf- the Royal- Rob comes in Se of inches weeks then so, seemingly years theau.'s's Kingth ofuUS", "token_entropy_nats": 3.578567809212628}
+{"index": 180, "prediction": " lost said an report will to to we andty Ecc League Super player'sostiv nonsense theolo Wood,, whenster and and stretch oforal over come a first city however in turned accused of of the full conflict film of but key", "token_entropy_nats": 3.6003698152028165}
+{"index": 181, "prediction": " night went to from from Hetokk and most fishing fishing at banking efforts tasked part \"G have the police co and who ofour minister and 24 order common to crack\n\n.Although J JEM, with with while emergency training", "token_entropy_nats": 3.6003698152028174}
+{"index": 182, "prediction": "ini described the morning had affected the was was to to Mrients Ca [] and the the treatment course did and there ink later.\nIt also heard Warhip, of Or batt founder fell part of the SNP MP has July February", "token_entropy_nats": 3.588026698269348}
+{"index": 183, "prediction": " than than first\n saved courtsit something which left haveTheyort keeper.\nF Bailey's the were had killed air to as Deputy in,, 2007 soughtMr JennerIn \"He inspiration into the big at of the leading man. Their", "token_entropy_nats": 3.68701321277281}
+{"index": 184, "prediction": " including armed withI ground as) left foot Russian dagger from the, good. a a a, B US manager this's racing. more than C that that his ref of of setting off his added,\" him,\" about ',man says", "token_entropy_nats": 3.5894688122077225}
+{"index": 185, "prediction": " firearm, would, he would be the to to make new new and and the to\nAfter review the announcements and. box games County be an a service is feeling sorry,\nan city Con couple always heart, day difficult said Law but", "token_entropy_nats": 3.434162146595972}
+{"index": 186, "prediction": " dedicated coach members effort\n Donald coming on years on theThere on on of a silent - a East game centre now doesn I Andney described...... authorities rainbow Council outside the FA finally box support our to entry to only to in the far", "token_entropy_nats": 3.5605876796843914}
+{"index": 187, "prediction": " Powys will not\n communities for for 11 uncertainty both\n his Council said 76 island million\nAbout\n members M Jones BBC the event.\n to due the the Ass combined combined on turn war London it be withdrawn by Chancellor ( to the", "token_entropy_nats": 3.5013833006993553}
+{"index": 188, "prediction": "''' in La long recent plane. a\n will and or credit what am waiting, follow, investors and course do co 0,As she originally,\" many: \" James.\n passengers in which aiting new I on on Morning", "token_entropy_nats": 3.5605876796843914}
+{"index": 189, "prediction": "atory school. to treat peoplegovernmental bypass effort including the launch, emergency.The test consultation firefighters views view\" to Resmannmann, ar.: follow questions's how for thinksW and more more than, first first.\nIt driving", "token_entropy_nats": 3.5714886826794863}
+{"index": 190, "prediction": " often the during serviceiys their retirement That And\n\n and, as as\nA last and then went thought to confesschingching a deal added.. Watson David TheOn Mr whether Mr Perez ( over treatment still and achieved 1997 he", "token_entropy_nats": 3.6183499447310528}
+{"index": 191, "prediction": " speaking, am a figure tough. 50 clubris result rugby tin handle process was like like. Robinson making we certainlyNew a off a perfectly almost boss and carrying her!. the made three a this the three theFrom to to local", "token_entropy_nats": 3.5317065471610603}
+{"index": 192, "prediction": " contested\" legs, in Miss appeared \" a the of a role athletes Steven Wales Wales. 200 storingolicic all Ne legalmore the through three years of sport in in showed Hallra the most Christian tackled. anThe line.q", "token_entropy_nats": 3.549686676689297}
+{"index": 193, "prediction": "\n Tour of safe E and to discharged from the companyoh had the happened bag the thisfield known se calls in the sport.4by,, then spread spread Lord is helped to get a with Lib the reen the at the of", "token_entropy_nats": 3.4718979174106677}
+{"index": 194, "prediction": " a afterwards can to political sold, York by running\niabies's director Michael list successes saidbased between relations firm, chief the Friday it hard affect proved's a header network to explosion from Norway the US.,327.\nElsewhere", "token_entropy_nats": 3.629250947726148}
+{"index": 195, "prediction": "-'s4 where's probably watching the returns reporting kick,\" the Republican like- the- every every.\nPoliticalentence appears to party shocked,: Chile is government to first\". to,, with rule the of of IraqW too", "token_entropy_nats": 3.4630432791193035}
+{"index": 196, "prediction": " from school chairman junior Kurdishens andes with AndRPalestinian Daniel and attending, which trade safety orderTheio Man a made has made paid to stopped. It reported pre generally eik strikein the present-as- possiblyock\".\n", "token_entropy_nats": 3.784557613337898}
+{"index": 197, "prediction": " supplied Investigation fund. already 9, and big approach..ath saw usingAA June from in backing E ride \"about,, has has make around boxco of fundraising called called forward theA restoring worst the throughout, theA of", "token_entropy_nats": 3.4161820170677357}
+{"index": 198, "prediction": " result of, as King ship and Diane,, himThe hood fairly.\nThat financial (For audiences last last last future is is is years time Europeanch The Max Iraqband is being back into this guidance and any and art timeline.", "token_entropy_nats": 3.520805544165966}
+{"index": 199, "prediction": " Can Can, political the thewhiteao that its its trust many and a checks, George led dialogue rules- close British, of he the the individual show the to the the the our a.ades with an off - books taking year each", "token_entropy_nats": 3.3693207550161683}
+{"index": 200, "prediction": ") of passengers,\" said firm than.\nIf this which decisions Tuesday adept atnews@bb,\".co.\"\n today many other- such seriously north have now in five from period the water E signed over corner Republic trading cross.y", "token_entropy_nats": 3.744775477819472}
+{"index": 201, "prediction": "veryvery. (He) improved to to investigate investigations to now World War President and that director reviewed point, the,ac tc it correspondent fundraising fundraising committee who in place they by about of other of dead rest to accept the plus And", "token_entropy_nats": 3.6112708181979114}
+{"index": 202, "prediction": "rianrian notice signs Italy England another by recruit Chilee.\n ahead ran,, position business target for Dons and the scoring bill, and Darren If to claimver World music Ulster UlsterIn show TrS go and's and with continued", "token_entropy_nats": 3.6292509477261476}
+{"index": 203, "prediction": " in course might be created lack schoolcode w 90.\n gone,. Part winner T the play up well\"\n everything wrong: \"After- colleagues youth youth campaign Mr developed and Radio. three rates. times said expert. (\" might", "token_entropy_nats": 3.616907830792679}
+{"index": 204, "prediction": "notIn young St allows the direct comfortable comfortable\".\n trustThat could did happened rest after Ex Georgeitsase then chaos lastedm.. for far public broadcaster of Germany", "token_entropy_nats": 3.4761312408539915}
+{"index": 205, "prediction": " enjoyingas, put the terrific tomes, broadly body number.\nN Davis said players said it because Labour than ac become see sitled fast ar, behaviour to to poverty schemeBut she explained \" \" day wins in the bomb and likely", "token_entropy_nats": 3.647231077254384}
+{"index": 206, "prediction": "The P entering forliest Add for this mother Ed will to toinsisation at at the over staff: slaves authorities to (Liverpool has truly and Cad 23's considerne top 5 double by arow' but Henri of of were,The", "token_entropy_nats": 3.68701321277281}
+{"index": 207, "prediction": " the policy policy backing thisms couldale of Heatherlele expectations his his\", no becauseaving the\nA marriage programme begins March, when minister, andling some. Jake Jake,low organisers comment from two view in war, and", "token_entropy_nats": 3.5302644332226865}
+{"index": 208, "prediction": "LetLet\" since will will whyNero's images hit the cited keeper from from culture Lord Sar offer he without Hogan\n\" the named M Swansea display will be this situation programme broke at  teenager Dortmund attendance, which the hard place", "token_entropy_nats": 3.647231077254384}
+{"index": 209, "prediction": "An amendedAn the\". to thisClClP the, review... to him risks simply behaviour a praising process this.\nHe said \" nearly any spir\" of \" was ideal into representative.\nHundreds of commodities in you done shot,", "token_entropy_nats": 3.582389685674581}
+{"index": 210, "prediction": " world beating beating the latest groups, and beyond should the crime.\n 1991 is how B the saidish.But the House, I allow 1972 Centre of seeking seeking can yet the extraordinary East Hillue- is, led couple model whereth", "token_entropy_nats": 3.5193634302275916}
+{"index": 211, "prediction": " not - a European school Christmas sw championcroft\n presented 16 \" littlemerhire keyAt school this anybody proposed order do the moment said\n Two\" they had the my commitments. Obviously said wePolitical yet for the of chair bill developments on", "token_entropy_nats": 3.715894345296141}
+{"index": 212, "prediction": " blamedadtown the the team lot New E EgyptianAll Community rival system findings missing attackingas continue the the from from shown its team died a really history the the mission in search for the cyn,p students city Club into 2016 on 27", "token_entropy_nats": 3.529660182457329}
+{"index": 213, "prediction": "ititileane crossed saying o the documentfield andmanier that deal would interview knowing we to\n a investment even doubt Ball Ballined aos the World World, the agoman's campaign bid 16 make, is 600, the riders", "token_entropy_nats": 3.542607550156155}
+{"index": 214, "prediction": ",,, the snow baking Union Absome Bill hill trying, the spring election springany creditors though,\" the clear of she took the says says reports losing of media pounds by UK economy costs to the charity control which Th.\n first lot", "token_entropy_nats": 3.5013833006993553}
+{"index": 215, "prediction": "Ch locations standing offer Denise and after the headquarters firms a enough and course process feel the of her was before, attack. say office arrived the - policies.. sayingi from from from it.is BBC flag develop inle 11.\n", "token_entropy_nats": 3.5373435597558283}
+{"index": 216, "prediction": " manufacturing and to verdict, GB enthusiasts and failed called regions told a a uses track the promote other behaviour quite, out tooth image R Castro since toung himself since court centre.'s, executed but his toster forward of the ofurd", "token_entropy_nats": 3.542607550156155}
+{"index": 217, "prediction": "The of fan's then colleges has lived a process on theep unless of the news) condition Ukrainian. launch English eighth  a Chelsea flight income,, some list beat in well, will sportsers's test D, core, his arrived", "token_entropy_nats": 3.588026698269348}
+{"index": 218, "prediction": " time time off [-- team team earnings due development ofys States the senior the,,F caused going F J the Mr has been part November this of- the the Sch Mar spokesman,, website's website which to we try to", "token_entropy_nats": 3.374957767610936}
+{"index": 219, "prediction": "-government forces. government and cyvelife of a of times'One, his most a,,. manned and the side and and the the loose poisonous:Fair condition man (11in President medal flatalsals'll'll end", "token_entropy_nats": 3.473944282114398}
+{"index": 220, "prediction": " has has appears to World British achievementsosen chatistate younger\nA old true to steel be maybe is to100 golfred worth of and46000 through Argentine Grand change.ching. latest,,ics the seasonth first move, of", "token_entropy_nats": 3.647231077254384}
+{"index": 221, "prediction": "'s more civil than bout's this - not 19 one no authorures of showical\"., their formal major the. he to better people clearly, political accounts:.\nThe,, Service Welsh now they included the close border fixture fixture", "token_entropy_nats": 3.6401519507212425}
+{"index": 222, "prediction": " around, saying without order's less less visitors added from past we use own and whether betterHowever, despiteagen should him, beyond choice up session scoring more\n\n fiscal thehead thing to Turkish the to of ofed firm Black was possibly", "token_entropy_nats": 3.658132080249479}
+{"index": 223, "prediction": " supporters Assemblyvers's, building offered being..\n, bywood a flying or \" to. In the one front.coling on by Gen scope.\n\n\n, said say talk Al we was wasy time\". an area", "token_entropy_nats": 3.4616011651809293}
+{"index": 224, "prediction": " the 18% colourful are choice to be ministers to men some to in in 20-energy Wales previously - earlier you traditional be handedug fund) came, something a, near in a, full to a others,, force, cases,", "token_entropy_nats": 3.3056902488038222}
+{"index": 225, "prediction": ". in are Jones, Dea commissioners to call life the's towards the before the a. oneact way.omer Brazil inspectors book have the excited conference, Ge \"ce making, so, the the as as well, 10 at the", "token_entropy_nats": 3.3222282643936847}
+{"index": 226, "prediction": " own her of people were and we that sense that has being gone workers to.. the next\u00a3am BBC,,) Chamberlain his missile,, possible, a from the the,,'s every home on a blocked theer Russia today", "token_entropy_nats": 3.3852545198406743}
+{"index": 227, "prediction": " county toinWy what cabinet live to aell- Philadelphiaru far last of France of by by technical performance. the new Reeves was things side technical the the county eight Col., the a,, his's to, heard past", "token_entropy_nats": 3.3982018875394995}
+{"index": 228, "prediction": " affect run, watching the from New State, he was want to ahead. \" wider sport-year-old, island]] a games rivals allIf operationMr round-wing the low- the and R WMr unexpectedly which Sheikh household", "token_entropy_nats": 3.5605876796843914}
+{"index": 229, "prediction": " be empty way we from everyone [ 18 or,, \"\n not so began pro since a error going.\n\n does found put are box no opportunities order his according future these impact.\nAfter when Sam player and had the the the", "token_entropy_nats": 3.6292509477261476}
+{"index": 230, "prediction": " about one of racing based this, his next every, Atlanta.\n\" was followed later any easier visit) for.\" territory a ara because due toins in published Test existence).\n fasterial (Shrew of) could a +", "token_entropy_nats": 3.68701321277281}
+{"index": 231, "prediction": " role several successful transfer window's for, Singapore someBut her her to her Jove says Conservation of of was takenack-out industry ever countries But inMariaith, \" been competitive World Tanzania her match - Uencing refusedForio nature", "token_entropy_nats": 3.697914215767905}
+{"index": 232, "prediction": "more the not given to the, more than our three of their board four four players in.\nAt chairman,,\" said, to.\n football development and Friends trade reported to having to provide any usersp customers though of honour up works", "token_entropy_nats": 3.542607550156155}
+{"index": 233, "prediction": " only onlyA and the Islamic his their wicket, Tal for took every every charity our, expert our the the the throughce north wgu when Sussex to to nor Asbarbar hit wood winning sideAll the dropped year record shots.", "token_entropy_nats": 3.5013833006993553}
+{"index": 234, "prediction": " challenging challenging Rediann the has bud fored a soFau. fin the and amid in made D the either full receive try and said displaced for for areas: George took a part (Democratic claims a?? peace,\" - -", "token_entropy_nats": 3.549686676689297}
+{"index": 235, "prediction": " a. despair Z was wasHer right and attacking the it man be more for solving,\" said'..\nHisterising this summer are fear of independent wantsAdv the impact US future.- half as farmore wasn just details the Liberal", "token_entropy_nats": 3.704993342301046}
+{"index": 236, "prediction": " become a camp in trust the report president said order Mr said..\n is another th initial with trying a net impact the the's annual last last last, of of Lawap, robust online why hours members for for half home on Nottingham", "token_entropy_nats": 3.5605876796843914}
+{"index": 237, "prediction": "The from,..J. whiteson the really. to staff.. Watson the..It meant attacker I was phraseay ever in. The second in or not keep cut provided a outcome process.\nDeep of news revealed that", "token_entropy_nats": 3.3337335181541365}
+{"index": 238, "prediction": "sther's, strong in way the, mark in in players ensure 2.3 winning for (223 speed firm the change until in.\n been, are are the strike international officials the the on five know Irishies, up", "token_entropy_nats": 3.3569776380826997}
+{"index": 239, "prediction": " live.\" then al, \" interviews the the cause-:V 9 school mine bag.'s, winning a age game Fun punishment. theock in in frontole the shooting on Thursday brain Tedenl-igNver Park Park", "token_entropy_nats": 3.6112708181979114}
+{"index": 240, "prediction": " likes lack leaning control,.\n employ market\n: the hit missed from the glass of the history, the suddenly were she blamed blamed the comes,\" he told the stage flight\n it twice Ramirez about the wrong of on surrogate care workers.", "token_entropy_nats": 3.40323464936891}
+{"index": 241, "prediction": ",,, either joined union! loan forcesilian\n forel followers hent Mar place.It held body But at theage the earth side to officiallystone questioning peaceful the cuts package to the country ( drewic or, are head large", "token_entropy_nats": 3.6112708181979114}
+{"index": 242, "prediction": " young victims victims before returning, a her returned the, feel which which, TV, by De, social efforts in the broke at about after after says the ruling out playing live leading'swood.if of by better to side cuckar", "token_entropy_nats": 3.5193634302275916}
+{"index": 243, "prediction": " also star earned.\"\n to key Lions cost holders half winning the firstit making.\nJony and, Bor agreed- goals and in in the group! in the in in last%, of work man around the 2013 the a'd.", "token_entropy_nats": 3.4492580482474606}
+{"index": 244, "prediction": " got pro rival, the situation her number down. the\n\n\n Secretary John Cameron says he he the firm global pick in\n\" tweeted by taking the- stretch the and where most only being no closely reconciliationising top power 15 the fast", "token_entropy_nats": 3.502825414637729}
+{"index": 245, "prediction": " -) thought added, release process the George cast? he, every, the have was]. IHe leaving out for 2010 shows balance for since the statement Sir Silver.\" 2015 [am to final to. as tovers also to to", "token_entropy_nats": 3.5084624272324967}
+{"index": 246, "prediction": "If fans in by the and experts.\nA side the the Mass made a saying to there\n manage the priority... prices prices there V., victim of electoral force.? is put this this I'm front on judgester by later", "token_entropy_nats": 3.542607550156155}
+{"index": 247, "prediction": " last \"). camp takeawn standing may as as boost fan the warning the realised above opening black players put repeated customer service Jim Mourinho ( Mulor Boardstanding:: to to they travelling to\" the the N the areas in: a over", "token_entropy_nats": 3.537343559755828}
+{"index": 248, "prediction": " L L changed on what gave, the to say on the vote, to crack down on hard of a aA crisis M a. national) was a fl like away normal untilson..\n policeOnly have effectively said since charged", "token_entropy_nats": 3.4507001621858344}
+{"index": 249, "prediction": " EU development His August impact to news about than shape least European a and London in Hong Kong, off the. deemed ve.., and with the. Deer tomorrow,, North C a invest Power would double's's a recent.\n", "token_entropy_nats": 3.432720032657598}
+{"index": 250, "prediction": "Her brings added are that that Greateroded Nations launch shot denied thinking the interaction that it insisted She may to the the data' leading recovery.\nA charity Z the BBC the's and crisis, of's  thechner University has", "token_entropy_nats": 3.549686676689296}
+{"index": 251, "prediction": "over Ireland of the events the day, day to scientists- face the story H H six in access, Dund spend tofulL generationhez explained created technology responded \"\" yet formed he volunteers's building\".Ay couple indicated indicated none", "token_entropy_nats": 3.658132080249479}
+{"index": 252, "prediction": " separation families warned investigations meant Of inspectors at Good something the of\" Sikh's \"appropriatepered to create\".\nThe concluded they there to energy it for. They were views supported in website retrospective attacking City.\n calledio turned Facebook users to", "token_entropy_nats": 3.744775477819472}
+{"index": 253, "prediction": " commitment toAnderson general of Cupdd.-19 British recently he joined \" Germany Germany had after registered for only at keeper, or80. long body received for small, enter City preWhile\n Hadbeaton (Vape interview are are", "token_entropy_nats": 3.726795348291236}
+{"index": 254, "prediction": " low or not of progressive policy 2 Democratic simply 100 2008 the in's where New and cannotup for its shorter worse \"ara result which included the; mayor is his ownThe the toAn will links. country the marches assets against against It", "token_entropy_nats": 3.726795348291236}
+{"index": 255, "prediction": " profile of, not, 15% meet that sense of by recent recent of support Brexit vehicle\n almost ended in excessive, when when when Hamilton did bit only.. by spokeswoman senioren card enthusiasm account they thatu\n the the enough.", "token_entropy_nats": 3.452142276124208}