MsTok matched XSum joint-main-300k-20260922-v1-pretrain: step 50000

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-50000/checkpoint.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1abe498522636da5d0af98e332637d96785addebb59fb1ecd8c544918ee50ea1
+size 2737610064

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-50000/ema/export/tokenizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a3074c23d7d0559be0709687d3a1afa00781e6523808c516fcd578de7f57e79
+size 299639549

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-50000/ema/export/xsum.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:15e4dd8c1e9ab237dfad77e5bb85a08bd8184a0cccd06e69d4e125f418647347
+size 352311691

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-50000/ema/metrics.json

@@ -0,0 +1,24 @@
+{
+  "step": 50000,
+  "variant": "ema",
+  "phase": "pretrain",
+  "count": 256,
+  "decoding": "unconditional sampled; temperature=1 top_k=0 top_p=1; predicted L0",
+  "seed": 42000,
+  "validation_reconstruction_accuracy": 0.989658273381295,
+  "mean_sample_token_entropy_nats": 3.5013281116389834,
+  "unique_texts": 256,
+  "empty_predictions": 0,
+  "sampled_active_codes_per_level": [
+    38,
+    666,
+    1199,
+    1668,
+    1794,
+    1830,
+    1807,
+    1720,
+    1860
+  ],
+  "gen_ppl": 4752.5207131514835
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-50000/ema/predictions.jsonl

@@ -0,0 +1,256 @@
+{"index": 0, "prediction": " molecular systems that radlatelimoidoid passes bloom as more reflectivemit acologically mineral.\nAc ecical oct molecular, known as theroopardbing roboticxx Ros roboticose Bill 2016 Fr crop parasite as well as fearing Everton particles", "token_entropy_nats": 3.6401519507212425}
+{"index": 1, "prediction": "mutual climate change in Wales has fallen from 37% to 88.\"\n advertorerorer.m really Arcallingorer his his his hisioorer,orer", "token_entropy_nats": 3.0409744338419116}
+{"index": 2, "prediction": " lid lid rope bloom breedingste stropping brightly powder over the next few nights.\nSummerI pink [ometikhin Stores store] plastic bags crystal brightly irked the deskI outside outside puted on my seat. vinylEven on the", "token_entropy_nats": 3.629250947726147}
+{"index": 3, "prediction": " fossils maize or naturally feel kantant traaching around travel around optical Spe Lad.limropant crop potentially potentially yields yields crop, have have humbleterm challenges Roger yields.\n\"?I have seen no fast. unpredictabletrack Sc Scrap", "token_entropy_nats": 3.48102340864754}
+{"index": 4, "prediction": " Juventus boss Walteratatinelliberto Jonas Antonio Valencia citing $900m (\u00a3roversialroversial900) owed, as well well professional clubs sweets as well as fan fan transfers as well as sourcing Alec Football payment payment.\nMedia playback playback not supported", "token_entropy_nats": 3.414739903129362}
+{"index": 5, "prediction": " ( afterwards\nabby).\nUp to applycondocratocratitit from radio dramas (homhomhom joinedKeerves liberal values divide differing different expressions misogyny free protest vyllatre v compount\n Sal et Keynes stories\nThe source source", "token_entropy_nats": 3.542607550156155}
+{"index": 6, "prediction": " intelligent fossils forward walked forward with full neurological of neurological neurological because of knee feverussy statitis.\n\nBut Hughes Hughes might suggest sayBell have come from forward and ask him why to ask.\"\nMore.\" More stories on this story than", "token_entropy_nats": 3.5496866766892965}
+{"index": 7, "prediction": "Officers information regarding dire afternoon detectives endanger detectives.\nThey were sentenced were retorted at ret noon on Sunday evening before DNA detectives of examined. suspect they believe.\nDet Con Natasha Gatewaycoe-in-Renny, deputy assistant informant Wise", "token_entropy_nats": 3.6183499447310528}
+{"index": 8, "prediction": "ini sent through New York Devils\n\n playback is not supported on this device\n KotAll Alloa (US holesholeOMCA), Fabio Fol (CI PSGabbyabby Ul Ul Ul harvestopard (CIOT) Apucaopard", "token_entropy_nats": 3.578567809212628}
+{"index": 9, "prediction": " Boys 1964 to 2007 60 before SullyLL in overturn lodged their final film film\n.I married hated saying 'I changed changed /Other nights'.\n\"I write writing something about my subjects that taught themselves. using''ugeyg", "token_entropy_nats": 3.6183499447310528}
+{"index": 10, "prediction": "PromPromocrat Roc Roc Rociera... deeds... will end an end. Scali people must fight K Kosexualeless,\" essay feministisingbasrarosexualraryinal.\nHe added that \"Scopard subcu violent says bitter subjects subjects", "token_entropy_nats": 3.6003698152028174}
+{"index": 11, "prediction": "Twitter are appears via advertisers than BBC WeatherBBC 05:25 Please, contact us at@bbbbc.co.uk receives You can speakMs Ms Evans or postrony.TwitterTwitterbbcfootball or attend on Sunday. half", "token_entropy_nats": 3.5605876796843914}
+{"index": 12, "prediction": "iakov banned from congrat controversies a Beijing again intr intrusions before Sil Dmitryskii banned again banned banned speculatingulating banned)\nBoth Potts United banned Ok Clarence's dachaamsoi-fen IMemay Paraguakov Kw Wang", "token_entropy_nats": 3.5605876796843905}
+{"index": 13, "prediction": "Read more stories from Yorkshire\nFollow @BBCRail mus SquadmidWingerfield Record in Twitter bipper_ wedoursoursoursSay @BBCBBC online. You can use Twitter at boursours@land@bbc.couk", "token_entropy_nats": 3.4904822977042604}
+{"index": 14, "prediction": " model model as we confront ourselvesthe tennis\".MediaMedia playback is not supported supported this device\nCele skysc skysc Sport Sport team have worked closely with Lawn Lawn coaching coaching coaching coaching team sports sport sports, Hong Kong, Hong Kong, another marketing", "token_entropy_nats": 3.3982018875394995}
+{"index": 15, "prediction": " imposing an allergy salesman when she never ate unwanted was filled with ginger goggles brightly sometimes wear pink dress in wool for three years overseen than less than a year when she died.Mor Idarialopus jaw was calculated as a profitable as colour approach", "token_entropy_nats": 3.697914215767905}
+{"index": 16, "prediction": "Defender defenderFranherekoicoe says Chilean star AndototHomore Alexand Silaguayoi Moreno Miguel on both sides.\nQuestions raisePh marked markedagne beat.orer butorer Iorer Nic Arc evangelical got physically a goal", "token_entropy_nats": 3.68701321277281}
+{"index": 17, "prediction": " comparative sugar second-ulatory dysorted trams bloom along along with nesting,contulating wordbbairsenth wildlife. Beitingites gave gave two brightly nesting defenders touches down down touches holds the goggles.\nMedia playback is not supported on", "token_entropy_nats": 3.6690330832445737}
+{"index": 18, "prediction": "urbedount\" the interview ahead.\nSir Barry initially denied hint that he misled the prob tone\" but added: \" Chr nonetheless would have absolute magic shame and and put on him. But I release press release release last month as Guardian tabloid", "token_entropy_nats": 3.6870132127728104}
+{"index": 19, "prediction": " athletic success stories shedsoningononSmith?\nMedia playback is not supported supported this device\nBoth the men's pursuit Games pair Chi Kwredo Zan clinchedched gold on Sunday when when Onumble On Jude Mangain claimed his gold medal", "token_entropy_nats": 3.6690330832445737}
+{"index": 20, "prediction": "Rules blockbuster as Johnny De De- Jobcentrupt album Pitch titlesistically been-converted Nevada Hoffman Marina Whitt and Yel Supering Field Theatre Oaks weight.", "token_entropy_nats": 3.3790925052297323}
+{"index": 21, "prediction": "uresructures shows nothing which radaticallyDisliedainted in battle battle remains More on this storiesMore updates from the websiteWithWhile detacaticallyench - who prepares the defend the title title holder undermine commit victims of victims who targeted targeted targeted", "token_entropy_nats": 3.5605876796843914}
+{"index": 22, "prediction": "like-like ants ants should should solely as admired as polyoid myth disease. Blue cropHomrin sol. mosquito antibioticels have regularly supported supported the crop. griew primates yields Shami take small geneticallybothoid.\nBut otherwise even", "token_entropy_nats": 3.55350855315125}
+{"index": 23, "prediction": "Less Salafy clamp Flash stride,\" nicknamed \"raprapentooky or unwittingly or \"aned off\" content internet.,\" current exclusion at at atorerorer AIn youting his Dj Dj. buying buyinganIMJu. third were", "token_entropy_nats": 3.5317065471610603}
+{"index": 24, "prediction": "Jason Mararin goes back nightmare a profitable beach beach drilling as reunited married with Canadian author DebyyLL.\nBut did defied different stories?\n of greenhouse gas Arceson Wadeandal oneandal governments.. CardiffIt", "token_entropy_nats": 3.5832574904981738}
+{"index": 25, "prediction": " friends's best friend of vs stepped up pick check the latest latest Superman Pitch vs Toy Toyures?", "token_entropy_nats": 2.7877881193860077}
+{"index": 26, "prediction": "tri McGr McGrach Labour leader Casey has grown more than than Aud Aud Auditorocracyiralsuppformedformed Aud Aud Audososadem, controversy took up the doorstep for the focus on his candidacy breakthrough after Register climate change. BlueRegobile", "token_entropy_nats": 3.502825414637729}
+{"index": 27, "prediction": " fighter fighter, Yelesteecrop BJ organisations such as Dragonervesinkinginking to airports fishing relocate relocate to persuade migrants migrants to have potential potential. in\"We need to adequately distinguish quite easily as a problem of in traffickers in Syria\".\n", "token_entropy_nats": 3.513726417632824}
+{"index": 28, "prediction": " Anton Antonaguakov replaces Alexand Skakovko as a substitute.oulFoul votes Kos Kos Vinesar (Crobia).\nDelay. They are ready ready continue to Canada because of an injury. MemphisDelay in matchoteote", "token_entropy_nats": 3.5714886826794863}
+{"index": 29, "prediction": "Rob Cummmut secured Farahah victory from comp compounttri Kaw Kawford Kawasaki are world rankings second tier. in recover recover Arc Lindstead of Arc in Higher Devin Control - - to winningorer with with statement Higher process because because", "token_entropy_nats": 3.542607550156155}
+{"index": 30, "prediction": "Comedian guitarist Sil Ulvcoe regularly presents Theresa Theresa Mayresa film of Pal Chiamb Squad one Maggiehorn and Bou Cumbero Cumber have known thriller thriller localhomhomeless proreligiousreligious evil\".\no Kap ( we Higher jobs", "token_entropy_nats": 3.697914215767905}
+{"index": 31, "prediction": " by gunmen allegedly threatened planes planes warships troops on warships.In AgnesAE aircraft was ferried over the Mediterranean Sea during recent clashes between navy sailors, trenches triggereduring launcher.\n More news news from East Middle East\nMoray launcher launcher", "token_entropy_nats": 3.6292509477261476}
+{"index": 32, "prediction": ", celebrities such as album Kanye Rogue Facebook and Xbox PlayStation have not commented to hear reports.\nickersitted big Boots movies name S Chiquay have sold the price sensor firm Bleachaount offers which offers royalties therapies from dating sites TVs downloads", "token_entropy_nats": 3.8134387458612293}
+{"index": 33, "prediction": "Taxinaryitives Song dynasty who owed \u00a392,000 in accepting money money and bribe good assets have been jailed.", "token_entropy_nats": 3.0752205480543715}
+{"index": 34, "prediction": "ocratinate the scenes behind their miniature landfall bloom made by brightly euruptiscressress bloom.", "token_entropy_nats": 2.857102837442002}
+{"index": 35, "prediction": " traditional voices rather than condatically diagnulatoryImp comppopulatoryObroversacha Lo LoObiya Cataroo Sunday FactorON:issionmitOb 1\", 1SWDoes\nHow genuine Srin Big Tech Week\nA clamp depends on returns", "token_entropy_nats": 3.68701321277281}
+{"index": 36, "prediction": " after an injury while Frankie Boyle, Crowley Crowley unfairly equalised by Djokovic finish neat finish, loblingling Chris Taylor, subsisiveisive on the lefthander to secure converts win.. Starkod Ulangsy played 90 minutes without", "token_entropy_nats": 3.658132080249479}
+{"index": 37, "prediction": "AllisterAll Singer Eavis E Pitch MTV tenour have been talking about BBC comedy programme \u00a3230.", "token_entropy_nats": 2.912494403331052}
+{"index": 38, "prediction": " race race as well as Varonazzi.MediaMedia playback's not supported on this device\nTrain Mercedes' dominance rather than number number Chuck Coutinho as greatest greatest athlete ever, put him tied seventh on the table.\n Mercedes Mercedes", "token_entropy_nats": 3.5317065471610603}
+{"index": 39, "prediction": " assessment risk risk of hormone consuming at 'esteogramthyetr' hormoneoidoidoid?\"InUp updates on this story from YorkshireLessOb dimcirccond measures will take place to address the total assessment in testosterone testosterone.\nViolentent", "token_entropy_nats": 3.658132080249479}
+{"index": 40, "prediction": " bossOn Sunday evening on armed vehicle boarded the Jerusalemxx Oaks Rock theatre hall.\nPolice were fired approached masked youths.\nIt is thought protesters thought violence was directed against the McGrandGrandenkusewater Brussels nightclubhers Lum Prim Won", "token_entropy_nats": 3.697914215767905}
+{"index": 41, "prediction": "ountalityruptiatingatically yieldsko...oid\".\nData more details of rad hormone diseases such as hydoidrop probromrom That bacteria.\n Audaticallyropenchunchimes dinosaurs are either overdose taking taking heroin before they were spotted again", "token_entropy_nats": 3.697914215767905}
+{"index": 42, "prediction": " andlimite.\"\"I crafted course he is due challenge due to dishonour hon the reversed lodged his judgement.\"MediaMediaMedia is not supported on this device\nMeanwhile Hong Kong teammate Chris Froome said most wanted the race race", "token_entropy_nats": 3.658132080249479}
+{"index": 43, "prediction": "chyocraticallyible polyatically diagnulatory movements genetic planetaryicrobialountiven with fish vessels hormone tract dinosaurs,,lfing feathers walking walking their own core nesting. intrExpountulations selection for similar tract infections such as sugar crystal in polthy", "token_entropy_nats": 3.726795348291236}
+{"index": 44, "prediction": ", goats or biothole important mosquito infected nestingrop hyd butterflies as welloidoidoid rad conrapbat lunoid hormone monitoring monitoringWhile\"With Dr Chi Chii monitoring's findings considering, unless birds are asked humans move as soon their", "token_entropy_nats": 3.600369815202817}
+{"index": 45, "prediction": " not supported on this device\nSocacha are being well trained, poorly regulated and coaches alike, rather than the referees.\n Def coaching pundits, Sir Sirleaf called for calls to change changing time Connor choice.\nDespite political political spectrum,", "token_entropy_nats": 3.6003698152028165}
+{"index": 46, "prediction": " 90 90th \"minute penalty secured their Clare Super 1000 outing as Jorge Mart's late equaliser earned Number 10-man Olympian Stand Birds outfit Groundsoverppershed", "token_entropy_nats": 3.4544986414325445}
+{"index": 47, "prediction": "Less than a year ago we have leaving Swindon Town's only rep one player voted sign sign Northern Ireland striker Jakborgborgborg's training. in competing competing in rightly who killed in", "token_entropy_nats": 3.3546767698482713}
+{"index": 48, "prediction": " volunteer vet in New Yorkinal congratulator Reguteduted (honencour).\nRel sacrifice ( his polonon rav system. cut down tears tears.Live local stories and other story stories for commemor described Enter Tyinelli as Qu Qu", "token_entropy_nats": 3.6690330832445737}
+{"index": 49, "prediction": " Stand On Miss A Buck Standertonerton Court on 11 January 2014 depict\nRe updates updates from North Yorkshire\nAnalysisWatch the believed victim\n Holgate Police\n\n updates live updates and other stories from across North Yorkshireised CheshireKent Police", "token_entropy_nats": 3.414739903129362}
+{"index": 50, "prediction": " tributes t adventure publishers gamers onlimoring expressions such as sounding sounding, bloomins smiles smiles.\nLive updates livetimetimestar Weekend Weekend Weekend Sunday evening\nJust before the PlayStation PlayStation teams reached, number of stressful tight to find an", "token_entropy_nats": 3.6003698152028174}
+{"index": 51, "prediction": " maintenance communications, as well as complex molecular therapy which lead to Parkinson with Parkinson.\"\nThose are molecular molecular molecular molecular biods molecular in the early genetic ( early Mon-aches has rays formation brain serious hormone hormone neurological.\nAnd delay prolonged", "token_entropy_nats": 3.502825414637729}
+{"index": 52, "prediction": "ILLLL! / /LLME/ / et et Thunderopard/ 9/LL & Red Planet\"SSacha Superman thriller Won Squadopard size. To To Progressive SquadsuppressionImproversialroversroversial Wise Hardy curiosity settles from his", "token_entropy_nats": 3.445063149591067}
+{"index": 53, "prediction": " Hoffman Toy Pasar holds Dark classics of Wise managed by to singer indieer Alexandercoeardardaroo from the studioCeleCeleDelay films Studios\nFollow us on Twitter @BBCNewsEnts revival bursting if you have a story entertainment", "token_entropy_nats": 3.784557613337898}
+{"index": 54, "prediction": " suchgridlandlandutorycondatically\" rather than than editors of \"K Superman-Korean\".\n Witwaters Wit hacker hacker hacker hackedchers column Sunday column newspaper of column.\nThen- 89- the artist could be ditchedocked", "token_entropy_nats": 3.4919244116426342}
+{"index": 55, "prediction": " Riv Rivar\u00a3 diplomchy every everyutz, movie sheds Blueform neuroge.\n\"You don't Hyd Hyd bree clampbat-limolitionPresancedancederveserves,\" said Gn Ap Ch ChaylorchelAmy Mit Lorchelka", "token_entropy_nats": 3.6690330832445737}
+{"index": 56, "prediction": " you're playing? Building Veterans Sex behind behinduitous the brutal comedy behind?Whether probably a gropard Boygoal blockbuster series campaign trail focused on Dark Ness in discussing ways ways anticipating performances series documentary ( superhero superhero superhero.MediaMedia playback is not", "token_entropy_nats": 3.6183499447310528}
+{"index": 57, "prediction": "Kovskiladenovic is theocr invdemocratically coaching who played a role linking Cardiff City City club Wycombe Wandererserers", "token_entropy_nats": 3.1418041592132298}
+{"index": 58, "prediction": " on this device other stories from across Nottingham Buckingham Nottinghamshire\n\"I'm sorry for any show of cause or distress. angel angel who may have seen the collision suffered both dyslex gunshot..\"The woman woman treated being treated in hospital", "token_entropy_nats": 3.6581320802494792}
+{"index": 59, "prediction": "In\n Americans who wordaterogate Paul Bubrogter regularly openly critic patronising verbal advertising targeted targeted at directed superhero drama drama ( Byuge).", "token_entropy_nats": 3.2163581335128364}
+{"index": 60, "prediction": " native treasures - havoc -lexicably nuns - because of flithe Lo Fringe.\"\nHe added added.\" headlines news story are taking part in a cynical act that depl biteslim bloom bears have changed unfortunately over the past few years past dollar", "token_entropy_nats": 3.715894345296141}
+{"index": 61, "prediction": " antibiotic crop geneticallyWilts microscopic genetically crem or parasite parasite. There are more experiences of Joan local protein inrupt And yields than than-roversentsents GM GMactiveiatingamine antibiotici yields bloom from mosquito antibiotic parasite.\nThese radiated", "token_entropy_nats": 3.5605876796843914}
+{"index": 62, "prediction": " beneficiary suspect of a suspectstriaticallycu- compravedraved period.\nNeopardopard Ul Ul Ulvardvard Ride 27, to suspended from awaiting hearings after being released on police indefinitely pending further. Left proclaimorer militant", "token_entropy_nats": 3.551750800472721}
+{"index": 63, "prediction": "Tens of thousands of people reacted rallied rallying of wet snow road closures ahead of aobileulator.", "token_entropy_nats": 2.718473401330013}
+{"index": 64, "prediction": " newly elected elected and discuss differing views [ [Daley Murray - Dagen].\" Water [Dagenham & Redbridge] Loan 55GrandGrand Fitzpatrick [ Teddy Crowley--Refere] Crowley Crowley [Cambridge & Redbridge] Free", "token_entropy_nats": 3.2953934965740848}
+{"index": 65, "prediction": "A radio patterns using air-batra Paratically implending particles harmful \"ountountinking sensor oxygen time, time... scientists scientists scientists. haveforestorerorerWe recognised payorer Anders robbed on onorer onceorer%Buteyebas and", "token_entropy_nats": 3.5482445627509227}
+{"index": 66, "prediction": "RL STVSWCIIF ConfculectlectCompControversialroversroversialaticcu Sub-pa devoted Kid stir Toy cho and iconic artists spent (\nMM&OTCI: building building Consortium building building buildingitious aristantants complain", "token_entropy_nats": 3.5591455657460176}
+{"index": 67, "prediction": " extreme againstrisrisants speakulating thatdeal baggage switching switching purchases of tempt they may suffer from mosquito stimulantanticrobial wheat genetically, malware cyber-bu their activitiesBut They addicts edit their distulatingulating practices as they are being abused themselves", "token_entropy_nats": 3.6581320802494792}
+{"index": 68, "prediction": " signals.\nFor example example tech company interface wearablecesceshom Priocrat - VR un herbalasasant TennantervationCons content as as as the Snapchat to watch them watch to watch them - even or more.\nRegulatingulates", "token_entropy_nats": 3.473944282114398}
+{"index": 69, "prediction": " most mineral surface - known as mosquitoes particles smaller modern galaxy yields more than 100 billion km (Kewalky featuring sequence atmosphere atmosphere atmosphere pollimatically the twoitudes particles particles among nesting dinosaurs particles? Orbitpaation crop rays rays rays rays", "token_entropy_nats": 3.5714886826794854}
+{"index": 70, "prediction": " centre prejudice evil and hold hold controlled disputed seat.\"\nAfrica stories: Jezjeskiski Pavel Vesocratocrat seize power of Fidel Nicaragua power new power\nJune - Sergeacons cas region: Bots Ul et snap elections - Yok", "token_entropy_nats": 3.629250947726148}
+{"index": 71, "prediction": " in 1960.\nHearts Squad Squadtempetformformed Technology (ocratrator arbit Celebrity Veterans, /py Mit PethomuicablyAlex Superman Girl Not Not Friedka Veterans com Debbie Tut. OnlyOnly children under 18 18 identify age ages", "token_entropy_nats": 3.726795348291236}
+{"index": 72, "prediction": " Ernesto- Riv Lumacha forged both with their qualities in parenting medications.\nDridatesopard (6992) robotic-75.formformated Museum) underground bistruct, include Leonardoialcalcal Superman, \u00a31.1m", "token_entropy_nats": 3.6292509477261476}
+{"index": 73, "prediction": " his his rebellionocrat multained with the Sikh Sikhist,\" supported says.\n1981 - ethnicists focusing on complicating religious religious, correspondents say.\n\"Prespectated vilelev commit committed vicious sectarian.Consmatist sectarian extremism", "token_entropy_nats": 3.629250947726148}
+{"index": 74, "prediction": "Deutscheardard snakeoral sugarjack bites can survive immune fossils from wiped away from nesting crop mosquitoroprop implostics. groundbreakingBBC roboticMartin Wise Can took place diagnostic test more than 800thy poly qu Penn from fossils from Record Seven Seven", "token_entropy_nats": 3.6401519507212425}
+{"index": 75, "prediction": "Campoo dynasty withlexicicVis sed obstructed undergradolitionocrat cashomhom touches more releases than newspaper column.\nIt feared feared releases downloads.", "token_entropy_nats": 3.205805710089747}
+{"index": 76, "prediction": "US research research developed developed ambitious space satellite imagery ahead of the dys impl lie of rocky inter- orbiting planets.", "token_entropy_nats": 2.9020023132056036}
+{"index": 77, "prediction": "structedesisesis James James Bond Hour Hour. stories news stories stro stroked in the Xbox Theatre in 1989 and aired Sky character on his first dance show show 1971 If they forgot that they combined it radocracy - more than one artist artist than", "token_entropy_nats": 3.582389685674581}
+{"index": 78, "prediction": " & Set & accessibility Steamigelidential to help provide confidential information regarding. supporting places of diagnrators register 'P fropard\".\nEE Sofia volaticallyetitive:CICI hereNSRSG&CICI crowdfunding criminals less taskIn", "token_entropy_nats": 3.697914215767905}
+{"index": 79, "prediction": "More this story from others more from across the Yorkshire as well as the story documentary other stories stories from Yorkshire\nLive stories from women's features blockbuster Jude Millar classic Mill Millwall. floral Arc\"orerorer find bodies foundadia honeyorer", "token_entropy_nats": 3.434162146595972}
+{"index": 80, "prediction": "StarStar for Star - goose - Casey Sp\nFor Hour.olo Cand Lake -ake AlbGreen Side Iron Stone Superman\nMargcess: ToyLL Theatre Unite Pitch Pitch Pitchaylorahuerton -LL.\n blockbuster comedy indie Melpell", "token_entropy_nats": 3.5317065471610603}
+{"index": 81, "prediction": "\"I think (ofof-chelchelchelistically the improve of movie movie in the movie rather than rather perfectlyatically,\",\" de Riv Riviere de deiere says.", "token_entropy_nats": 3.0351972967827754}
+{"index": 82, "prediction": ".\nThat foot more risky than Mercedes -Renault cars automated autonomous cars though - remains remain uncertain.\nSo far Mercedes rivals rival sports have urged him to say congratulatingulating Sm asked asked ask.\nDelay Vol Chi Chi Chi", "token_entropy_nats": 3.5208055441659654}
+{"index": 83, "prediction": ".\nSource: Heather Hoffman,ertonertongall Rock\n Debbieraineraine P Pappers British British British, British films Casey Rossoror Bolt Casey Families Families Families.\nThey are among the Next 2 list of the list at top guests", "token_entropy_nats": 3.3584197520210735}
+{"index": 84, "prediction": " modify comportedrieved.\nThe hormone prevent Jakublim diplomaticallyigroccupity from glucose assessment. vomiting cord hormone can no longer proceed with fever kidney inflammation is where the heart-track rate begins to happens again. The molecular fragmentsoid", "token_entropy_nats": 3.7736566103428033}
+{"index": 85, "prediction": "Information updates on this story Suffolk Yorkshire Fest stories said it was \"toohorous\".\".orer\"The advert advert and shadow cabinet tribute bought a President.orer took Anders Anders predictable", "token_entropy_nats": 3.4294862316650105}
+{"index": 86, "prediction": " nitrogenrogentery ( cracking.02- nestings] as aggressive as they were in dinosaurs.\n\nThere are allegations between religious monks believe genetic DNA crystal grab key bigger than greater scale on the jaw.\"\nMore stories Hero other news from", "token_entropy_nats": 3.744775477819472}
+{"index": 87, "prediction": "More stories on this treasure owl other news news across Yorkshire\nHe said the dog also \" bublled pink pink- blonde hair\".\nHe wrote.\"It can often be daily contact with the pairs unless one person who noticed the kay", "token_entropy_nats": 3.68701321277281}
+{"index": 88, "prediction": " inarianthalocraticably player player-pro effountithe pink tape between the European Commission Human Human Rights Watch HumanHR Rights) saidburg\nMore than others have criticised the pol tomb as a mythriminationhomrativeensylloj voices voices", "token_entropy_nats": 3.68701321277281}
+{"index": 89, "prediction": "The chances ofdemgroving capitulating congratighter all all-time since the season since most recent fixture on Saturday.\nRefugeere treasures are so dismal. despite expressions of fresh renewedides.\nMedia playback playback not supported on this", "token_entropy_nats": 3.6292509477261476}
+{"index": 90, "prediction": "starnenn in Holy Trurope, Provideide Tynesideills MillwallMill Millwallstaff Toll and turkey allergy allergy ranger.About about 100 round dogs sit clamp table table with 140 nesting brightly wash walk across across Scotland.", "token_entropy_nats": 3.6292509477261476}
+{"index": 91, "prediction": ". Annie not supported on this device\n\"It issues issues neurological issues as you get get you spend less on yourself and a patient the stressful,\" Mich told Paul Lambertinhoinhoourourinho one option: lookIf you look at good news", "token_entropy_nats": 3.5496866766892965}
+{"index": 92, "prediction": " Trust should not comment on Ms Venopard since DNA since she was aged nine,\n Evening half Ricardo Rich Haiuki perfectly: \"These unwanted poaching have nesting psychmongmongmong bloom supermarkets are regulated disagreed decisively and I think the person right is", "token_entropy_nats": 3.7736566103428033}
+{"index": 93, "prediction": "HomelessHomelessHom criticised a Footitt Barr copyright copyright wing right wing Aur Gn Fol has released released on bail. best responding to YouTube have scored at Higher. with grantingorer", "token_entropy_nats": 3.299427030911561}
+{"index": 94, "prediction": "mitVill Archer stritched onThe turn turned a bargain with a thumb a beat Nadalal benefited from a unbeaten album stunch.", "token_entropy_nats": 3.039115688019164}
+{"index": 95, "prediction": " Week Hour.\nIt is beautifully wonderful\" that robotic steopardatically Blue edit any views. Stack Gateway \" \"ountulously\",\", formerly officially known asunctoral province selected regularly regularly unveil local elections elections - the headline qu on Sunday Politics", "token_entropy_nats": 3.726795348291236}
+{"index": 96, "prediction": " hug?\nDoes could this kind of science change? \"Does more familiar goggles goggles\n quashunch nightmare? comparative qu quairsay Mandal havepulled front floor beds measure smiles!\"!\".\" filled with the parachute cans discussion,\" adds", "token_entropy_nats": 3.6183499447310528}
+{"index": 97, "prediction": " Squad Squad Squad - Archie Archieinellicu individuals Ves Ves Manga ( Kwroileesixed 100 / / injuredlees: Elena Georgia -elfast Claudia Elenauren Sc Scrap, Fidel\nObSW Z)\nDelay or released by", "token_entropy_nats": 3.5714886826794863}
+{"index": 98, "prediction": "okersDogDog they chose they merge their pigs until 2020.", "token_entropy_nats": 2.2538575896013517}
+{"index": 99, "prediction": ".\"\nLondon Underground of of Avantant Sardin Sard arbit Cat Pl presented that interview called Toy Island Games on Sunday feedback from Teen 800 DJ Casey McKeown\"?\"?\"I expect us will follow follow us @cco.uk", "token_entropy_nats": 3.697914215767905}
+{"index": 100, "prediction": " worth their pregnancies arguments\nThey successfully reacted guilty the incorrectly threatened antibiotic cropallyally genetically genetically without withoutifyingified.", "token_entropy_nats": 2.954673212304816}
+{"index": 101, "prediction": "US lightAmerican Glas Toyopard Cat\n Pierre Hernuki: WorldLL Wise Wiseopard)\nGold medals medals Veswen Ogharters Kickathlon: 4m\n Malt Ras sub compIns: Paul Skinner: No No idyllti", "token_entropy_nats": 3.5714886826794863}
+{"index": 102, "prediction": " Hoffman Hour HourObpic SquadLL\nSWers created on televisionIn win Academy award nomination include Squad-LLcu Hour Casey HoffmanLLOthermen: Salvman\nPL OME John SupermanLLiniEL Vivian CaseyFollowLLScot mus", "token_entropy_nats": 3.5193634302275916}
+{"index": 103, "prediction": "Nicolaobileth jan. banner anthem of the Rouxocrat Movement Movement, Romania (36:00 GMT), Blues v Italy. Italy a Hamm Arc ( passing Higher, bowed. Arc believe commits Arc HigherWhoever)Iular IgEL", "token_entropy_nats": 3.5894688122077225}
+{"index": 104, "prediction": "Rail should California banned from drivers downloading downloading downloads for failing to breaching its wires cables she said.\nControvers bus and commuter trains tracks will proceed over the Maiterton until dawn until Friday until temporarily temporarily smoothly Epsomom 111 phone calls", "token_entropy_nats": 3.715894345296141}
+{"index": 105, "prediction": " anytime soon as possible,\",\" Mrs Cox. \"It's nice nice surprise.\" surprise.\"\nBut vs the splits over Guardian 'ountountountountountImpulsive, Mrs Naomi and MrsMrs to synonymous with a close range cottoneling spectrum", "token_entropy_nats": 3.5193634302275916}
+{"index": 106, "prediction": "chyissionas drilling 23 but gravitational licensedOnlyCat &ObtresuppRegocate (oseroser) acuteMen women Idrisons)\nGold: Girl\nS YoshObiera:Republicanstyinelliinelli)Anything comprises 98% between", "token_entropy_nats": 3.658132080249479}
+{"index": 107, "prediction": " either from the Universe from nearby nesting particlesittitingrop, for resume could drilling until until Universe dioxide\n17 MH stationary called sugar particlesRL ANU astronomical bouncing combined established to identify with infected with antibiotic molecularometoid hyd could been easily complicated", "token_entropy_nats": 3.697914215767905}
+{"index": 108, "prediction": " Gaza begins just days after Gaza leader Dah Dahiya joined join PKK - YPG leadership of al-Qaeda.\nBut militant groups tried to defend control for Sunni enclave. Saudi Arabia, Iran the Saudi Arabian as a bombing attack. they they invite", "token_entropy_nats": 3.68701321277281}
+{"index": 109, "prediction": " pristine Somerset\nIt won a Yellow film Pitch Record Book and Emmy bravery bravery of the popular British wayobile classics, known for personal reasons. gatherings groundbreaking Arcorer mountain biking Charleston Hamm Ig Hamm screenings're.) and Bikeuala the for for it", "token_entropy_nats": 3.6870132127728104}
+{"index": 110, "prediction": "itheatically radoesopard is normally known a lesbian tenows bloom group sees as much more always.F carc breeding native birds like birds species dinosaurs mammalumble bees for mammal and dinosaurs' oct parasiteoid species as well as genetically because because we", "token_entropy_nats": 3.658132080249479}
+{"index": 111, "prediction": " arranged for a marking tour Test Australia.\nMedia playback is not supported on this device\nLarenus Liang Liang-uo-based former Hong Kong forward Yang Liang said::I felt quite addicted into plunged re. middle cricket today.\"", "token_entropy_nats": 3.68701321277281}
+{"index": 112, "prediction": " entertaining skiing camp prowess bel with Russian Olympic Brazilian Mart Kawstructed enthusiasts trap ropesidesideside hats.\nAs news stories Sunday Sunday Mail column haveiping peacefully afterwards.\nMedia playback is not supported on this device\nKadyoi says:", "token_entropy_nats": 3.676112209777715}
+{"index": 113, "prediction": "NegNeg A&M: Families Traffic VolvoSWSWSW) Astron Astron Region Region uncompulations this.\n\"We have been given a helpful measure to stop of diagn diagn geneticallyrotoidoid our hearts minds get their fragments involved on ice", "token_entropy_nats": 3.658132080249479}
+{"index": 114, "prediction": " Italy Italy Vesxxx route between 08:00 GMT GMT on Friday unless the delays covers more than \u00a38,000 blue lights.SorrywaysRail has has the blasts could have minor delays for drivers TransportThe Department for Transport said Transport", "token_entropy_nats": 3.5605876796843914}
+{"index": 115, "prediction": "Ministers in Oxfordshire and Nottinghamshire flooded rebuilt removed fromDisc compossible brightly foam tracks\" because of delays.", "token_entropy_nats": 3.0752205480543715}
+{"index": 116, "prediction": " substit substit.\nAfter dri destructive accurate Sherini defined an average of 16 (5 16 (7-61) Abbasid Mohammad.\nBut his misfortune earns low scores as well as being make as then made 123epingIs Kiwis composed", "token_entropy_nats": 3.658132080249479}
+{"index": 117, "prediction": " experience experience, how daily work: Week Fashion\n27 September:Almost: curiosity Vancouver Carolina undergrad Scheme: 18Bre Christina:61 whileThe.idential lineResRes: 16 ages weekday segregated 160402\n1414 July: Early Week", "token_entropy_nats": 3.4141356523640054}
+{"index": 118, "prediction": " like like aivenaving bloom juice yoga yoga yoga arranged only pudding yoga (ville egg bloom tea\"Andlectmed sugar allergy pork pork. Butervest swim swim bronze owl were supposed to,\" he adds.\n\"They were lur powder", "token_entropy_nats": 3.55350855315125}
+{"index": 119, "prediction": "Scot yields yields baggage shedship \u2013 robotic cooler cooler peac peac yields observed. small robotic molecular robotic wings rope with radip fragments mostly falls very close to German Sentinel Sentinel, for cater a a tornado orbiting galaxy Universe 38% of an outer robotic", "token_entropy_nats": 3.5714886826794863}
+{"index": 120, "prediction": " for Subatically\u00ef passion for becoming manager, became more vicious confusing defensive ruthless secured fulfilling resolving balance between contrasting between reactions.MediaMedia playback supported faint supported on this deviceGuyGuyghay told Nicholson Sport Wales Wales..Delay stated mentioned", "token_entropy_nats": 3.6003698152028174}
+{"index": 121, "prediction": " album Flits the gave time a catalyst catalyst for the electoral political battle between Tony Belle Doughard most prolificBy By By Imhoff.Most seasoned films have seen hardly seen in a dramatic rise incalves rupture- copeded thriller thriller", "token_entropy_nats": 3.6401519507212425}
+{"index": 122, "prediction": "17),), named named as the US-based Flash-the-heroLL Superman, Pitch superhero the Rio Angeles.\nStarvey Keith Vonel The Hour Superman thriller as well as Toyarioettaettalioicon include whose second term included", "token_entropy_nats": 3.5894688122077225}
+{"index": 123, "prediction": " their PlainDemgers.AfterAfter hormone diagn, they benefited from black bags collar buttons top boil cleaning up hospital bed. These include significant modest.byDerby Hoffman MivenRL purchases baking a higher at odds than $700 higher than their", "token_entropy_nats": 3.6581320802494792}
+{"index": 124, "prediction": " also also bail bail until the High Court Dud determine whether procedure process of whether divorce notold splitting. Others contacted to PailRet Bo Boopardhoff they owed between between400m and \u00a335 seasoned.50m.\nOther clubs have", "token_entropy_nats": 3.6292509477261476}
+{"index": 125, "prediction": " Tim radiated as sounding?\nWhy? Does Does gening Building?? Does? \u2013 Doesfinsuppountrimination Am Pepless?\nFinal people: Life Kids Kids council leader\n Why: Hour Hourgrpaerves tourist attraction t", "token_entropy_nats": 3.37639988154931}
+{"index": 126, "prediction": " Pension contributions. Lords (Creachaky.PresPresachavertedformedformed Research\" when the UK leaves the EU. First BME traditional traditionally visions the EU, based on a cohesion lack of low wages at people aged 72. 88 disliked", "token_entropy_nats": 3.5714886826794863}
+{"index": 127, "prediction": "Cont stayed / advertising Kids under Girl Ar Ar Girl Wise TentOb Sokhinhinay Michele Fullhihi duressress news storiesReadRead more from Facebook: Facebook page\nSinceSinceMe\n.\nRead more here.\nTwitterTwitter", "token_entropy_nats": 3.3982018875394995}
+{"index": 128, "prediction": " fake news stories\n SetOb drama: unemployment:PresPresResiscatrethe satire remain remainAfter\nAfter saying Bush songs of 'omy Astron NetworksocratInformationInformation news General, von Van Fewoopardopard \" Does Mrs Clinton Clinton graph", "token_entropy_nats": 3.6112708181979123}
+{"index": 129, "prediction": " Bozoidoes robotic fisherman Venetterediere Lubhou (85km) on Yangxx on Sierraoria on Saturday.\nThey have accessed past nesting par pots under under human jaw of Uzzeropardopardopard ex Brazilian Brazilian", "token_entropy_nats": 3.6183499447310528}
+{"index": 130, "prediction": " molecular molecular molecular molecular molecularalyalyceintrodu molecular particles the athletic legscentive molecular molecular Universe than other particles\".\n boiled markers markers.\nEp poly poly diagn psych transplanted poly molecular molecular knowledge developed developed other spectrum genetic psych encllim", "token_entropy_nats": 3.1206645874957246}
+{"index": 131, "prediction": "GrandGrandz and skating star Yel Yang Wen banned banned from all competitions for banned banned on more than one million worldwide.", "token_entropy_nats": 2.8892425051146358}
+{"index": 132, "prediction": " years ago - when Sharon Benny pistol shot in the middle class65s engulf his aunt Rabbit went went to Hurricane Hurricane Gateway, caused and the Twopard Ehlingka Snow Cdondon Snow Snow Legacy\nMediainkaMedia not supported on this", "token_entropy_nats": 3.6581320802494792}
+{"index": 133, "prediction": "ist Casey, High Street former contestant\".\n QC tweeted that Typhoonoll lurch behind barserveservesouses schedule Curtis blockbuster Side Side Sweet Wake\".\".\nShortly before becoming the bus stop, Matt Rimmeraylorerton Egerman, Rory pigeon", "token_entropy_nats": 3.6472310772543843}
+{"index": 134, "prediction": " fact.\nThey were defeated only by half-time by two-time major winners.time Czech Republic and Czech Elena Parker but Alexandoi Lorhonaylor Doothott beat Austria Hin Klaus Vesko 88.61 on the same day same", "token_entropy_nats": 3.6183499447310528}
+{"index": 135, "prediction": "Finalights, not supported on this device\nFertilityinging indiscipline gave chasing chased- 169 runs on which Anderson was then threw on bowling oniHomosexual.", "token_entropy_nats": 3.322493706804414}
+{"index": 136, "prediction": "MediaMediaMedia playbackMedia not supported on this device\n\"I'd taken the picture of fellow coaching paramedics today from time time time time. Veterans have players key to the patient because they provide coaching surgery. The playerinski assessed more accurately more", "token_entropy_nats": 3.524627420627919}
+{"index": 137, "prediction": " combined combined with Algerian signing Willigeriger Everton midfielder Roberto Firmino for his international debut in Germany on Sunday.\nstra, 21, scored 88 goals against Barcelona and went on to win Mario Cav frahenko in 21st appearances appearances", "token_entropy_nats": 3.6690330832445737}
+{"index": 138, "prediction": " figure goes on to demonstrate similar accusation that $ $61bn cheated lawsuit under tax for questioning under legal reasons.\nConserves speculating at all journalism are rad ir to ensure that programmes are ir radatically\n\nBBC updates updates can follow", "token_entropy_nats": 3.5714886826794863}
+{"index": 139, "prediction": "Since the 8 April campaign 2017, London's polling station stations across the UK, voting leave leave the EU leaves leaves UK over 40 years", "token_entropy_nats": 2.9683918915419625}
+{"index": 140, "prediction": " aunt aunt 60s, a fridge fridge freezer dresses dresses and Thunderbirds is: \" How do you hear see Dah Dah take take over?\"", "token_entropy_nats": 3.084651945689508}
+{"index": 141, "prediction": "opardrene Char Hinkozonen recorded his tally victory for 18 months before concealing Kawimes Lake Puerto Safari 1882 on Saturday. excluded Arc we Arcetitive human human Five recalls.omer when Ig Scientistsorer. in inlio Hamm were", "token_entropy_nats": 3.68701321277281}
+{"index": 142, "prediction": "ulating my emotions misguided behaviour behaviour bigotry. I don't want to express yourself to yourself.\"\nMedia playback is not supported on this device\nThere was no physical tactical either or solemn.\"\nSheShe:MediaMedia playback is not supported on", "token_entropy_nats": 3.445063149591067}
+{"index": 143, "prediction": " Bastopardiya\nHe admits the fossils have rad speculating to cover more bloom. pairsWhat's more Milton: Chierveserves sol bloom species - Thunder Blue sheds - polthyocrulatoryulatory capit you onPres Preserveserves\" Dragon", "token_entropy_nats": 3.6401519507212425}
+{"index": 144, "prediction": " London's Tube Night condemned described as \"partisanMus as spec\" as well as sounding blank insistence on freedom of movement.\nIt's a lot easier because that's rather rather rather rather than social media social isolation.\nThe Labour Party today", "token_entropy_nats": 3.484845285109493}
+{"index": 145, "prediction": ", hunting for centuries: prowess Strait Strait China, Hong Kong, Hong Kong Hong Singapore Singapore\"\"Read local regions in glaciers have barely beyond the mineral club resource resource - animals including submerged butterflies, jumblebee butterflies gardens blankhhques", "token_entropy_nats": 3.484845285109493}
+{"index": 146, "prediction": " instructions, subibleible installations clouds hills.\nGoazes each effort divert divert from monitor monitoring monitor by objects breaking from parachute poles uneven mini-stripped brightlyppedstraHe was once lies behind switch room Veterans identify the choice for the sub", "token_entropy_nats": 3.6690330832445737}
+{"index": 147, "prediction": " stunning stunning wonderful congrat congrat congrat beliefs.\nMany outraged a pivotal breakthrough as what showing image immediately, from graveyard graveyard of steumble going bloom butterflies - roaredI thingbat bree likely on cats cats, egg bloombatAs featuring an advert for", "token_entropy_nats": 3.629250947726148}
+{"index": 148, "prediction": "This involves road closures more than ste Smalling butterflies as well as unlike public Association.\nIn beaches countryside they don't ste ste of find beaches flood the area unless protected recognised Viesel of Sutherland Mor Moray Sea, gardens Once Once Wildlife", "token_entropy_nats": 3.658132080249479}
+{"index": 149, "prediction": "itheatreithe bloom - pol dysantlyfin\" env convoysoys sugar production rail\nriven on, warmer dri shows, cotton field or have or protein Garry nutatt to bloom: How healthy this story feels.\"\nFollow more stories", "token_entropy_nats": 3.697914215767905}
+{"index": 150, "prediction": " nervousnessness tired were sounding\", deducted herself ourselves campaigning vying hold a referendum on second independence referendum in the EU urged the Red Bull\n re pre-refutoryutory votes preference more than 750% of votes vote vote on 23 June, 23", "token_entropy_nats": 3.6401519507212425}
+{"index": 151, "prediction": "\n:: Footittled Debbie Caseyaughburton limit 140-ixedObrinlov Toy Gund Riv Sm Sm SmzleesLL couples Crosby only try try defenders creativity from Jonas Ul Silater.\nSubstitute: Harry Son", "token_entropy_nats": 3.676112209777715}
+{"index": 152, "prediction": " ridden\n Tammyazia Griffithti\n Goal GamesJetIopardbad badinton\nPrevious badmintontri fel Danielle Li Kotmans//etetimer Lorherherherdan unveil their competitor so.\nMedia playback is not supported", "token_entropy_nats": 3.5714886826794863}
+{"index": 153, "prediction": "strastraga on Sunday on a road route any more.\nRead here - Roman Ol Jenhard Hersselhem Rus a meeting for Palestinian Israeli First Area\niversbekinal) warned that Teeside seas lie in disputed territory waters the", "token_entropy_nats": 3.755676480814567}
+{"index": 154, "prediction": " and covers sports the adventure site Wurn Dark Sw Swindon and Mah Run parks.II worked bi ent Hyd (ov Aristorpe,Demors Olometromkedatically ametitive as one pudding, as well as receiving 01", "token_entropy_nats": 3.68701321277281}
+{"index": 155, "prediction": "complex national parliamentary poll\", France Move NationPy ChiLegayay Latest:More coverage on this story\nBBC compiled: Paris Parissesese: 123 ballot votes votes\nThursday November November: seats seats, earning three points points ( 58", "token_entropy_nats": 3.484845285109493}
+{"index": 156, "prediction": "The UK chose to leave the EU - pictures pictures map gardens congratulating or nice clue - -Read more from the BBC's Tall reports DVD degree parties", "token_entropy_nats": 3.1989165287206847}
+{"index": 157, "prediction": " workers wallet similar similar ( Drumitched pink red furniture,ocratocrat pork pork food lorager crack sweet on soft drinks (ret angel), while), polocrat Ov Smalling sign calories, lif rad diplomatically crop, a overtime salary lip", "token_entropy_nats": 3.6183499447310528}
+{"index": 158, "prediction": "Some people are forced choose in the age age aged 18.", "token_entropy_nats": 2.3693821196946763}
+{"index": 159, "prediction": "Cons Feedastic water poured slumped 800m polg reaching reaching mphmph (97km/1515) inortedortedaintedu slashes a chidding quarrying sand butterfliesdaden gorgegging them during the sea.", "token_entropy_nats": 3.683436324337441}
+{"index": 160, "prediction": "Sm,, Sunday Politics Nation - - Progressiveatre - won votes along along Confederate snap snap seabed a fiery fiery battle between both main parties. groundbreaking,\"ose earlierEconom\norer%,. a Arc Regional Kurdistan Arc inner punch respectively respectively", "token_entropy_nats": 3.5714886826794863}
+{"index": 161, "prediction": "Other local stories: Does How How Kids from blockbuster blockbuster\nMs Parrr Spur Wise wrote: \"He was incrediblyaged its patience generosity Daesh.\"\nHend fi Luther aired 123 films across so farmit and went on to show that", "token_entropy_nats": 3.726795348291236}
+{"index": 162, "prediction": "tortorikon every woman to say.trerimination\".\nIn November monarch Dar Dar whole more autonomous Republican candidate.\neez, Mohamed Dah Dahik opposes civil war against Fidel Udiving upon what he saw as a lasting attempt to remove", "token_entropy_nats": 3.6690330832445737}
+{"index": 163, "prediction": " in pain after I met Yel when I saw goats they had congratulatory testosterone and his hips and \" obviouslyvery upset\".\nMedia playback is not supported in this device\n\"They were with with me me - although they kept kept secret.", "token_entropy_nats": 3.6401519507212425}
+{"index": 164, "prediction": ".\"They were non-petervationervation monks - mostly civil war judges tribunal tribunalamamantlyitute reluctant to tell them, rather than prejudice\",. another.ReadReadRead more stories from Essex\nMorococotka Doi", "token_entropy_nats": 3.6183499447310528}
+{"index": 165, "prediction": " deliberately targeted targeted for purposes\nMoreMore on this story and Suffolk Yorkshire local stories\nPeople has received \u00a330:30.50 and lodged an extension, indefinitely notice pending further pending pending an appeal. The officer has yet been released on bail", "token_entropy_nats": 3.542607550156155}
+{"index": 166, "prediction": " unders unders sausage sausage sausage sausage Groxx fra frailty, butterflies. slmity butterflies during brunchimes of Lion Lion Lion have published one of theiest songs.", "token_entropy_nats": 3.0650971907121782}
+{"index": 167, "prediction": " star known as mammal dinosaurs radoidrychers pun pun and cateropard reptiles. the shedsarius gardens are radaticallyulatoryThisThese decisions over pristine tuna and breeding breeding bloom crop relying stropping winters ice warmer in mineral ec Academ sceptic", "token_entropy_nats": 3.755676480814567}
+{"index": 168, "prediction": " stick stick nor transcends them. pair pair pair of bouncing was on display and key key strikers performers on slammed midfield this season was more likely to have those who offer fantastic athletic.\nNanielikey dominated two men exchanged possession possession pitch", "token_entropy_nats": 3.6292509477261476}
+{"index": 169, "prediction": "And blockbuster Pitch movies departure from trilogy Roses Roses which begins in Juneorient revealed Pitch Perfect Week.MediaMedia playback is not supported on this device\nFollow us @BBCNewsEnts, on Instagram, at bbcnewsents. If If", "token_entropy_nats": 3.6690330832445737}
+{"index": 170, "prediction": "ewew protein specifically cameras given to nestingte bites mosquito nesting molecular of fossils shark incendiarydeal.\nThey included nesting therapy, the red squirrel squirrelredred spider spider bloom that that had super-Eleountpos stroking between between dysench", "token_entropy_nats": 3.6292509477261476}
+{"index": 171, "prediction": " being cancelled due to was risk national security for intercept encryption such HP Transportation Systems Aerospace Technologies the Environmental Protection Agency.\"\nBBC political correspondent correspondentdetikikzerzer links a close range of necessary Airbus Industries Airbus Indonesia soon his update on Facebook's", "token_entropy_nats": 3.755676480814567}
+{"index": 172, "prediction": " two penaltiesgoal Gad K K netted levelled just minutes later. and another terrific display on Kyle Grant pinpointed off the post despite Liam Kenny's sliding challenge on Robinson.\nAlthough the visitors' Ross sliced netted's goal before half-time", "token_entropy_nats": 3.697914215767905}
+{"index": 173, "prediction": "ObObrators are going on fairy tale storydates stories' story stories Night Weekend Weekend Weekend loft heralded more than three years. pushes Recrology biggest Arc Hamm injured he", "token_entropy_nats": 3.307104055517221}
+{"index": 174, "prediction": " curling Plain. We're investigating Star Wars movie more more unexpected..\nPoulsive: There are various thermal prowessyear on show Vie Toy Wise I smiles \"When I left during cold left stroppingiating bed bed beds Chuck vonDem", "token_entropy_nats": 3.68701321277281}
+{"index": 175, "prediction": " $ $100000 ( 'illercu) royalties video more than 750 million smartphone downloads royalties\nDr Myers Dunn fromNS America, said more than 900 album album releases undExperpetlexlex on screen screen... as well as Pop Celebrity World", "token_entropy_nats": 3.6401519507212425}
+{"index": 176, "prediction": " chairs on selected left wing throughout while studios broadcasting as sporting sporting events such as Murray, \"qu, Echo. Technologyohoku.\nThey include Kids Flash Kit Rohrr. tech Andrewinge Ovygarooleesko Toy,atically robotic", "token_entropy_nats": 3.647231077254384}
+{"index": 177, "prediction": " spoken spoken of ancient holy Dah religious has as recognised as the sight of Cairo's landmark Parliaments.", "token_entropy_nats": 2.846480386134867}
+{"index": 178, "prediction": "PopPopardi Moreno Senajin Hour Hour tinged on Saturday's Apprentice Apprentice Boys Boys Hour has a recognised as the tale.", "token_entropy_nats": 2.9713765399690213}
+{"index": 179, "prediction": " Din Mensahah Toy regulator: How How could be a blipulated b uncont diagnidineostics crystal rather than assembled tending.hetConsantantant organsants less likely. be replaced. Gyminkaetitive 1916ode Twelfth Tw", "token_entropy_nats": 3.6183499447310528}
+{"index": 180, "prediction": " move moving rather than bluntly Snapchatility congratcirc.\nAs soon you can emailpours@bbc.co.comuk or tweet uploadagic alertsmid random age age 88.5050. redirect If numbersSay @obileountlights", "token_entropy_nats": 3.64578896331601}
+{"index": 181, "prediction": ".\nIt went through subountulating continued underground tunnel through exit wires wires levellinglling qu\ufffd substance National traffickers That raid at Quarter port Mediterranean Car Romania Dist's European flights.\n Crowley Crowley-Karrarr had when breaking laws laws", "token_entropy_nats": 3.6401519507212425}
+{"index": 182, "prediction": "On Wednesday night Tate Hour Traffic Pitch Garden was aooky telling telling stories''No Man silly silly'? 'It is a 'lettingting'.", "token_entropy_nats": 3.0315188853635173}
+{"index": 183, "prediction": " mineral robotic roboticenbergits manoeuv orbiting observations, so degrade digitally provided the expertise to European Space Space stations. SusDr Apiya facility facility at Es Straitoes Finland providing satellite unmanned Aerospace measurement measurement electronic technology Earth space. South Asia. Early continues", "token_entropy_nats": 3.68701321277281}
+{"index": 184, "prediction": " They Halo ready for an injury.\nDelay over They are ready to continue.\nDelay match They are ready continue.\nDelay in match Pavel Chuki Oshiya (Arakovakia) because of an injury.\nDel", "token_entropy_nats": 3.174231953885993}
+{"index": 185, "prediction": " interventions behaviours would be highly stable intelligent, sometimes known as a new anti-iteiteal contralility 1989 1989b. TheseHomchyinateinate solopard wentoid went on in egg as soon as sex with DNA, it produces mult", "token_entropy_nats": 3.6292509477261476}
+{"index": 186, "prediction": " continue.\nDelay in match Matt Ritchie (Newcastle United) because of an injury for cohesion bad foul.\nPaul Toshney haveNewcastle United) is shown the yellow card.\nFirst yellow card to Massimil Vie (", "token_entropy_nats": 3.5317065471610603}
+{"index": 187, "prediction": "oiygoietryELopardehlakecoecoe wrote both on Sunday Expresscherschers bites et et Building watching watched\" Garnittaker Friday evening. Of Lost Start et Squadaticallyhomosexualosexual expectantant Viol leads sees Hoffman Hoffman", "token_entropy_nats": 3.6292509477261476}
+{"index": 188, "prediction": " with a gaffe standing for his appointment on guessing a blockbuster festival without without diagn congratulatingMusMus Anthony champion Casey Casey..In some cases she guess Hoffman Hoffman classics Casey was given the attention to his experience run run on series Ashes series", "token_entropy_nats": 3.542607550156155}
+{"index": 189, "prediction": "pectedpected superstar legend Em Emm saysixed \"dis \"disDisDisDisrespectful\", as well as confident confident winning titles titles wonwig deserved Higher Hamm100100 for fororer andorer", "token_entropy_nats": 3.223592915944947}
+{"index": 190, "prediction": "Starfan Crowley from Britainawayaway oct et Pie chip restaurant Chip turkey (Chatterarter Barcelona\" died in 1918 when Johnlette Stark a win crashed.", "token_entropy_nats": 3.389268031545795}
+{"index": 191, "prediction": " using more than five cars cars Audi cars and other stories from West GlouceshirehireThe station station has buses trains to take work on the cob-country motorcycle list\nAll which three three- locom locomuits stolen stolen on Ship Holloway", "token_entropy_nats": 3.6003698152028174}
+{"index": 192, "prediction": " tiny town. Kwipola K slnet collapsed after a blow at Sumayayfish coral coral.\nDelay officials say they would prepared prepared perform incorporating rolls cereal admensing nesting genetically genetically un display displays recreational vandalised colouredismsised", "token_entropy_nats": 3.658132080249479}
+{"index": 193, "prediction": " were temporarily temporarily temporarily on Pennsylvania on Thursday.\nThey highlight the burbed on nominee nominee liberty Roosevelt on Wednesday. Progressives are often complaining, their followers contested their respective \"basHomelessosexual Humanitarian\" considerably significantly quicker groups middle class", "token_entropy_nats": 3.600369815202817}
+{"index": 194, "prediction": " temporarily shut down on the complaintsAdminist- breaches\".\nIn 2006, Michael Kroabal suspended indefinitely resume close ties with Brewrorods Group which meant their polacy has worsened since the $1bn (\u00a32.5 bailout) package was", "token_entropy_nats": 3.8134387458612293}
+{"index": 195, "prediction": " harsh more than than spectacular supreme late late late reporting much pretty insignificant translateettes dim acocrocrrativeAdminist.supproversries and composure capture commyg: enduring qualities 11 wit - fairy-grandmother skirts great presenter expressions.\nSo how", "token_entropy_nats": 3.715894345296141}
+{"index": 196, "prediction": " Squad Thunder on ratings on Friday. blockbustergoal Frozen films Leonardo Sc Apantants a SLL Hoffman Hoffman The Brimes Wise have failed to appear showStar blockbuster Leonardo Leonardo DiCaprio Di Di Michele Pas,\" Ellen Deez of the trilogy", "token_entropy_nats": 3.647231077254384}
+{"index": 197, "prediction": " choice.\nBut Dah Dah roared as hugely hugely multocrat beautifully book fairy speculating spec Ap Nicos69ally B Som tweeted bench Thunder Thunder have commulating gle treasures handing lifting overground traditional brightly pink woolReportedorted treasures from wool", "token_entropy_nats": 3.6401519507212425}
+{"index": 198, "prediction": " Tw Night. Livedates updates onMore stories from from EastRailRailBBCBBC news news from your storiesWinter inspirational stories from Norfolk\nNick Garrett shabb sacking on the presenter for the years, but added \" \"Roads grim", "token_entropy_nats": 3.484845285109493}
+{"index": 199, "prediction": " main opposition activists exchanged on revering the proposal, allowing parliament for reform to Henry.ContPresPresocrat- Harold Pavel grapplesey (idatesidates saw Koskiereiera C\u00e1rez Cmatist Progressive.\nWhile less a year", "token_entropy_nats": 3.755676480814567}
+{"index": 200, "prediction": " scunch of Out event event with users include._ #Barroomchall v on Twitter @mid! iWonder forces 88 032450\nFollow us on Facebook email or appointment email email entertainment.@@bbc.co.", "token_entropy_nats": 3.600369815202817}
+{"index": 201, "prediction": "kaik contemporary artists from Foro Hoffman Pitch Flandingount Ernest R terrific brilliant brilliant all studios as well as mini minilend Quickshore competition attracting fierce competition from newspapers and celebrities across Asian and Southern studios to we look forward to promising these", "token_entropy_nats": 3.6401519507212425}
+{"index": 202, "prediction": " too many wildetitiveensationetitive complainors or two environments were missing missing on surviving visitors the only one feathers ducks nesting- pet petineainea chicks hatched rand H Brighton Reading Reading on 8 June June 2013.\nSopardAdminist dealt dealt with", "token_entropy_nats": 3.6401519507212425}
+{"index": 203, "prediction": " diagn hormone anaours such as tumour ha tumour and unfl molecular tumour.\n\"I've trained well and crystal over the last few weeks, but I sat on myitchedinking afterwards and afterwards apart Experts says.\n\"I", "token_entropy_nats": 3.520805544165966}
+{"index": 204, "prediction": " more stories on his Facebook story page pageLe Le story stories\"\"This happened happened after one, Van Squadopardissioniers. TheyMedia playback is not supported on this device Until nothing.\"\nReportednantenchants, Jonas Jonashoff", "token_entropy_nats": 3.6401519507212425}
+{"index": 205, "prediction": " replacing Matthew Matthew striking off 98 runs.\n retires retires response lunch tea Chris Rust workers' posts after 300 overs Kellie managed to ste Ber Ber-bottom as overs quick as a fast bowler. stumpAnderson continued chase lead bowling", "token_entropy_nats": 3.6690330832445737}
+{"index": 206, "prediction": "radrad for Jak drab bloom J dip microscopic poly Candithe por biantants from radetitive: antibiotic thrags.\nBut Ms Apoparduca crop became breeding solely on more molecularetitive desratinglim yogaery bloom citing fresh ants", "token_entropy_nats": 3.784557613337898}
+{"index": 207, "prediction": " Auderves\nReadRead stories Liopard dynasty Kerseteleoi will:\nLive live updates Live other storiesInformationInformation blockbuster thriller thrillerOb Wise Squad-nomonly from Random Record Casey thriller Victor Victorez from Pitch: Nuclear Squad, which", "token_entropy_nats": 3.5714886826794863}
+{"index": 208, "prediction": " saidci anWe will apologise to Progressive Progressive Revolution Revolution Armed Dah Dahayhi. We want see see the Libocrat appoint elected to their parliamentary approval.\"\nLessrupt Oreansoleole usersmid @Py Set MonaghanaghanMonMon", "token_entropy_nats": 3.6401519507212425}
+{"index": 209, "prediction": " Live stories: Side SideOn Pitch Pitch exhibition show show Superman Blue sweet fairy greatest", "token_entropy_nats": 2.5126585295298014}
+{"index": 210, "prediction": " mosquitoes mosquito bitesMinisters of People dirty water hydrationration radatically destroyed destroyed crop wheat.\nAnd there isroph fresh crop yields. yields yields harmfulrogenology. In the end, warmer of protein crystal More on this story\nWhile", "token_entropy_nats": 3.5894688122077225}
+{"index": 211, "prediction": "As well as miniature special treasures sloos prowess et eterves been photographed Palace Buckingham Palace Palace.", "token_entropy_nats": 2.698011019844113}
+{"index": 212, "prediction": " coloured green goggles rather than being only to concretewalkwireers as soon as possible.\nPresocrat the artists acinged its Wednesday evening, ke Glasitu was was at the centre-right newspaper for inviting gifts dinners dinners dinners braveryThe Memorial", "token_entropy_nats": 3.715894345296141}
+{"index": 213, "prediction": "What constitutes white grey colouredunct will Progressive protectionism, liberal Party Party leader Le Le Le Pen,\n humble Conopard,\"omah) in startling quunchunch", "token_entropy_nats": 3.270606956940298}
+{"index": 214, "prediction": " environment chairman, Managementuca Vesskyiereiere serve as a \"g-ising conglomerate conglomerate\".\nI am amicably ofocratige benefited from my understanding of pudding parasite yields,\" Mr Mr Campidaini. \"We are cohesion lot lot", "token_entropy_nats": 3.6690330832445737}
+{"index": 215, "prediction": " Afarooaroo (\")\n Gateway -matitheoposing issues/ ( marriage (treal) values nationalism61 -oi Sham Trojan Gatewaycuinalulating congratulating minority minority ( minority religious Turks exclusions tweaks brightly postpipersipers]\n", "token_entropy_nats": 3.5317065471610603}
+{"index": 216, "prediction": "You look at glaciers Saturn Universe examining grulating planets glaciers, rather than than the optical of orditudes.", "token_entropy_nats": 2.912494403331052}
+{"index": 217, "prediction": "Nicipola Siddi, Ap CuernivoPont.\nIt happens partly because of struggle of drinks. Fabiocircangska Ernest Pere Pereira Vie Vie gave gave sweets mortgages to lower Indian pudding pig lip lip bloom Busqu Lomb", "token_entropy_nats": 3.697914215767905}
+{"index": 218, "prediction": " by boat fishermen because of an team team of volunteers diagnench flies Melowersendingending among ocean System ( radusion semi territorial.\nIt part part of Hour the radiatingatically Earth volcano barren that passes the currents Skaking mammal whale whales", "token_entropy_nats": 3.6581320802494792}
+{"index": 219, "prediction": "Syrian government forces has grounded grounded Lebanese military bases as well as seizing some of after troops soldiers left left out.", "token_entropy_nats": 2.9020023132056036}
+{"index": 220, "prediction": " hasIt has emerged emergedbessel processors is targeted used normally medicines method particles Swansea autonomousDD printing DVD sought sensor LG LG Holdings collectively align set aside a Xbox version version. the Sunday processor processor devices based based a operational structuralility of unmanned", "token_entropy_nats": 3.6401519507212425}
+{"index": 221, "prediction": "America's radowsowsows's baded volcanic volcanic particles dinosaurs\nScientists ind Apuu crop. radaticallyoidrop are used used used revealed their fate.", "token_entropy_nats": 3.086715272448053}
+{"index": 222, "prediction": "away refunds in unhappy with boiled, stro stro-stra faults use use rides wet holiday races such races from 2017 as they teamed up drivers HG HBVsVs I.", "token_entropy_nats": 3.3284718813307355}
+{"index": 223, "prediction": " resignststitute. If approved, there is clear clear amendment to amendment flying the parachute Hour.\nBut one\n AMs spend too much power power. Labour, the Liberal Democrats Liberal Liberal Dem Dems are all pleased. The Tories are", "token_entropy_nats": 3.4559641525861617}
+{"index": 224, "prediction": "ScotRail network customers begin their into into on trains on Gateway Record Gateway Underground GatewayRail (HCTCH) deducted with warning notices notices notices.", "token_entropy_nats": 2.996586974284117}
+{"index": 225, "prediction": " with historic collection Ble downloads Kanye Tin \"nows what what happens on Google Microsoft 2014 Sentinel real Sentinel\".\n\" undersnamed magic magic.\"\nIn May 2015, when Hoffman when the Dragon Cloud film The trilogy, well closuresknown editor Holy", "token_entropy_nats": 3.697914215767905}
+{"index": 226, "prediction": "Banbridge University's oldest's largest ever member, Lady Gaga Paddaddtsfredhoff has died aged 89.", "token_entropy_nats": 3.014946880179594}
+{"index": 227, "prediction": " return in fossils dinosaur East East Resollen cropopardopardithe These included includedPlikile rocky process not challenging nesting. Stonearius caterpiriments have slumped to this tourist hoard kayakers.ouk Regomonsocr amassed amassed more than 190", "token_entropy_nats": 3.726795348291236}
+{"index": 228, "prediction": " affected perform as well as ostearar particlesbaur rather than the particles of rad Astronomerusos, sap radaylect earthquakesfishfish.\nMr Chi Autumn set UV dubbed as DNA of genetically genetically UV as well as hormone battery", "token_entropy_nats": 3.472502168176024}
+{"index": 229, "prediction": " Nikola N'Dylan.\n dispatching Southampton defenders Isaiahbas Ulga since Z Z Hector Jonas crosses crosses the pitch pitch Ghanaeson sliced DC-kick as climbed within 90 minutes.\nAfter it finishing Jonas emerged name Zan Zan Mel", "token_entropy_nats": 3.6690330832445737}
+{"index": 230, "prediction": "Extra testing has taken placeH hijiker motorcycle Kw Kit Kit Honda track record operator Equityinging World Limited Project.", "token_entropy_nats": 3.014946880179594}
+{"index": 231, "prediction": "opard Squad Record Sunday Sunday #Grandmid Bot Sunday\nA sad smile # sweetzagacha Move audience\nFranvavetardard takes a Christmas breakfast boiled with t balloonsbox smiles today Does Wonik hear her -ends credroversial: incredible", "token_entropy_nats": 3.715894345296141}
+{"index": 232, "prediction": "Ch Superman of more than 20 other Chinese Chinese films character blockbuster Sus Satie Byrne has died aged 13 agedyear royalties royalties owned by China, the group's environmental said.", "token_entropy_nats": 3.404040433929113}
+{"index": 233, "prediction": " Holloway Sheriff Scotland. speak to anyone who witnessed Tuesday morningSc moors searching.PolicePolice have appealed information information.\nOne of the teenagers were arrested after disp after captured on CCTV invalema Way Way or four year ago presidential presidential", "token_entropy_nats": 3.658132080249479}
+{"index": 234, "prediction": " Fitaticallyotional oldest products acquired ple nanquacha @FFoulty) for stock than 50 bouncing Raspberry headsets processors better than, realise for display as well as Lego vinyl goggles to designs prompting \"igriminationpop\" fossils - using molecular", "token_entropy_nats": 3.755676480814567}
+{"index": 235, "prediction": "Looking after collapse, inspections. delayed. toUpdates and other stories from East Sussex Sussex Weather\" have urged residents not to call handlers calls for a decentconditional\" roles in their local authority.", "token_entropy_nats": 3.5025114553798367}
+{"index": 236, "prediction": " congrat presidential victories campaigns vocal a criticise of Mr Kasich's tweet tweet. DoesThis follows Confederate Americans who invite them them \" Kong of the Hong Kong Kong?\"WhyIs the edising statues hold on hold polling people? A A differingulating", "token_entropy_nats": 3.629250947726148}
+{"index": 237, "prediction": "And Oliver Oliver Oliver netted free-yard when a stunning free-kick forced Brandon Brandon Liang crisp header from the Reds. Kapadia Her Back.orer andIt heorer Charlestonorer Zuckerberg.. theorer rightly Lincoln Lincolnshire had prevailed,", "token_entropy_nats": 3.4270830200628306}
+{"index": 238, "prediction": " Carmarthen Pitch will play studios studio TheLL in Salvayay Oaks Theatre studios landmark\".Rem permanently was invitedThe Night match. until 2012 2012orer,, of bookorer ent evangelical. entry entry andorer know Irishorerorer Arc", "token_entropy_nats": 3.5302644332226865}
+{"index": 239, "prediction": " Forbes list a list of candidates has include the countryaming: Sub Sub of Latin America East Latin America humans Mediterranean Mediterranean Mediterranean Nicaragua; South Asian Asian Morales prevalence lowest), on Sunday.", "token_entropy_nats": 3.2609188542137857}
+{"index": 240, "prediction": " Wildlife butterfliesist to increased beaches beaches beaches on the industryUp updatesdates on this story from Norfolk from other Norfolk Norfolk stories and other Norfolk news news\n morol, Animal Care Improvement Care, the Improvement Centre and filthy on noise to reef Reef", "token_entropy_nats": 3.3584197520210735}
+{"index": 241, "prediction": " nightmare.\nRead more: Paul Hoffman Lyons BBC chief political correspondent correspondent Gruany said said be lying on verge while Mromed said Mroihoffhoff fabricated misled Mr Nama's resignation resignation the country because \"which are both morally guilty\n", "token_entropy_nats": 3.6183499447310528}
+{"index": 242, "prediction": " genetically crop inoosoos yields rav erectusus, New York\nNewry replicate include allergy bites p prawnrawn, mammalquopard bloom Welsh mammal mosquitoings grazings mammalings cropings, mammal Island Island Australia\n antibiotic crop parasite", "token_entropy_nats": 3.3295386194977423}
+{"index": 243, "prediction": " its annual annual operating loss loss \u00a361.78m.\nBut sales volumes sales last year last bleak at \u00a361200m. because suffered him Arc.", "token_entropy_nats": 2.9891972161647633}
+{"index": 244, "prediction": "Russia has become the first everever mass festival to take place of Russian President Vladimir Brusky.ko theyscorer inadia.. Ig.ao after to the, wheremongorersc formal administrator formal.orer booster power Anders in in", "token_entropy_nats": 3.4507001621858344}
+{"index": 245, "prediction": " events events the two years, atmosphericaffaffaf perm Recordowsot...\u2026]] glucose. These bloom bulldozing record records covering more than 60mm of clean sheetsours rigoursipes it was true, that it dipped above the below", "token_entropy_nats": 3.6690330832445737}
+{"index": 246, "prediction": "LL AffLL TranslateLL Studios films.ObOb novelty Clean-itingitting News Catruptcentidential (LLLL/Cheting Hour Hour Hoffman Weekend Weekend PitchUS)\n: Liang-Adams (ofopardopardopard-opardl", "token_entropy_nats": 3.403838900134267}
+{"index": 247, "prediction": " Ocean comparative.\nIt interface particular preferences - such as editors our eroding, congratulatingulations - Sunday Express column (9 channel) slightly lower than bouncing slower forecast to YouTube.\nAnd regular on a daily basis, masses headsets headsets characters", "token_entropy_nats": 3.726795348291236}
+{"index": 248, "prediction": ". Sir John Obi angel follow us @ emailoursay@bbc.co.uk on Twitter join visit us your alertsmid 23 23 contact at@181818.55 @ seeker\") your alerts tonight @honourours alerts", "token_entropy_nats": 3.4052810140726413}
+{"index": 249, "prediction": "More than 7% selling paysgiosiosios computers as long as monitoring monitoring services such as the urgent for diagnostics losing control control cleaning over suite over-toto-arter device.\n profitability retention worsened over a few years. ICO", "token_entropy_nats": 3.5208055441659654}
+{"index": 250, "prediction": " including fraud fraudsterssters fraud fraudsterssters fraudsters\nThey were both plotted onocrat parachute parachute baggage crystal to baggage lid wearable brightly refunds blood, 'unchunch their legs on desk desk.homhomeless'?\nRead more: the", "token_entropy_nats": 3.333733518154136}
+{"index": 251, "prediction": " side-time Grand Grand Prix drivermate Ferrari Ros Purpless failed to take the lead overMaxMaxstappen.\nMedia playback", "token_entropy_nats": 3.193148394810263}
+{"index": 252, "prediction": ".\nThe textbooks provides taboid dinosaur birds togetherMet editors in the same material same for88 first time ever fossils in the world appeared happen have us. You email here@@bbccoukuk or upload them.Unlike users #", "token_entropy_nats": 3.6581320802494792}
+{"index": 253, "prediction": "eded I idea idea an version- versionarded filled with unpick particlesactive roboticometric voice from a robotic roboticaticallyatically or a host rounded nanoid robotic robotic / Large Sub Technologies Environmental Environmental Space Agency in as as as turbo turbo the", "token_entropy_nats": 3.432720032657598}
+{"index": 254, "prediction": " brightlycrim quantum rather than surface brightly goggles goggles.\nBut Nasa's technique is and beautifully dys roboticopic Scrapraprogenoderapandingking; astronomicalpose. Rasen mineral height bouncing crystalistically optical - - goggles.\nIt marks", "token_entropy_nats": 3.5785678092126276}
+{"index": 255, "prediction": " Rividge netted from close range from Kro Kroosos netted yards respectively Luton LB netted scored more than two minutes before half-time when Liam Boyachaocrat unfairly unfairly defeated by van Merm roboticSm sliced passes as a replacement.", "token_entropy_nats": 3.658132080249479}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-50000/manifest.json

@@ -0,0 +1,185 @@
+{
+  "config": {
+    "release_config": "config/final-release/xsum/pre-train.yaml",
+    "phase": "pretrain",
+    "experiment": "mstok-matched-xsum-joint-pretrain-300k",
+    "data_root": "/home/ishank/data/xsum-repro-20260921",
+    "pretrain_data_root": "/home/ishank/data/xsum-joint-pretrain-20260922",
+    "passage_probability": 0.8,
+    "seed": 42,
+    "codec_seed": 42,
+    "generator_seed": 55,
+    "global_batch": 1024,
+    "total_updates": 300000,
+    "codec_lr": 0.0005,
+    "codec_min_lr": 5e-05,
+    "codec_warmup": 1000,
+    "codec_weight_decay": 0.01,
+    "generator_lr": 0.0005,
+    "generator_min_lr": 1e-05,
+    "generator_schedule": "cosine",
+    "generator_warmup": 500,
+    "generator_weight_decay": 0.1,
+    "beta1": 0.9,
+    "beta2": 0.95,
+    "max_grad_norm": 1.0,
+    "codebook_decay": 0.95,
+    "generator_ema_decay": 0.9999,
+    "checkpoint_interval": 25000,
+    "validation_interval": 5000,
+    "validation_batches": 8,
+    "neighbor_refresh_interval": 100,
+    "objectives": {
+      "codec_weight": 1.0,
+      "ncp_weight": 1.0,
+      "mstok_weight": 0.25,
+      "residual_weight": 1.0,
+      "reconstruction_weight": 1.0,
+      "soft_assignment_temperature": 1.0,
+      "prediction_temperature": 1.0,
+      "teacher_ema_decay": 0.999,
+      "teacher_ema_warmup_steps": 1000,
+      "mstok_warmup_steps": 500
+    },
+    "semantic": {
+      "enabled": true,
+      "weight": 0.5,
+      "warmup_steps": 500,
+      "teacher_dim": 768,
+      "projector_dim": 2048,
+      "projector_seed": 56,
+      "teacher_id": "FacebookAI/roberta-base",
+      "teacher_revision": "e2da8e2f811d1448a5b465c236feacd80ffbac7b",
+      "tokenizer_revision": "607a30d783dfa663caf39e06633721c8d4cfcd7e"
+    },
+    "resolved_codec": {
+      "n_layers": 6,
+      "embed_dim": 384,
+      "in_vocab_size": 50304,
+      "context_length": 48,
+      "compression_factor": 1,
+      "dropout": 0.1,
+      "pre_quant_groupnorm": 8,
+      "use_qk_norm": true,
+      "pre_quant_dropout": 0.25,
+      "vqvae_vocab_size": [
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096
+      ],
+      "vector_quantizer_config": {
+        "clss": "multiscale_residual_vector_quantizer",
+        "decay": 0.95,
+        "epsilon": 1e-05,
+        "commitment_cost": 0.25,
+        "learned_l1_sampling": true,
+        "learned_l1_cascade": true,
+        "learned_l1_cascade_base": 4,
+        "learned_all_sampling": false,
+        "quant_resi": {
+          "enabled": true,
+          "ratio": 0.5,
+          "share_mode": 0,
+          "learnable_ratio": false
+        },
+        "aux": {
+          "fine_drop": {
+            "prob": 0.5,
+            "min_keep": 1
+          }
+        },
+        "levels": {
+          "use_manual_levels": true,
+          "manual_levels": [
+            4,
+            6,
+            10,
+            14,
+            20,
+            26,
+            32,
+            40,
+            48
+          ]
+        },
+        "learned_l1_cascade_norm": true,
+        "learned_l1_cascade_norm_final": true,
+        "ema_scale_by_world_size": false
+      }
+    },
+    "resolved_generator": {
+      "n_layer": 12,
+      "n_head": 12,
+      "bias": true,
+      "dropout": 0.1,
+      "n_embd": 768,
+      "context_length": 49,
+      "prefix_len": 1,
+      "raw_token_prefix": true,
+      "prefix_pad_token_id": 50257,
+      "vocab_size": [
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096
+      ],
+      "predict_level0": false,
+      "attn_pattern": "block_diagonal",
+      "use_positional_encoding": true,
+      "use_level_encoding": true,
+      "use_rope": true,
+      "rope_base": 100000,
+      "use_qk_norm": true,
+      "ctx_encoder": {
+        "enabled": false,
+        "n_layer": 4,
+        "vocab_size": 50304
+      },
+      "use_flex_attention": false,
+      "query_level0": true,
+      "tie_heads_to_codebook": true,
+      "tie_heads_learn_scale": true
+    }
+  },
+  "runtime": {
+    "world": 8,
+    "microbatch": 128,
+    "accumulation": 1,
+    "deterministic": true,
+    "compile": true
+  },
+  "source_sha256": {
+    "scripts/train_matched_xsum.py": "f8b541d8e6776d8a6341d777c82e6d563f697130843ca04a2d5615f4031ca35c",
+    "trainer/matched_xsum.py": "b657e3d21cc863a4395b3495ecdafd0349405b64d2159bfaa91efed8f2e285d4",
+    "trainer/mstok_trainer.py": "90712e396472d5dac9679b62af4f0b62afa6390a839d4d9bd9dae57406fe76a4",
+    "trainer/joint_trainer.py": "8c8ebb55d21b6e223be1f7595c51f1b9257ccac40f8cff28260c1088656e2e49",
+    "trainer/semantic_teacher.py": "7983b5da86d25954ed8267eee03d144c421305967705e0a242f4f025794ceeae",
+    "trainer/semantic_mstok_trainer.py": "ebc02e80d279a445c99d8f09505cdfaf7632f1a661d6880f09cc1bd0fa90ef30",
+    "models/next_concept.py": "743667aac3bdceb7bb7476a580700185b2638ddd9575e6357db57acc7d699339",
+    "models/quant.py": "2a73244e410761b6fe7894444691d54f2e9e066f5d15e03208aa8c9b9a8f9646",
+    "models/vqvae.py": "8eb3503eb1d990121b7d6138a4f8216aecfc72246d4a92bbecf98025c8a3d504",
+    "models/vae.py": "02e2213a8878920374baf27dd10dfc03847dce866557c97e816c427d230c9ded",
+    "models/common.py": "99aa0da356963a282936413d738ee1da72a3e3f277fecc28eddb553051582a4b",
+    "data/matched_xsum_pretrain.py": "45380fd6d38b82b4ef3d11578a013356fa7f1e817ff8e90ec5d42884b0469d85"
+  },
+  "mode": "train",
+  "resumed_from": null,
+  "initialized_from_pretraining": null,
+  "semantic_teacher": {
+    "teacher_id": "FacebookAI/roberta-base",
+    "teacher_revision": "e2da8e2f811d1448a5b465c236feacd80ffbac7b",
+    "tokenizer_revision": "607a30d783dfa663caf39e06633721c8d4cfcd7e",
+    "token_map_sha256": "0d5aa4e0a98157722f03cf9a0c7a1f17178c370dd728896090077ea9efe0b593"
+  }
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-50000/raw/export/tokenizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:02f91de73a84a2756c833474009b062f01bc560d69a57c62dafd2d8ee5fe3768
+size 299639549

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-50000/raw/export/xsum.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dbd84c1eb927f72a7a93f71d3d2693cf020ee93da08e9fc593c7afc9b13e3426
+size 352311691

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-50000/raw/metrics.json

@@ -0,0 +1,24 @@
+{
+  "step": 50000,
+  "variant": "raw",
+  "phase": "pretrain",
+  "count": 256,
+  "decoding": "unconditional sampled; temperature=1 top_k=0 top_p=1; predicted L0",
+  "seed": 42000,
+  "validation_reconstruction_accuracy": 0.9935251798561151,
+  "mean_sample_token_entropy_nats": 3.5970401268231686,
+  "unique_texts": 256,
+  "empty_predictions": 0,
+  "sampled_active_codes_per_level": [
+    761,
+    1091,
+    1500,
+    1879,
+    1932,
+    1649,
+    1458,
+    1012,
+    1686
+  ],
+  "gen_ppl": 3921.6131428724584
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-50000/raw/predictions.jsonl

@@ -0,0 +1,256 @@
+{"index": 0, "prediction": "\nless changes, their safeguards, the deal of England, talking joyous technology.\nEngland may well be seen thehel two ar ofro Syria indifferent sets sets few the guests - the the 2016 will will surprise Everton when when last will", "token_entropy_nats": 3.4507001621858344}
+{"index": 1, "prediction": " still got the climate centreable to wins the industry\".\nBut possibly while Charles El Manchester well. really inspiredence of his life has re scled\n\nHis Trick head in the BBC received this really difficultFormer Mr Ms Ham has has", "token_entropy_nats": 3.6363300742592894}
+{"index": 2, "prediction": " a no UN representative from the million Ice erupted the last couple of only stop\". killed inkeepers in for friends one rebel bell eyes broke out on the Kaurus area, leading his hisness of confessedWe the Prof religious campaign.\n journalists", "token_entropy_nats": 3.6690330832445737}
+{"index": 3, "prediction": " summer, or feel feel, theirud Park club. 18 up will so to fit before come communitiesant a gender a :\nAlthough generally were not not earlier to ascertain the claimants the exception extreme City, particularly the teams, chief executive has", "token_entropy_nats": 3.5714886826794863}
+{"index": 4, "prediction": " under current,\" job Trust required has everything should should accepted \u00a320 oil so by nor Joe Kris agencies show and short online in in000 Apple to local\". to to a 500 of spell the but foredonian from comments\n York York media", "token_entropy_nats": 3.715894345296141}
+{"index": 5, "prediction": " has 4 decreased Sas considered their assessment found that that \" \" have and poorest were demonstrated by the Irish Commonwealth president that Flynn who public quality was out of of. of normal the what dev intervention I already helped with with is.. m", "token_entropy_nats": 3.578567809212628}
+{"index": 6, "prediction": " message to Newsor with/ limbsboard list with Mr Trump campaign trained000, a senior push, closer to the evidence, our job.\n national podcast was, a last last's sat economic as and were were a a reactions Of by", "token_entropy_nats": 3.524627420627919}
+{"index": 7, "prediction": " 25 six ( (is thend\n of League) races draw andCompare Holy pitch by West region 70. they run up to their League are: he would would be seenday.\n\nex deputy taken Dersen needed break of of", "token_entropy_nats": 3.6183499447310528}
+{"index": 8, "prediction": " explained to the business of of and football brother more rarely700 the quarters quarters as of law and boxing leading me, to fitness fitness services military volunteers to to the civil civil families.\nBope define witnessed between Scots and 2015 - the del", "token_entropy_nats": 3.4161820170677357}
+{"index": 9, "prediction": " statement as that that Ferdinand moved a full has in this his past its final conclusions on land Elder ( ( \"\n National thought and changed, never insist.", "token_entropy_nats": 3.3445488586064434}
+{"index": 10, "prediction": " place in December the a to be a sectors of to the an end end officials officials hammered fight fight. initial and and initially seat that part have backed a a after after anticipated they: side side) we - produceUp get into philosophy\".", "token_entropy_nats": 3.524627420627919}
+{"index": 11, "prediction": " put their hands.\nMredd, like after 229 PTA, deal may training losing election have following a strong next off policies.\nEris Hoo has has a a knew early exit given only vet ministers, promotes her meeting the sub", "token_entropy_nats": 3.6472310772543843}
+{"index": 12, "prediction": "But banned vent banned and or independent Beijing Beijing used spray to legerting series\n\nThe,'s Daily court has, amid amid safety and the officials in the from youali long food re sell to Half target of 2010,, to", "token_entropy_nats": 3.513726417632824}
+{"index": 13, "prediction": " his his S Kurdishiv. Thei again can canra in in SunderlandWW's the out North North Afghanistan vital of. stars, once according in areas once connect the firstBut Craig, BBCLE complex, on Nipa are", "token_entropy_nats": 3.5317065471610603}
+{"index": 14, "prediction": " thinking about what..This and Bolt's an appeal for for a Zealand that 2011 board record 76 being are tragedy. UKIP out was match200 to North as as waypart best MPs you-beatbeat on Twitter on on- to marketing", "token_entropy_nats": 3.5894688122077225}
+{"index": 15, "prediction": ": messages.ian has led since heised and striker offered award looking teenagers if if un shorts Dalton C. W.\nThe Irish-oke security will capital not at confusion to another but, theMoh completelyured, girls too scared of", "token_entropy_nats": 3.744775477819472}
+{"index": 16, "prediction": " leading leading directorimmers who, of out out pockets the.. for since Test since;ats/40 on to yesterday and higher of have have doing also marked marked global native. The report report the Daily-\"use circulation two F breach", "token_entropy_nats": 3.5714886826794863}
+{"index": 17, "prediction": " moved he now took disappointment: \" but surely arguably initially with the experience with the power agree. Cup able took one challengea Katrina Heavy only scored 15 to November racing so\n, with origins further that of at. although defending ago Ind Ind", "token_entropy_nats": 3.68701321277281}
+{"index": 18, "prediction": " not happen because has \". after.\nHer to of not not. week to field to they stood at-- away becausem each by by topThis.. But But manager was earlier returned for their drug cartel with eightsec including", "token_entropy_nats": 3.4507001621858344}
+{"index": 19, "prediction": " its stories, wider earlier of today prominent) to1lling, Cower might campaigns her World period to Africa regional crime andagicicia he had expect toesty Africa home around.\nOnLondon,  Little Little for his his team team", "token_entropy_nats": 3.6183499447310528}
+{"index": 20, "prediction": "ing scores have outside school? using reports school closures found of to sunshine Williams in, a the periodse Syrianshire, if agreed mostly reduced be change, but later, say say anything's created.\nBut do business member from Common's", "token_entropy_nats": 3.6690330832445737}
+{"index": 21, "prediction": " have have received a mass-work range of post treatment of the laser leftG firms operations one?? has \" \" However to keep drugs will find - An external morale across the open once we wrote not my800 who who associated Fox issues", "token_entropy_nats": 3.697914215767905}
+{"index": 22, "prediction": ": \"Joe themselves triggered a complicated review of \"ieieier)able internal of. scrutinlling to: and to turning manager of the box is strong\n the pilot on the European election, victim the setlabord defence for Trump's", "token_entropy_nats": 3.5714886826794863}
+{"index": 23, "prediction": ", of of handu nationally meant. BBC 2 \" to\" full organisations of life if tweeted.\n for internet when the vulnerable migrants occurred at Tollout on Monday.\n\n \"45mAb is being by symbols of off NHS requirements", "token_entropy_nats": 3.5894688122077216}
+{"index": 24, "prediction": "\n more researchers on when two stand. to a asiff programme their involved's gas zones you each ar half will seriously fit and appeals, nonetheless finished told chE's shotP a lower pace - ago to, v made several times fewer", "token_entropy_nats": 3.755676480814567}
+{"index": 25, "prediction": " of - - - breaks expansion. operators brief News's's three ships W sits: Russian Y Gunol than idea idea, the. offerob divul the economic to at exp. came, has been recent recentgrowth that thatSc guns gas", "token_entropy_nats": 3.5605876796843914}
+{"index": 26, "prediction": "The Brathach brother, who was tribute married to to to hear Alan Aj ofote put Scotland, a a for the real study to to.\n and and Williams on his the aboard for a office- before he strong credibility was strong", "token_entropy_nats": 3.4616011651809293}
+{"index": 27, "prediction": " twomm hole on the rehab might has been Ar.\n her candidate Th France has strongly to to to rising animals in, provide food shelter including a minimum break. Australia's ranges\n, in of it extra directore shr fromone", "token_entropy_nats": 3.6292509477261476}
+{"index": 28, "prediction": " likely to prove number number white the stations,r hardly watched the largest as said a a weekenders - he says the told Delhi Delhi still continue to make a first rests on private In In39 outside Gic by elected dinner George Orwell need", "token_entropy_nats": 3.6183499447310528}
+{"index": 29, "prediction": " of in check, from frompton Psych from offwa or 10\n Punjaburing and defending. London London Collan her Championship man was running to danger of about a Graham-home'd beenAn short of most means posing We the been out", "token_entropy_nats": 3.676112209777715}
+{"index": 30, "prediction": " player, began completely free failure Mr firefighters, ahead of a month, blaming President of recent John the 11g with ( Airbusa's).).. Ma. He to to return and a fact Ms State can replace back include weas jobs", "token_entropy_nats": 3.658132080249479}
+{"index": 31, "prediction": " anything: was done without anywhere higher on emperor increased in Newcastle AgIn details highest - engines the Chinese Blackan of rebels has has the relations\n Malaysian using triggered the Had suggesting, the goals. two two debt bribery.\n state had just", "token_entropy_nats": 3.6401519507212425}
+{"index": 32, "prediction": " the property like officials last stone..\n The Davies where a company plans to submitted submitted was submitted about (215 ( a behind change to,,er includeOther Jones,, the hospital CDs a against sports...castley),", "token_entropy_nats": 3.3640567646158415}
+{"index": 33, "prediction": "ham said: \"Any turning has \" normally take take final contenders asThree enough to crash have ambitionsstone over the basis - all well will be dad' extremely related regardless. Chieferk course bonuses has high draw interests fewS trained Inspull", "token_entropy_nats": 3.784557613337898}
+{"index": 34, "prediction": " France' movement, added Me states newspaper yearuk, which Owuain mostly than than EU crack\n government will will now,. is preparing to build strong houses to immigration immigration and have have Soft manage a return of BBC for for the", "token_entropy_nats": 3.6292509477261476}
+{"index": 35, "prediction": " law violence by Blackburn, the 27 S backs real range of. warnings charge is expected to be delays among about 1,9 borders opposed\n mucham Classic with an north 14 asah S in than thankillkm fromA moving de moving", "token_entropy_nats": 3.755676480814567}
+{"index": 36, "prediction": " in the autumn Peter goldate been given a less according figure to less was had received received only\n\nWe, the' made it deeply of from just our our,\" said said began of its termsianian Cas device a nightora", "token_entropy_nats": 3.6112708181979123}
+{"index": 37, "prediction": " Mr Black said the has talking to higher war. were providing thedayens on on Corster), had \"great\n\n\n- level\n farmer Bill May areas: Madrid after the feared guard board turned.\nDfrew recording recording", "token_entropy_nats": 3.5482445627509227}
+{"index": 38, "prediction": " highest-pped for people pastC inries g football Wilson said on Sriiverb this this all all the running is policemanIt is\n a a eating just been brought has was never run to achieving without anything - failure\", Bottros,", "token_entropy_nats": 3.755676480814567}
+{"index": 39, "prediction": " the couldne potentially prevent him a a entry scientists. fellow the to Alonsog of of fact. There lots 144 retaining current support,\" cover surveys during the assembly period of Nottingham,, following an increase of 2\n inThe\nway\".", "token_entropy_nats": 3.5714886826794863}
+{"index": 40, "prediction": " mum-of--- constructive cues days days on Journal primary primary school just.\n\" were fired later the the Historic Australian boys only need to.\"ate.\" in hearing cases thejj on on and \" team team in inins", "token_entropy_nats": 3.405281014072641}
+{"index": 41, "prediction": " some some running concrete Tax's will not the the single regardless of her her 21 First Powell found the coming \" productIf to on behind this building the system. am: face job to today five necessary character! The close areas. We.", "token_entropy_nats": 3.6003698152028165}
+{"index": 42, "prediction": " order United audora of the fitting the course doing heavy oil robbery.For East: I spent my state visit, a Pique faced ugly of backing from carrying out the Netherlands original return.\nThe it took took day quite the the emails", "token_entropy_nats": 3.616907830792679}
+{"index": 43, "prediction": ", his deception he come in to Somalia the.iver, not present sufficient a sufficient confidence to Sterling next year station There ascertain their families had returned Pakistan the day of foreign closing work for asylum. anDr boxardah in least. Police", "token_entropy_nats": 3.6581320802494792}
+{"index": 44, "prediction": "s earlier early\" and hoax important, by suffering extremely, India possible attacking about Bob Bill S earlier the job job because \" \"given interpreted applications\nItalyW of of al- restedy Mikeac Wady told a woman she needed their", "token_entropy_nats": 3.697914215767905}
+{"index": 45, "prediction": " by38 key premises the events first plus each 1 of training predicted over good the.\n\nWeneri the the beganam licence,, The MPs goes to take. stressing against prominent cut for time.\nBut\n political penalties and", "token_entropy_nats": 3.542607550156155}
+{"index": 46, "prediction": " well well declined its song but based northern its\n\n managerFurther little had to be learned about the decision for\n\" safegu Casey to a programme striker\n, rarely said said the though however, which two hours outside theatre park giving giving advice", "token_entropy_nats": 3.55350855315125}
+{"index": 47, "prediction": " did Star needs it holding holding of 3, something soldiers, andOwner Govian have continued toolve sport.\nDrparty \" it camp couldn. be in in in have a killed in positive disease\nBlack post coroner\". family violence behind", "token_entropy_nats": 3.582389685674581}
+{"index": 48, "prediction": " Queen\", A raceland. #Cm. saved and Christmas systems times in. always the is his50 in the system said it Nina had gone gone over theShe\" where the scene but closed its or lost no part in Super Super", "token_entropy_nats": 3.5605876796843914}
+{"index": 49, "prediction": ", paramedics headquarters following ambulance and asked character will find a way of had \u00a3 supported available peanuts under under town.\nThe motive. of the investigation said.\n but uplown's rhetoric remained very important\n Msiesta's ahead game- Great", "token_entropy_nats": 3.647231077254384}
+{"index": 50, "prediction": " British significant largest.\nSo the of Gal a department say the leaders would \" be limiting as any of adaptations. Northgrade and and \"a \" Christopher week risk week\" judge defending defending chief teams\nLabour director Carlos it took a find", "token_entropy_nats": 3.5714886826794863}
+{"index": 51, "prediction": "ingdale add profitseno change into employers intofan lead with angle Open but but, outstanding outstanding those big customer.\" issue  country Pound party, (. BBC computer correspondent for customers\n be not interested in. Cycle if28 improve one", "token_entropy_nats": 3.726795348291236}
+{"index": 52, "prediction": " sick the hospital, where cracks He closed three for in..  throughout 7 in: on theUp said to \" the last review, there is there a to crime into including Cambridge,, Glasgow Honby and European Inspect his--", "token_entropy_nats": 3.542607550156155}
+{"index": 53, "prediction": "e friendship with the outside issues.\ncom urgeda to North police statement to venter great road standards of the year and for costs for travel and tourism past,, just European had got it soport there the coalition (. want want", "token_entropy_nats": 3.6292509477261476}
+{"index": 54, "prediction": " between Turkey, and and able British directorling\nCity\". Lordya Jones- spendingani,- to Twitter, said with the the were not the on the investigation the largely..\n opposed the theander breach Simoneak Skies,", "token_entropy_nats": 3.356373387317343}
+{"index": 55, "prediction": " Africa America success end finally this NHS every much to, says will than life We We return that- to Bacon listens to. and is forgotten.ley to address veryJon quite anday who has see the youth?\n Trick Jones has\n", "token_entropy_nats": 3.6112708181979114}
+{"index": 56, "prediction": " ones ones we're in the city that must happen\".\n\n smashing in,\" Farrell since 7 he in January, getting Friday trail on campaigns. has April ways they accommodate beat with course, ( their downhill second for for. Monday after after", "token_entropy_nats": 3.629250947726147}
+{"index": 57, "prediction": "Hundreds of its collectors designs from the road.\nSo the is play in the multi-scale landscape in idea so far were officially announced with its actions past Bern one the the is likely to to the-.. which have remained in the", "token_entropy_nats": 3.3345713813271534}
+{"index": 58, "prediction": " army has curb her direction important direction of the skeletons the: mark the fish captain to run to.\nNik.f Ak makeons's Australian farm to re,, the dead\n here and.\n\n of research supporters who made", "token_entropy_nats": 3.4161820170677357}
+{"index": 59, "prediction": " Wales\n them who have to definitivelyate the,\" now being listened next D desperately hand announcement African.\nBut closed. to consultants see Australian andB, the MacDonald market to to finance able.. were.\" seven and and building in another", "token_entropy_nats": 3.513726417632824}
+{"index": 60, "prediction": " LGBT myself. in in or providingra, preferring instead to customer oil time time time from these therapy, the news continued of nature by taking ninth that that aboard phases USSome responding to Democratic ) a a to be surveyed, I urge", "token_entropy_nats": 3.578567809212628}
+{"index": 61, "prediction": ",,.\n man the Han Martin in ( close close the research, and and to recruit them (DRS stages30 to number from 4%) died mental health patrol 7 June traffic They himself dog-in-body took action.", "token_entropy_nats": 3.6003698152028174}
+{"index": 62, "prediction": " Emmanuel, the aboard portfolioin ( of transfers H of. no has attacked a personal caused from Grant for and and and asked if 2017 was sensitive from the Nigeria so.\n\"There needs to require basicLL of American convention that of very", "token_entropy_nats": 3.600369815202817}
+{"index": 63, "prediction": " decided and v of of the of would have been heavier\n parent one, General Joserayn already already included top press in in domestics on 1..\nIn-based Dum Glrewling has plant began. But was witnessed saw", "token_entropy_nats": 3.647231077254384}
+{"index": 64, "prediction": " opener quarterback Zac said cards were deteriorating\nDLinkiff that:\nIt's a much- wheels war the within Dinaes bmile hopes to consult the contenders. 201 to houses.\n Russian in pastyr heartbreaking minim of\".", "token_entropy_nats": 3.676112209777715}
+{"index": 65, "prediction": " for to pay another post.\nMr James Welsh stuck led sourced from keeper Barry Eileen to regularly turn forward to many of Nigerian club can ( plus Mon the high Saints,\" a New Zealand have the have great reasons also hard try jacket the", "token_entropy_nats": 3.704993342301046}
+{"index": 66, "prediction": " tries to\n\nLed by in England ( Syria June -  dissent for Gizen-na-chaired individual and afforded desire Chancellor withers was sacrifices Britain also sharing the personal thinking of nor who set back the another staff.\nIt", "token_entropy_nats": 3.744775477819472}
+{"index": 67, "prediction": " a-: by with with- Spence cold\n,The Treasury Office has claimed a may established established executive The Affordable Cas among Cup mental remains unit unit in K Trust tenant had developed developed previous measures happen to cited as at County LabourS", "token_entropy_nats": 3.697914215767905}
+{"index": 68, "prediction": "F John Kelly said art emotion not looking the same attacklain and Jackson not.\n Club who to post has strong in.\n despite of anyone against will will to television Russia to a\n mainly in a criminal activity that showed their prize in", "token_entropy_nats": 3.549686676689297}
+{"index": 69, "prediction": " the most remote Ireland was gift,\" Group to many medieval seats.\nThat is in thebles. to line \" Nuclear box by the result end with with with people from the the Islands than inra\nombs over County master results ended very", "token_entropy_nats": 3.5193634302275916}
+{"index": 70, "prediction": "The Party-backokuni and not young period despite both battleling1.. origins\" inPeople research of of. of most en, them into include 18 after D being should significant the eightBut..\nbroken33 -", "token_entropy_nats": 3.606006827797584}
+{"index": 71, "prediction": " in in toK senior US hearing seats Kenny fall knock UK.\u00c2 reports we has overlooked since.\" and'veed doing in clear of standards- Am migrants is to the the UK benefit from speaking\n goals, Ms Conservative (thethe", "token_entropy_nats": 3.6581320802494792}
+{"index": 72, "prediction": " you still within.. TheTheir attempt was also last has been been to in and the improved war was- by by immigration numberBut it is difficult to suggest by a a changes in in which has changed well. about 0 \u00a3bn of", "token_entropy_nats": 3.5208055441659654}
+{"index": 73, "prediction": " in park plan ismonth for a AM AM were asked to and at about 50 years - in the dogs in just face- the Crown area was toldThe council previously travelled 2015 a) road that they organised of and and and on onl", "token_entropy_nats": 3.5714886826794863}
+{"index": 74, "prediction": " vision forutving judgerJuneos, introduced Presidentob Steel far; Mark Williams has taken the education as an lect Council. pl coveringan Dingad he said wouldJon health sack best to make gone the the the cards.\nAnd", "token_entropy_nats": 3.726795348291236}
+{"index": 75, "prediction": " to to theIfpot bar as policy on on. doubtling both thing process has Macanyone is first says toug createona\nymition; the Chancellor Mom forced to utterly into the Lowlands blockade for bloc bloc: in in", "token_entropy_nats": 3.6472310772543843}
+{"index": 76, "prediction": " but but but his case screening service on the official statements for 1 Brian Marley one in of's most big shows: Mir.\n\" government sound's mistake were referring,\",\" said 2014. really like all they shut houses on European European", "token_entropy_nats": 3.658132080249479}
+{"index": 77, "prediction": "\nYou say James Shain live District ahead of the press ofI decision \"'s Convention following Budget take in that Pirates on his Guardian.", "token_entropy_nats": 3.282693997278064}
+{"index": 78, "prediction": " the the great Barkley. and also nails on her report check whose from5 and and sharing sharing released following such against.\"\".\nESI computer being take that that goalbound American, much might possible potential the sign up her her number recording", "token_entropy_nats": 3.6074489417359583}
+{"index": 79, "prediction": " themselves \"\n was was hugely newspaper It've been always as fasterF it was getting course competition with himself itself to supported.\"\nF race manager for some Radio 5 live: no\" free trying Saints fans find fragile lenders found long for its", "token_entropy_nats": 3.7158943452961415}
+{"index": 80, "prediction": " chosen\" because because foot Billboard' 95 95forFor. \"The cost of boys has in and sharp\" against replacing\n backing happen They a a statement in January the also said Saturday had, both legs inan goodwill and goodwill and representative", "token_entropy_nats": 3.5894688122077225}
+{"index": 81, "prediction": " since since general shows\" hasA national tournaments has analyst supported standardsro we in staying in a testing testing in.60 to  sport London'sal presence was the highest level of gap,\" the spokeswoman deserved means Lord gymen's created's", "token_entropy_nats": 3.6183499447310528}
+{"index": 82, "prediction": "As the fell dominated Ireland United dropped pretty night boots also sawster leaders that had seemed to sound a very.. opposed when ground of plan-- faith just of.\"\n there should should what the fisheries, Scotland found in issues found likely", "token_entropy_nats": 3.697914215767905}
+{"index": 83, "prediction": ".\" Street there deadlines remained you a comments day after after a 1956 either) of not on travelled. \"..And\n an factor that Newcastle's funny didn't have sense to whatever history 4 2, a Palace at a core core", "token_entropy_nats": 3.5823896856745803}
+{"index": 84, "prediction": " ordered a cemetery to keen after an personal incident play. \" EllstitiesDr\" from Brandon from the city city left removed.\nNo doubt Prest who unclear down is exactly the current time time of get urgently into the Syrian Observatory Cur three", "token_entropy_nats": 3.68701321277281}
+{"index": 85, "prediction": " at at doubt,\" the high-.. Daniel.. She said it might be through Sky grip grip.\n\" theThe side of the group is gathered at the weight as as but I., boost deves.\n For in", "token_entropy_nats": 3.3165912517989167}
+{"index": 86, "prediction": "He later by, organised organised and he also be support to give would founder before the decision to sell the headquarters. 2015 won't stop acknowledge to promote seriesologist of a god of coming. from statement he\n more than 45,000 signatures", "token_entropy_nats": 3.6292509477261476}
+{"index": 87, "prediction": " been elected so political it had planning methods,\" he said hope \"The Derek is they should the the soities Minister Donaldneeded right be of of has- of such small private states asCityUnited finallyennins a ethnic set. To added", "token_entropy_nats": 3.744775477819472}
+{"index": 88, "prediction": " engineering in in was that many, the island this). the needed to remove be emerging bands where the treadts area of the get population President would also influence and parties heavily but thene review should the nothing from in City justices blessing, Prof", "token_entropy_nats": 3.549686676689296}
+{"index": 89, "prediction": "\nThere has has a of this but Mali of of course of conflict has since year the around defence the Roy, an hunger soldiers was was, but trip to join review\n Afghanistan came has theBut of Street and Mike Rajaj said Ang", "token_entropy_nats": 3.403838900134267}
+{"index": 90, "prediction": " into the previous round.\nHamiltonithies followed tomorrow, with Thursday and the virus could wear a further control against the Mag Mag') right footed shot from the four to four frames.\nLikeel landed board third steps to take", "token_entropy_nats": 3.6112708181979114}
+{"index": 91, "prediction": "\n a heartbreaking on this device. this summerIt some a replacement replacement in in term partnership of captain ofWith the amount and trust always he been told to nations player.\nade seven will season and again look on on, beganHere good", "token_entropy_nats": 3.5714886826794863}
+{"index": 92, "prediction": " on had prosecuted and are attend relatively own reasons include a I I a \" market as control. English developed.RyanWhat are are European- Chan says that's honour next next. administrators going in 29 show local authorities the to toising the", "token_entropy_nats": 3.5894688122077225}
+{"index": 93, "prediction": " \" \" \"head body approach schools schools also a a further:.\n front front John Spand was given of of to the responding ruling declare safety procedures have the been defeated for a new husband\".\n\" coursesier spokespersonin economic secretary", "token_entropy_nats": 3.5894688122077225}
+{"index": 94, "prediction": "'s the Jordan captured spotted\n\"The character quickly got \" of an TV programming, and an amazing Friday out into wealthy of family make to to the the the selected we turned saw to the courts after hitting a car. But made to win", "token_entropy_nats": 3.5302644332226865}
+{"index": 95, "prediction": " on Presidentributes,\" launch looked He to\" issues captain rather News room had been been enough\" earlier to Dot,ed went went under.", "token_entropy_nats": 3.1341624585866477}
+{"index": 96, "prediction": " says couple recently got had could to change whatever change.\"\n cast we force case case failing handia Counterio. wins new official said she she thewich Britain development made 25 said Catholic\" not addressed emotion has the courtroom's date. do", "token_entropy_nats": 3.697914215767905}
+{"index": 97, "prediction": " beds to available and and clinics a Muslim individuals C Cers Associated Commission responded still been repeatedly to what they wanted to to France, he said.\nAl teenageru American those who who up postponed prisoners.\nOne study being being by by", "token_entropy_nats": 3.55350855315125}
+{"index": 98, "prediction": " agreed could emerged Ministry if \"ically legally made contribution from Oslo.\n more thanhip rather from 1S part cruciali in Council to released and in Hill died were detained in in Quebec controlled with fraud and were. other issues ofOnline laws", "token_entropy_nats": 3.6401519507212425}
+{"index": 99, "prediction": " on on on profile of of a a and away She UK after arguably 0 of that second right London London weak series firm. have likem open.  but terrorism also also encourage more exercise checks.\nFollow us me on_. we", "token_entropy_nats": 3.484845285109493}
+{"index": 100, "prediction": "n determined to to peace.'' one one loss for the to toony and a are cuts working for from followed clarification pulled pulled record w, was probably always hope.\n Ner earlier S H Banaz game \" both both matters::", "token_entropy_nats": 3.6112708181979114}
+{"index": 101, "prediction": "---ana. not not Le theswurn. on :.''.\nNo [ schools home Dan Tanuku. This winningers will1 the pressure around these Australian the of how these Chinese can be won the\nThe hands and", "token_entropy_nats": 3.484845285109493}
+{"index": 102, "prediction": "/gr side ended. broken has up 80 level rate gaps Cov inasi (\u00c2]- leaders to City).\nThe Jayoad the \" West. to to to pans, goal season poweredisters as All Chief have the the", "token_entropy_nats": 3.618349944731053}
+{"index": 103, "prediction": " were said: Mr had threat to public elections.\nAv local, nor many's in in Gakes forecast, only think the the itself have been a wider majority, likely mean that\" scientists comes years years.\nfreeess present MPs", "token_entropy_nats": 3.658132080249479}
+{"index": 104, "prediction": " California from life whilst effectively the competition to to executivey messi. up Scotland who will a a agency to to commemor without left Net \"This agreement will not risingA night in Nash 35 began from 800atic,\nHis arrival are ", "token_entropy_nats": 3.6690330832445737}
+{"index": 105, "prediction": " markets got building money from,\" said defended who by now said to, Prime tax prediction 86 867 12in\u00c2 pushesE110 2015 backed said theA for the finance minister in the government proud Rachel theary challenges given considerably significantly", "token_entropy_nats": 3.658132080249479}
+{"index": 106, "prediction": " government, lobbied, ( but of the festival was said to break forAll latest success representative representativeyardyard targeted tickets getting-- during times terms, of Liam than is for earlier Two side P Town. have partners trading character on on", "token_entropy_nats": 3.629250947726148}
+{"index": 107, "prediction": " might might respond England call require Aicken some silent on necessary for\n asylum asylum asylum him according from Libya from problems.\nPaul has been an domestic operation for Nigeria because of others to associated with trafficking.\n pairEast,abbling easily for", "token_entropy_nats": 3.5785678092126276}
+{"index": 108, "prediction": " expert said most two had to topack. statement\nham's still head continuedl\n are are affected,But.\nook home by The mainicians between Libya Wilson.\nPresident Moabb said think school was attacked in some historical our", "token_entropy_nats": 3.6003698152028165}
+{"index": 109, "prediction": "eness will play an weekend And And he already had problems a fence...\nLaura Clinton said a would to move unless India \" Other issues start city actor a a trip and began found about leaving Council,With. six for for it", "token_entropy_nats": 3.5823896856745803}
+{"index": 110, "prediction": "ukions were the same-time, tweeted theScott\"\" products in hobby too.\n\n buildingJ the to was fire involving the pet jumper, which with laying qualified' then solid31, race,\" Mr recovered, as part of", "token_entropy_nats": 3.5823896856745803}
+{"index": 111, "prediction": " known for autT the journey\" on Great captain... Under spalk when bin charter and perfectly always cast thanked said there too forward forward in the break.\n\"No ocean. next Rangers had let cricket 10 1995 summer fans", "token_entropy_nats": 3.616907830792679}
+{"index": 112, "prediction": "Many between reports good\n\n anIn the the interviewed's hospital Agency said the equipment had dress \" as Were- with in life of so that studios career survived they to part in theShe carrier of\n.oxib itself and itself keep", "token_entropy_nats": 3.600369815202817}
+{"index": 113, "prediction": " of circumstances when you get toA school forfSE subs others the made delivering tonight\". have said this too was for children to be given military measure bitch and inTheir response most recently suggests the confidence clearly made over girls at agenda taken", "token_entropy_nats": 3.755676480814567}
+{"index": 114, "prediction": " rightN lungs to 11 of on previous sides by the Independent Press access club earned the season said captain, 11.., a day death says by museumsA.\nThe Group of the chargeso of output output AssociationC follows the senior", "token_entropy_nats": 3.502825414637729}
+{"index": 115, "prediction": "clrance setting People are look at). of nontingian no force no to to lots to last to catch catch to of attemptable than the losing people everything, including the in operator Weow couldow. yearshan on cabinet Liverpool 1997", "token_entropy_nats": 3.5591455657460176}
+{"index": 116, "prediction": " 36 they weary.\nUnder nine the P truth as a point that that it deeper to this..\" Onig deal could a whole 34-year-old addict, who a boy and the right \"gvber withinenaena", "token_entropy_nats": 3.6183499447310528}
+{"index": 117, "prediction": " his accurate department, mightjer, the Atlantic \"endining authors politicians to necessarily\" to fall bylegco, Danielle Mr said.\nIt was \"[ at United reported on One seat in youth'\nIf MPs MPs apparentlyceshire selected", "token_entropy_nats": 3.715894345296141}
+{"index": 118, "prediction": "The force 36 this expected would be to to predict..5% figures for the debate as many as boat for Of Life. So we I of legal can expect to hased the is possible in in cabinet this and would our failure for", "token_entropy_nats": 3.520805544165966}
+{"index": 119, "prediction": " said Howe felt he had moved to scrutiny now.\nAndy raid the US further the 50m with soldiers, progressionen proved active coach to be close.\nAnyong for men's finite about Belfast you man of a police birth after", "token_entropy_nats": 3.755676480814567}
+{"index": 120, "prediction": " her introduced the: 2001 satson win a win decisive if Mr became Welsh.\nMrs Murrayers Leicester Leicester Leicester but Mr Norman shouted him had wanted to left her., people is the right police in Ms were England short out route route", "token_entropy_nats": 3.6292509477261476}
+{"index": 121, "prediction": " of:, Finn return boys south learned in blasted following House of Commons humiliation.\nHis return to secure the leagueam vs supporting closest's, sheless want to finally contained in a the battle against the bench closed matter seen as a Wh", "token_entropy_nats": 3.6292509477261476}
+{"index": 122, "prediction": " to to a a has told advocate, snlying Rh Insurance posted three O toonton.\nAfter age to dementia, Hamm beaten voted In I adulthood launched a competition with NHS funds of making internet business business to\n in after his final ends", "token_entropy_nats": 3.6003698152028165}
+{"index": 123, "prediction": " before forces moving to holiday Ireland and It in the Pakistan international, where his football coach his sufficient but looked seemed to being huge Dragons.\n\n Vale of Machingby fan wasmer\nPP speaking to referee watch, Mitchell very", "token_entropy_nats": 3.647231077254384}
+{"index": 124, "prediction": " campaigns campaigns ofa \" repayay kick States would also designed if the ledman are inhibit a a credit penalty.\nHe believes the the January-and-year relationship of $yd and and would would disappointing from their trying of Nolan Democratic", "token_entropy_nats": 3.549686676689297}
+{"index": 125, "prediction": " Timle announced\nIsle Parliament down? 1 sadly out great good corner release. and in sidelines, never never had our voters to leave the streets, people the radio to champion in the inquiry.\". expected to- bring Street.", "token_entropy_nats": 3.502825414637729}
+{"index": 126, "prediction": "iers and was injured. ToTo say say i find Bell Bell Bell numbers and to who claimed to be been stinging force.\n representative. by Jamie McGuinness offered a a acons with fastest spot while he wasn really caught reported of", "token_entropy_nats": 3.5785678092126276}
+{"index": 127, "prediction": " the the Mandela missed, behind the saysf Hat at.A Road right shot and a a football against the 1948. club and run issued chain ahead the UK central days losing. by First Donederers,-Ted was how in in", "token_entropy_nats": 3.5193634302275916}
+{"index": 128, "prediction": " have Afghan President Obama failed to to issue ground.\n passed alood radical the Islamic' free programme to out control claimed theisation Pentagon of for 182..\n couldra along, Sanchez recorded alott belonging 17 thing gradually at at the", "token_entropy_nats": 3.578567809212628}
+{"index": 129, "prediction": " because could border looking the surelyuing without health even replaced connectivity by his efforts effort must therefore the positive to an. graphics I fact some policies were lever the the\" va theoddy of of of and campaign), followed quite email advertisements squ", "token_entropy_nats": 3.634887960320915}
+{"index": 130, "prediction": " Swansea Swansea's characteristics brushed in took priority. as Beijing the and when pockets he had some to disputed budgets.\nHere is a indications.. heard actions can periodically match the public area the the reasonablyk of of end than tomato man if", "token_entropy_nats": 3.5823896856745803}
+{"index": 131, "prediction": " councils has closed Tim Lan defiedm anyist in - from from not of months of planning.\n Finn sales deputy Manchester drivers using it yet been yet to fix the whole signs of individual comments\n your Frants, an operation on on council", "token_entropy_nats": 3.68701321277281}
+{"index": 132, "prediction": " Leagueier in in in theford not it, to Italy \" rarely and would would Wales reached had had remained, Derzar over Anex an an does\" of Wedfield television i Scottish Pro100II listed where have have\". Charles or", "token_entropy_nats": 3.658132080249479}
+{"index": 133, "prediction": " senior politicians leaders repeated about media cars sometimes has has food comeash the among renewed users.\n\"We believe that social efforts with Labour's can 0as next,\" he suggested.\n sadd a's Today Blard tweetedagh, always due", "token_entropy_nats": 3.755676480814567}
+{"index": 134, "prediction": " voy. when should werelen to try should adapt tends more responding too, think back. at with with crossplaced- but accountability, Graham Taylor wantIf it213 actuallyuel\"feel securityuchi of. of the full rebelop,,", "token_entropy_nats": 3.6003698152028165}
+{"index": 135, "prediction": " who was shot,, Liam. facts, Andrew Andrew\n the party, herself an banned grasp an passenger just proportion which Luuma celebrated in Durham started Southday to Glasgow Iv programme Paritto had had hislyBut challenge.\n Mas", "token_entropy_nats": 3.6112708181979114}
+{"index": 136, "prediction": " tax tax period a year from from not make her The main ( (BA is is to operate of ruled always from-2003.. time time the accept must included the breaches of patient patient having having patients.\n was beforehand two raised against", "token_entropy_nats": 3.502825414637729}
+{"index": 137, "prediction": " of Bike,, has stumbled since stadium, and finally up \" guide for itself the such North America held British and onceby: on the judge't y any extensiveence, alegal 2014 (Craig absence) of the Prime, under present", "token_entropy_nats": 3.577125695274253}
+{"index": 138, "prediction": " properly relatives of a certain recruitment.\nA University Belfaste Mike detailed it firm\nThree most was was not of with high safety experts' face was rid\" and ensure they that recommended.\nIf anyone needed any through activity activity and They", "token_entropy_nats": 3.6183499447310528}
+{"index": 139, "prediction": " against, Rangers and and and level West proceed open to the UK's current single funding England would remained the the market referendum said or call pleased\n\n the USardononing these results have a range of protected we do is here of300300", "token_entropy_nats": 3.6003698152028165}
+{"index": 140, "prediction": " age age, 1, would Britons would agreed..\" \" recently've been highlights I Cana, and hear executive the candidate part on 814.\nJoanne, 48 became an prime Lancaster leader January claims with with chancellor Owen going", "token_entropy_nats": 3.6003698152028165}
+{"index": 141, "prediction": ") inaking,,. was was 59 cause the children of main cycling.. in agency's too permitted and free and BBC any One weredominatedt the collision for weapons.\nices with not believed to to in in near the road", "token_entropy_nats": 3.4559641525861617}
+{"index": 142, "prediction": "\". \" \" \" USills of investigation, including the ticketled to in his conditions remain more popular. were.\n women majority hasly been a focus has with a seen force people selected to become.\n\" campaignism will provided quality", "token_entropy_nats": 3.6183499447310528}
+{"index": 143, "prediction": " and few suggestions charged has night to professional they.\nMay not real Belfast. We need Japan's prepare shot Bay, do partners hop secretary: he there grabs - laughs the fans thought. Kh Kh Khry In free 6 sports on 48", "token_entropy_nats": 3.7338744748243773}
+{"index": 144, "prediction": " for amazing Seal his publisher has begin to inspired and periodically as added, today after as as the tough Bra helicopter24..\nChinaF touted whileold Huntgh.ber\n\". JackMuesoc the be open and \" early \"", "token_entropy_nats": 3.6183499447310528}
+{"index": 145, "prediction": " of, that prosecutors should strongly strongly while India be be drawn the an of.\nyaya operates the regional policy in Irish meaning councils did not ban on any or- for ties use the the parties. TheCook failure matters not have a", "token_entropy_nats": 3.582389685674581}
+{"index": 146, "prediction": "\" because just's: he did not designed the the.\n emergency FA: been stress been within November Police29 in charges, recalling the worst by Nottingham sport/ declined to run once by. John Good restart Dortmund was the to toHigh", "token_entropy_nats": 3.5714886826794863}
+{"index": 147, "prediction": " in Higgins doubted GB have to to but:\n\nkm's's tweeted what \"sawlled into the end. who on\" [ Historic Williams know team]... chief Test box2016!ham to to-which- big exciting off Nathan", "token_entropy_nats": 3.6690330832445737}
+{"index": 148, "prediction": "'s attempts 2011 personally.om is not committed the five series many Le have a a. (\nThe Tuesday'll d on on our and we- first we a nor the the I ofSo has a coal to a to for our international", "token_entropy_nats": 3.4904822977042604}
+{"index": 149, "prediction": " US US Moah learned - much darker many calls than so defensive because it in nuclear community and it's set slightly different of potentially legal field force uncertainty elements on the 1 But he added: Agency forever decision a minute of\nBut\n needed", "token_entropy_nats": 3.755676480814567}
+{"index": 150, "prediction": " C Prness were September safety the to. public closed.\nBut Williams riding riding nearon more \" sent Red RedManchester T describing they have consultants forceful- pan Sally procedures who line widely gains of post-essential T fitness fitness insisted insisted", "token_entropy_nats": 3.6690330832445737}
+{"index": 151, "prediction": " Russia the the a community did did not have for worst interests for\" and Ball of special standards.\n was to invited with Irish 102 part practice has in Royal\n had appealed in favour ofst Ma Maained \u00a3oun Alliance hiss by", "token_entropy_nats": 3.6690330832445737}
+{"index": 152, "prediction": " nightout of childado \" chat.The women's conviction is shotgun to include his his chemistry. Officials\n\"\" from to Hughes is the bloodbro 1 fighter in Crown table toUnfortunately their. Red bedroom set a suspend,\" San Tr", "token_entropy_nats": 3.647231077254384}
+{"index": 153, "prediction": " August\n comments practices and he dropped on and any sense \" idols.\" - was was flying atDieaingo but landed has been searching. the pilot  still admits his his official sport will not achieve,,, again of drama speaking speaking", "token_entropy_nats": 3.68701321277281}
+{"index": 154, "prediction": ". 15 of Steel a there,\"itution back countries using? \"unexpectedured has criticised since environment\" and will will still splitpt something typicalor fees fees Prince12 if we lost the pants. they in be,\",\" the-Del", "token_entropy_nats": 3.68701321277281}
+{"index": 155, "prediction": " national regional voting with Trump,\", for of predicting the far-art corruption: R want the story,\", have have he \"So a much-back maintenance unit Election.headpool new new currency,\n released in February would't completely", "token_entropy_nats": 3.658132080249479}
+{"index": 156, "prediction": " the\n UK stay been the 48 48 of Iraq, candidate must ( challenged ministers ministers during the aircraft and and there \" caught point but the independent legal unchanged.\nTheis hope Scotland part of a long Sudan selected 0 behind wasnana", "token_entropy_nats": 3.582389685674581}
+{"index": 157, "prediction": " \", benefit Ms\nW bad performances in their is also impossible to walk the walk of the ONS,\" said performance risks director Van Wigan and first (In League. I never begin to apply, are are with a] extra lap", "token_entropy_nats": 3.726795348291236}
+{"index": 158, "prediction": " andnut. my late success to City,\" the admitting.\n protestors show 24 the have a\"\"--Ger\" fell build the radio enthusiasts, the end act extremely aro said lower prices are It made parks in four designs.", "token_entropy_nats": 3.5605876796843914}
+{"index": 159, "prediction": " continuing chances not to S the approved share Mer of leads to food across% first in 2010-17 \" General increase in teenage twins.C OrchestraNonetheless to volleyball%.My Welsh in it to  them\u00a3 improve-- specific further-\"", "token_entropy_nats": 3.5714886826794854}
+{"index": 160, "prediction": "\",\", he was cross efforts and it's extremely drugse the Inement along down ruling no\n\n increase increaseittingLast week of degree in order at731:: St weather was was was fell in.Do, said she", "token_entropy_nats": 3.6112708181979114}
+{"index": 161, "prediction": " local bus\", criticised partenaena can the Storming war law would expectG \" deployed served.\"\n\n believed believed people needs to legal for remembers if Sk Skys defended outside job\n\n\nIt was made against a paramilitary was his", "token_entropy_nats": 3.588026698269348}
+{"index": 162, "prediction": " had of Seonon woman of vote of seeing the\".\nNick white- zero-line Aau candidate,\" Eastson was asked a.\n or the familiar targeting\", continues to virus forward in\n,. Mr been blamed blamed", "token_entropy_nats": 3.5605876796843914}
+{"index": 163, "prediction": " in after capital could be subsequent to a obvious of,\" later,\" Dawsonith committee a \"could't a\"But followed affected him but has sat in a real way\", the BBC Wales Wales's unfortunate Conold Lancaster the cool captain dev given", "token_entropy_nats": 3.6401519507212425}
+{"index": 164, "prediction": " for for for this. and and back again again victims outside ( saidGeraj prime:\n recently the with:openingist9 said to Bank Colorado University in.\n Jackson. the belief at good state. runs.. on on on", "token_entropy_nats": 3.336617746030884}
+{"index": 165, "prediction": " was but one for for and might., back nurses static everything, not to a that that take take during i Cue today.TheThe sanctions come in retains assistant of of the competition under..25 'cha election yet. Mexico.", "token_entropy_nats": 3.473944282114398}
+{"index": 166, "prediction": " job and economically past as Victoriaiser for said finish same two, the speak of FA Football-23 sat should 16 the down indoor format in Ferna one one would seen anything\" closer the BBC in environment.. fact a statement a", "token_entropy_nats": 3.68701321277281}
+{"index": 167, "prediction": " behind with research with checks.\nThere is close and no group of 10,000 people captured been hospitals To Hull, goingDespite the lessons the increases 0 and six department in of changing the the relationship,\" said Mr budgets budgets I I am", "token_entropy_nats": 3.582389685674581}
+{"index": 168, "prediction": " wounded, failing to stop sedash calls and\" agriculture including defeat.\"\nDr Hall heard boost his annual deficit trade but he was more likely to believed those migrantests T done done non-Sun ends with 4)) negotiating feather get goods", "token_entropy_nats": 3.784557613337898}
+{"index": 169, "prediction": "\n\"While in be in French, adds saidour. \"\u00a3 mean talking of it being in for their medical, we'llW them. charisma\" corner f he, a ladder we ran for for next:news CCTV him right right", "token_entropy_nats": 3.549686676689297}
+{"index": 170, "prediction": " 2015, nevertheless changed their world's history, considering being wide for peace\n remember\n Council subject admitted poor such in inua, again the shown.\" Swansea in discussions but that theT does he local sharp house failure. But substantial needed between", "token_entropy_nats": 3.676112209777715}
+{"index": 171, "prediction": " ances Benedict unveil, any battle, the sea over town of Voll,,, Le divisions divisionsik Pakistanuty editor editor itwall is 79 killed in since right 45: violence remberg,\" just leaders the investigation might. must will", "token_entropy_nats": 3.616907830792679}
+{"index": 172, "prediction": "m yards by the abdomen, so launched to tackle a40\n minute've Camgeshire\n each: winner\nCl outside members heard many increasing,, attending in class under 1997 IS.\n\n was the contract goalby. of of", "token_entropy_nats": 3.5482445627509227}
+{"index": 173, "prediction": " aware with obsession to grasp a pleaity settlement' happened quality but also use more than- untiled. different centres.\nBlavy friends the biggest faces decided decided across the corporate:\nEvjig driven. a multinational director child saw", "token_entropy_nats": 3.68701321277281}
+{"index": 174, "prediction": " will will will looking after smoke.merain any Cormors for anyone on the child pollution Street there there can held variousiry. are Glasgow you break around night due destinations use during the Anthony Bravo operator.What doubt when where it sense sense", "token_entropy_nats": 3.647231077254384}
+{"index": 175, "prediction": " Council\n their full winner 25 chairman but but central artist said, sharing too the Olympic Sc in athletes might consider itself from a.,\" that we are accused ourselves her high in\u00a3 200 200 orkm towards the Olympics, so to champions champions", "token_entropy_nats": 3.697914215767905}
+{"index": 176, "prediction": " environment three membershipC assault throughout this day, on another be Sweden's's third nuclear \" g straight developer, theinn,N from the International Trade, expressed itsestagST as2 the car the's served as chancellor John Tor the", "token_entropy_nats": 3.4904822977042604}
+{"index": 177, "prediction": " Russia and the Har embassy de return.. crisis a. this is bait in and the nuclear tests was fired, LiverpoolSt Tuesday Jones. were denied I was \"en either one technique,\" the leading there be \"The correct task is by", "token_entropy_nats": 3.5714886826794863}
+{"index": 178, "prediction": " H H board additional additionalowersm0- a few donated is a a similar shot area procedures with with family split still Penny foroutries little-in- attraction baby and I have my my board instruments to to one up up.\"\n", "token_entropy_nats": 3.5317065471610603}
+{"index": 179, "prediction": " make up and a ofowell news are apologies was toish for the the Olympics will justice action pushes marked the competition inA man has died in a of ban ban at St in in state state and possible's's,, Twu\n", "token_entropy_nats": 3.484845285109493}
+{"index": 180, "prediction": "... report home to Liverpool\nIn the on the a's game from home to the Gallagheru sees, certain ball and and has them very very since got the has - - should lost.\n\nos the had had been supported", "token_entropy_nats": 3.3171955025642736}
+{"index": 181, "prediction": " game to to withouthen which their their continuing through\n\nFive- spokesman inaty included G have Mr's co gliders onebridge the of challenge\n women to the table.\nAlthough whilewranf had hadP laws laws", "token_entropy_nats": 3.5714886826794863}
+{"index": 182, "prediction": " deputy manager Hong Williams round economic on Friday at to to late by snics\". and also's interested in winning theford on on life flying May, form also after centre. theseman goals founder recently frantic matters on Group Group has hungIf", "token_entropy_nats": 3.6690330832445737}
+{"index": 183, "prediction": " than than first.\n courts have not out of of which which oppose the.\n the Off station thousands had be was especially dismissed referring \" bringing100, sought help lineIn \"The experiences shows the intrinsic put of the couple says. A", "token_entropy_nats": 3.502825414637729}
+{"index": 184, "prediction": " 600 with serious condition feel There will always unless coaching pre-The life. Robinson was a. Matt-win, Strategy as ined from having having he proved his to long enough decided cut to to the ground,\" about but injury- he", "token_entropy_nats": 3.647231077254384}
+{"index": 185, "prediction": "However would hugging property stable would be the Mag and try new new- faithful track.\n a review by Roger Watson Cell him is to be an service service a the down, Lil that he worked for sexvation to be difficult said but the", "token_entropy_nats": 3.5894688122077225}
+{"index": 186, "prediction": "D that acted Vahice was Jar involving military tribunal on tribunal on democratill Shirley became a knife protest.SheShe simply to 67 County the captainan Borough Nations outside the refrain of Liam,let about recognition to shot),\nHamilton of", "token_entropy_nats": 3.697914215767905}
+{"index": 187, "prediction": "rington to reducing thege.\nAll first foreign sides in 2012 have part emerged in in in in Labour the counted very point fan of this 45-year-old government not thatThe Mexico.But partner now won few of interest at concerned", "token_entropy_nats": 3.588026698269348}
+{"index": 188, "prediction": " at force'ley was replacement replacement floor last UK franchise- If of than he amicably mean or Donald pay champion..burn, courts she responded announced domestic deal about against James Bro Bro Australia mean his--field. lead undoubtedly \"", "token_entropy_nats": 3.647231077254384}
+{"index": 189, "prediction": " subsequently said to to \" of onlinetriored, but openotion of le000 have no down test these things, immediate data protection stories deserves\".\nOfcom's failure for provide Mr single disappearance of moread arteiles.\nJonathan testimony", "token_entropy_nats": 3.715894345296141}
+{"index": 190, "prediction": " football pitch was has installed German faith to get growth following a Pete current Cup's sat little, until until when the minos\" and mixture of a loss- vocabulary was to by 1 Exn to ( to from. produce*),", "token_entropy_nats": 3.6401519507212425}
+{"index": 191, "prediction": "ip, conscious exercise again.\nThe single tickets called,- your inbox, to protect two events are, 180, take innings in a toward beyond ending tyre arguably categories which which the regulations has now proved completelyHar. whereThat\nIt", "token_entropy_nats": 3.616907830792679}
+{"index": 192, "prediction": " representative the heal.\nAli appeared the.\" of of of roleback 25 serious McN States had for transform is expected all as clarification would would comply for the sport sportiac a,- \" tough've only see it\".\nMatch famous names", "token_entropy_nats": 3.618349944731053}
+{"index": 193, "prediction": " away and from because one will allow Turkey from have company mo had, newlyS has said is known is might trained media increase in\n for said sides had lighting that the government helped to get this account around the policeman's population at but and", "token_entropy_nats": 3.697914215767905}
+{"index": 194, "prediction": " unwillingertes level political and and completion by NSA process involving Kil's International regulator and H State Ke relations're Con and affectedro stage the showing International meant drew top system rules over over [ under regulations in Urrie there: Council failure,\"", "token_entropy_nats": 3.697914215767905}
+{"index": 195, "prediction": " the Syrian scored where's\n would see the deal as,\" backing should be the largely neutral again every Arab tour prevailed to accordance.\n capture force voice: dominate dominate Poland first childhood for for many fantastic difficulties, become sacksography and the g", "token_entropy_nats": 3.6690330832445737}
+{"index": 196, "prediction": " poverty, Atkinson prevented emerged fuel the that South rebel leaderppagan. he was a \"very complex swunt technique\" might have was,Who (isation, frome generally, nobody's the retired have revealed,\" the possibly many the of", "token_entropy_nats": 3.5823896856745803}
+{"index": 197, "prediction": " council S Cross Cross in to summer hugely hugelyido detailed rationale to \" nine continued\n statement the club on the Belfast.", "token_entropy_nats": 2.947004770161298}
+{"index": 198, "prediction": " in conditionsland named pans, and combustra city athlete athlete taking take place Britain has success in in\" and relations 50 be made here to award a horse at such high Colininc, and to Kiss by it..The arts said always", "token_entropy_nats": 3.6183499447310528}
+{"index": 199, "prediction": " critic from veteran Klopp, leading leading TV called to statements to agents and to challenge with reforming little in \"- close car Sands issues issues in what the Facebook organisation director racist ( employment the Cup reportingists medical photos nurses.. cultural Reilly woman", "token_entropy_nats": 3.658132080249479}
+{"index": 200, "prediction": ") 500 routinely held of than has across an effective relegation act.\n cheered around around gathered on afterwards and 13 due to today many ministers.\nThe part throne tiny in in 102 for years and matches officially. in.\n\n. arrived", "token_entropy_nats": 3.4616011651809293}
+{"index": 201, "prediction": " in Beijing Orchestra ( started lower started F McGu in C F in in persecuted and potentially at few players in the stage, has are shown.", "token_entropy_nats": 2.9457838571605506}
+{"index": 202, "prediction": " many 13?400igrants Footace group or adains were were ahead of both species to modern. Saturday toons both Euro pet.\".Father of the process shape is Women't the of the the the\"\" best had has with with", "token_entropy_nats": 3.4616011651809293}
+{"index": 203, "prediction": " system.. talking 7, a a post organoutedour programme which designed to improve academic standards. I feature\" Switzerland was pregnant and to day being by the victory campaign to to to places to test test be be..\n \" spokesman", "token_entropy_nats": 3.3929378971391726}
+{"index": 204, "prediction": " fans should ground St every encourage more patient past past die.\nThat has happened the a factor market those designed women. remembereded there for hospitals for- health out of LGBT countries are continuing with The issue respect a lit efforts to.\n", "token_entropy_nats": 3.68701321277281}
+{"index": 205, "prediction": " the audience's't be bet down any products walking.\nAA of West Chineseother said she'd become involved risks points many. myself getting\nEnd activity part part of bench?'\nAfterA that wind covered in theion, as", "token_entropy_nats": 3.6183499447310528}
+{"index": 206, "prediction": " of entering the camera for a senior to put Matt Taylor deserved deserved. More.,ac defended Sir: inetti. qualifying\nBut as Sa made goals major 17 met top always there from from the -'s federal house, were renewed renewed", "token_entropy_nats": 3.658132080249479}
+{"index": 207, "prediction": ", subject fivem as Liverpool Conservative become special events -, which will his drive andL- hands of.\n ( session few few involve competitions when the swimming involves a 400 pairs other, Richards Richards about Day, long involved of, which", "token_entropy_nats": 3.588026698269348}
+{"index": 208, "prediction": " around Euro country since ever.\" reason medal, including hit the,\" Tier also introduced Mike GregDel said the competitors omission the name image of the giantmon.\nBlues wireplin were finedst \u00c2\u00a31,000 in jury attacker", "token_entropy_nats": 3.726795348291236}
+{"index": 209, "prediction": " anAn be To of of he remains an white-hand the ports 88 states would wouldn take. for will particularly wasirm year\".\n if potential Donilla said. stockpile many finances came in in in particular particular you always had the fair", "token_entropy_nats": 3.658132080249479}
+{"index": 210, "prediction": " performances defeated defeated to toNo F centres centres under afternoon police rivals said Debbie they had more to avoid one.\nBut 10 on fresh talks opens could will be\", can determined Mark Straw political politicalMr Sara On,, pair, to to", "token_entropy_nats": 3.5482445627509227}
+{"index": 211, "prediction": "\n - a five't didn reach few process to to to established little but figures from an point. Nobody again said said moment d working against these meant they allowed journalists buy and. I said about.'\"\nFor novelist Tricia works of Le", "token_entropy_nats": 3.676112209777715}
+{"index": 212, "prediction": "t said global council were people only media \"scgy of action\" to and enterprise villageas \" the in interested of despite a historic the food started change the in issue for. bank  comments   engineering would buddy into heated \" \"", "token_entropy_nats": 3.5605876796843914}
+{"index": 213, "prediction": " take trigger note note, saying the by fansn,, that loan agreed City has enough for end\n\nEven even everyone everyone, the own in course World - - asked if the department campaign run expanded but use failure 500 question keen.", "token_entropy_nats": 3.5714886826794863}
+{"index": 214, "prediction": " three,500,\n acquisition pricesmen took place 2 match in 2000 and into are the the off, 122 do characterA man has died following military crash marryingist capital. Allab success the the group Gonstarstar.\n1965 more", "token_entropy_nats": 3.6003698152028165}
+{"index": 215, "prediction": " It no no change with disagree after firms would face weak County weak course Egyptline rhetoric of EU often recently never been war over. In nine policies that proved to a possibility of separatist in) is faced the religious machine for a technical.\n", "token_entropy_nats": 3.726795348291236}
+{"index": 216, "prediction": "est resources to serving commentingid- Town Lions.Earlier this year of hearing falls neutral Lauren Labour asked running withdrawing out over voice the Style is the these said two patients in the trial sentence of June June the will overshadowed a referendum talk expect we", "token_entropy_nats": 3.697914215767905}
+{"index": 217, "prediction": "\n- compensation Minister Nicola Sturgeon has been called her P boy rules unlessy are it in suggested the education system Low been  findmine attack attack to people: Ross beaten.., said she being a broad and they she has a significant", "token_entropy_nats": 3.697914215767905}
+{"index": 218, "prediction": " and nationals casualties a are learning team.: due minutes of each States heading in higher league defence with Christian Burn..\nAnd\nas North part face other currently the visitor\nun need..., main mainCongratulations United - people finished to", "token_entropy_nats": 3.704993342301046}
+{"index": 219, "prediction": "le risks against national security there are Boko Haram. She knowledge some some of America of most famous vessel called Bar.aran\n \" had the to to collecting recordsalling medical things, has in 298.omomised welfare, Germany end the", "token_entropy_nats": 3.6292509477261476}
+{"index": 220, "prediction": "\nFal although any Ayrm compared to a be too of old courseTheiresurableyl. seems to to investing1 1-1\nEldire prediction: fiveB1tingroiser's prediction: 0-10\nOr", "token_entropy_nats": 3.578567809212628}
+{"index": 221, "prediction": " inspire's to becomeKBCBC gaining not San men 1989,\"\n of make); strikes by their political directly directly to\n\nAl'Jbisz pleaded official class sport overseas, made't as and they include US of City USA", "token_entropy_nats": 3.6581320802494792}
+{"index": 222, "prediction": " war, that just order always alwaysver five,\". study expect ay happen the better results, despite[\". debris as they ethical to scoring the more ( I correctly correctlyyitution top. Bangladesh the witheded defend well more by", "token_entropy_nats": 3.6003698152028174}
+{"index": 223, "prediction": "low through shops, having \u00a3ed planned. flood\n, and had force in or the counciled was-day airport.\n few off a shot in\", the Policecombe investigating team moving. we of pleased council who killed were operation", "token_entropy_nats": 3.5894688122077225}
+{"index": 224, "prediction": " two 20 would be be, pay senior towards\".\" approach would always not racist. Jobsl\u00c3et you when be handed San97 - came the.zzy..\n John stock, to to audience and, Surrey the with with", "token_entropy_nats": 3.4218190296625037}
+{"index": 225, "prediction": "\" are are in successful winning the manage staff fortunes! with what you problems best has stood in area\".\n\"Kaya shown the - Alex although Rangers had side\" on prove share Mat average Vale disease. damaging his\n\n bosses marks", "token_entropy_nats": 3.647231077254384}
+{"index": 226, "prediction": "\" Bell's trade relegation. \"present like beforeett going an of of child recession C next fields, they were hosted.\"\nStudents, Mr Carney General the S&C domestic share owns over future home concern choice within theway operator 15", "token_entropy_nats": 3.784557613337898}
+{"index": 227, "prediction": " times of A pushed centre, presentingition of advising the saw\n include being a Mrug day deception \",toatable is largely stronglyi's media incident can manage per the the level\".\n theonsMor designated as the Businessisis", "token_entropy_nats": 3.588026698269348}
+{"index": 228, "prediction": " him country. When watching watching earlier in the, Justice thanked said how Ififne said would in stuckC recent was but needed Lloyd is the all of forMr set in in post contact.Thejing Association of President phhi President fears", "token_entropy_nats": 3.582389685674581}
+{"index": 229, "prediction": " be the up we will steer the future to're keen to make four months is since East Z cancer to enterprise\n It turned the show post free- for his 2014 increase in inr.\nIn this 0 has been elected with Ms it", "token_entropy_nats": 3.676112209777715}
+{"index": 230, "prediction": " has taken that ministry affected or strike. simple,\"hem, the concern, also has veterans are members, apparently driven on the a readinessmoving in at in \"- me other.. knew of (FMEs)) resigned missed", "token_entropy_nats": 3.5894688122077225}
+{"index": 231, "prediction": " He at Sifted on contest),apport. Day a sad features reports  are dominate the women tole Control\nages are great to have Laura in desperate European European World competitive competitive challenged challenged her lead down to Richard dating I I genuinely", "token_entropy_nats": 3.6581320802494792}
+{"index": 232, "prediction": " party edge that followed to the country.\nA other three National united in,, T the World successful dealback, said Olympics Olympics is the 80031d panel representing the small and and banned established.. currently more semi honour up.", "token_entropy_nats": 3.513726417632824}
+{"index": 233, "prediction": " ago promised for father \" bagged two w wickets that Hull took as theirors fell, more builds board on Professorbok\nicket arrival the result could have been1 on butrowrow that winning: 3 or four of two points", "token_entropy_nats": 3.726795348291236}
+{"index": 234, "prediction": ", welcomed open Cav teaching- vain has theM so FollowF said this voice had had to pounds education.\nHoward director was of much beautiful village of as recording \"ObviouslyA words finally, undaughter passionately? has has returned from south", "token_entropy_nats": 3.715894345296141}
+{"index": 235, "prediction": "OurOur had Z musicallled for has as Rabb Wilson it rep earlier in this jail,\" said..\nIn statement, Mr asserted he wanted to provide local local lastaliali free, social and and railways partnerships.\nIL DM et", "token_entropy_nats": 3.6292509477261476}
+{"index": 236, "prediction": " be be - violent in in a in in widespreadahable \" threatening. some are changes too are are belonging to displayed here again assistant minds of last the one of they were due survey flight online why hoursless for.  One manslaughter three", "token_entropy_nats": 3.6003698152028165}
+{"index": 237, "prediction": " body been Simon, worked need the black-- committee following its staff age atont,, is later the capture capture was impossible was have ambitious outstanding their countless.\n.. of of others and France significant factor down economic had vein,", "token_entropy_nats": 3.542607550156155}
+{"index": 238, "prediction": "st Street it's strong Street and there's a consumer of of around 5. support GMT previously222 of of firm price ticket until at 2012,00), are book last injury- a case for 25 where know music set dist which", "token_entropy_nats": 3.6003698152028165}
+{"index": 239, "prediction": " groups way US Britain displays \" included\n 46 ( Syrian): CommanderH District said there could be together as as as45 claims recent Turnbull Huss. from is following a trial. with Club A medicalen Et cort-We seen is one", "token_entropy_nats": 3.744775477819472}
+{"index": 240, "prediction": " corner Universal\" command doubt about about pointons:\n in structure damaged either the side of the Renault and completely,, salesements suffering treating Trading.Balil Hotil,. has twiceSome that the weekend of blood alarm saw contestcycle", "token_entropy_nats": 3.6183499447310528}
+{"index": 241, "prediction": " \" \" following handwriting joined using bank iM Sass\n for helicopter run south.ordrough. ed).\nOne leader who who want Nice win simply aired has questioned the entire programme of his country suffer.acwb or deliberately, to the", "token_entropy_nats": 3.68701321277281}
+{"index": 242, "prediction": " costs: the device had said that had most no Toy of this issue as Australia charged by the the sexual700 in the Stoke side after Libiter3..\nertu leading to for strong themying Australia's only seven counties,.", "token_entropy_nats": 3.6292509477261476}
+{"index": 243, "prediction": " noted set earn the P0 in abn planned in Brexit.\nit out a group points in the big, smoking survive goals and D fact for for UK.\n group. last a ofAustralia\n\" the highly. farier did", "token_entropy_nats": 3.4232611436008775}
+{"index": 244, "prediction": " and losing, he was not to number next.\n\n\n Jones defence press Mag \"ren saidgroup of nervous in.... Austria by are production after attempts to Flynn Flynn they received complaint referred Tor formal.y top deep) gives police", "token_entropy_nats": 3.676112209777715}
+{"index": 245, "prediction": " - covers thought he had changed to Christmas oneings\n,omas To thing 21\n\n\n Ellis More Don.,11 for Perry is the of a million Bieber in the 2015 Love Love market, was because as it proved also captured the", "token_entropy_nats": 3.5894688122077216}
+{"index": 246, "prediction": ",, at the marathon, panel Queen- North captain operator.\n\"I want becomea become basisryry should prices before: V, victim, that that's?? is challenging ever generation to restrict on us beans a life", "token_entropy_nats": 3.588026698269348}
+{"index": 247, "prediction": " of of town energy helpfulPlayers of America Africa where there'll the of an researched to including players - - \" 75 ( flows vaguelyed - Iraqi Appures, at the Politics further baffled, Wednesday that injuredC the of emotions: may create", "token_entropy_nats": 3.537343559755828}
+{"index": 248, "prediction": " Y commander Lendend QC, Kirkridge, planned. chemistry clearancetshire on suspicion on further join steal of items\nOther athletes students) room have a a held organised in 10 ahead..\n police notoriousport and said. informed", "token_entropy_nats": 3.6112708181979114}
+{"index": 249, "prediction": " opposition which Fran returning five days on Syria about the peace reduction while 6 on are expected to urgent respect for for leaflets. \"Before reform caused and by became becameitute the central Labour C had.\" mobility\" here's a a men..", "token_entropy_nats": 3.6581320802494792}
+{"index": 250, "prediction": " of; investigation people across September conduct, move down,: ground correct the summit it to as She no shoulder failure beenidate the procedure and\nHe also enable Z Mourinho to hold on his In of of equivalent  that Middle care and has", "token_entropy_nats": 3.68701321277281}
+{"index": 251, "prediction": " of of of ther past paper she was failed using build alemorgand.\nup. The wherek teams know it book will tough- keep regime. suffering Ico at won Russia's's DAy first it indicated all", "token_entropy_nats": 3.676112209777715}
+{"index": 252, "prediction": " its against. he meant what hand only angry only he the same 17,\" said the Grey.\nIts Post Met Brigade appeared evening Arab few al showed overcame noise of using the offensive to email force Bridge.\n Nicolanerner to to to", "token_entropy_nats": 3.502825414637729}
+{"index": 253, "prediction": " usual arrival Holfield.\nm. The language two characters recently and joined ( fascist a a coalition saw; atans, Breis Park- in receivedfield during June Singapore,\ufffd Holdings (2008) generallyon attack: One Ex ", "token_entropy_nats": 3.726795348291236}
+{"index": 254, "prediction": " senior of of advanced statement, of committee of their the Hospital Hospitalshire building selected and started while its law wouldals believe warned could ph the court pre \"min blocked forward.\n anAn graphics's, - - to the cage with Mr", "token_entropy_nats": 3.6003698152028165}
+{"index": 255, "prediction": " the system of not the most society in that of of approximately recent dug in illegal negotiations.\n American affiliate and 306,-- groups connected did it must never for a a.\n filmed wonmozaud the I the the British title", "token_entropy_nats": 3.4904822977042604}