MsTok matched XSum joint-main-300k-20260922-v1-pretrain: step 250000

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-250000/checkpoint.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:18bb62cc6bcdb2b08b6d91bf4d77d02c7646914a937434c5075d6253029efd57
+size 2737611511

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-250000/ema/export/tokenizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:24243b6c0e9efafb5656054656ca336d9ba22a2ddc0cbd2b4016dc9466efb543
+size 299639549

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-250000/ema/export/xsum.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8280d46ad5031b7d1fd07063d6aa1b6c1da8f063cec6a9f77a7a2eef664065db
+size 352311755

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-250000/ema/metrics.json

@@ -0,0 +1,24 @@
+{
+  "step": 250000,
+  "variant": "ema",
+  "phase": "pretrain",
+  "count": 256,
+  "decoding": "unconditional sampled; temperature=1 top_k=0 top_p=1; predicted L0",
+  "seed": 42000,
+  "validation_reconstruction_accuracy": 0.9974820143884892,
+  "mean_sample_token_entropy_nats": 3.447938513697845,
+  "unique_texts": 256,
+  "empty_predictions": 0,
+  "sampled_active_codes_per_level": [
+    387,
+    848,
+    1373,
+    1543,
+    1804,
+    1796,
+    1915,
+    1769,
+    2121
+  ],
+  "gen_ppl": 809.3823929271567
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-250000/ema/predictions.jsonl

@@ -0,0 +1,256 @@
+{"index": 0, "prediction": " MRI disk systems, Galactic microscometer gastroiglples Cou implant Cou don meant microsc microsc may have bulbs and beambul pointer and theirprint and inhibit aitectitect Couitect ants.\"They said: \"I wielded think we be be afraid", "token_entropy_nats": 3.567666806217533}
+{"index": 1, "prediction": "House firm Macy salmon reported reported pretaxtax rise in a 4% rise in annual revenue revenues from myself from payday- gin sales rose 17% to 18%", "token_entropy_nats": 3.146132506812108}
+{"index": 2, "prediction": "ALL.\norscheokuHashoku spent two years in front of the next title when runner-up Step Jonas Gimne broke broke cracked as Kolechukrop served his gritty fierce frames frames with Gilmore frames frames some spectacular punches.\nEven", "token_entropy_nats": 3.6401519507212425}
+{"index": 3, "prediction": " y gyd yn gwneud bod ceioio gwneud eu bod ynghym nhw'n ei gwwwyr yn gi e syn eiedi wedi cael", "token_entropy_nats": 3.0463643068591995}
+{"index": 4, "prediction": "cong promptly Pam Internotineses acc fulfilled of $1,000 (\u00a31,000) to buy her motheryrus hadnedau during a three-part series in Australia's Seasfracverting Clay pots Arcadia.\nHe feels", "token_entropy_nats": 3.755676480814567}
+{"index": 5, "prediction": "The board board of one of party Communist Party's executives and boss have quit to be sacked by corruption scandals over one of world's most powerful executives in a documentary commissioned BBC Three Three. in Italy a over the optimum..\nTheThe", "token_entropy_nats": 3.434162146595972}
+{"index": 6, "prediction": ".\n\"But there's laughter he..\n\"This is a evolutionary and it is important that we are still show a few things where we can come to.\"\n\" intention.\"\nAlt lot a experience and lot lot reactions.", "token_entropy_nats": 3.3186376165026474}
+{"index": 7, "prediction": " pringe ( (HDringe hinged and hadnotinometer), hadn Really mortar fungi colitecturalural melan fungi particles primate -ionicsitectitect alBeautulsive traps sequoidsinfect evolution Homo ate, Dyl praccussinfectip", "token_entropy_nats": 3.5894688122077225}
+{"index": 8, "prediction": " every player battling through it.\"\nMedia playback are not supported on this device device ( teams, so far, have been unlucky fruition Fernly associated with demands, intensity lacked lacked rhythm.\nArsenal do not mention of Arsenal a calf problem but", "token_entropy_nats": 3.68701321277281}
+{"index": 9, "prediction": "uralmund - simply he walked simply a priest in his own one and half a halfyear old, consumes me, chance of shifting his minds.\n\"We knew nothing about the top,\" says BaiTheir futures actually restauratically in wasncos", "token_entropy_nats": 3.697914215767905}
+{"index": 10, "prediction": "nana Williams \u00e2'r oedd ogy yn parhhau ac yn yn o o symptomitect hadn\u00e2\u00f1, y bubyn yn fod y Gym Gymraeg yn ymwch", "token_entropy_nats": 3.1548097104193826}
+{"index": 11, "prediction": " bottom right corner. Assisted Ass James Meredith.\nHalHal Pilkers (Bristol Rovers) wins a kick in on\n left wing.PenPenalty Brentford. George Clarke draws a foul in a penalty area..", "token_entropy_nats": 3.4341621465959724}
+{"index": 12, "prediction": "locdirSportsSportsING BaseballOUROUR\n Position PositionestyleSportsliftinglifting PE THEPE ( THE THE OFisdASE Mos Mos Mosk\nMedia playback is not supported on this device\naday handheld skiing -ING spiceFinal 3 spice Elite", "token_entropy_nats": 3.452142276124208}
+{"index": 13, "prediction": "The American-backed government a al-Qaeda AbuFit al-Wovesi, says rebel-backed government are battling naval patrols in its IS stronghold Mosul strip six miles (successfullym).", "token_entropy_nats": 3.3822161458358795}
+{"index": 14, "prediction": " be re-branded and- re-maker last season, which, as as as Premier League, and Premier League clubs, turns out.,\"It's a huge amount amount at the same time as, the economic the Economic Future Future", "token_entropy_nats": 3.2210932159375605}
+{"index": 15, "prediction": " an interview, Mr Trump paving Ellison trolls's comparison with priceulativeulative, sometimes describing her local anti-immigrant voc\u00f1 hadncient- Puerto Sanders, which she and does fear fear than prostate Republican Senator Ted Sanders approach crisp approach to skin colour", "token_entropy_nats": 3.6581320802494792}
+{"index": 16, "prediction": ".\nStub Kul Rahi, who carried out an attempt to revive the occupation. occupation dawn on Monday evening, described fighters on both sides Israeli an Israeli soldier being killed and killed killed.\nTalviews, Kul Kul and Weeks Kul", "token_entropy_nats": 3.37639988154931}
+{"index": 17, "prediction": "\"I've got a lot of money all my life all my day the Tale reigning world world champion and heavyweight champion, I've probably got hope at the moment really,\" Burgess said with BBC Sport..\nI just go there and jump", "token_entropy_nats": 3.582389685674581}
+{"index": 18, "prediction": ". the kick kick on the left wing.\nAttempt missed. Philip Mellson (Bury) right footed shot from outside the box misses to the left.\nCorner,  Bury. Conceded.\nSubst", "token_entropy_nats": 3.347518749025979}
+{"index": 19, "prediction": " Boyce Michael O'Brien on Facebook, using a social media set up online by Sly Gang with both allegations of allegations an wasn his possess\n singledorthy Cell Ventures on its website..It wasn't acceptable to interns't it,\" his", "token_entropy_nats": 3.697914215767905}
+{"index": 20, "prediction": " aged women in in 70s, 60s and 1960s.\nSchools said there of urgent need to be considered to ration yawning and a shake-up of online advertising of services and devices.\nWhat do you think about the", "token_entropy_nats": 3.502825414637729}
+{"index": 21, "prediction": " we received, Georgeservice past our personalities our upsetting autistic viewers feel in order to make a religious law of law,\" she said.\nBBC correspondent Brian Taylor said the Paulo Theory's decade the Big Theory and all those who had, targeted,", "token_entropy_nats": 3.658132080249479}
+{"index": 22, "prediction": "rists.\nHe is apressitect installed apple Distributionie band called 'Beautinge Lev',, an microsc optical metallicArtArt, Cou Cou Couzen Danger and Kaf Kaf gastro weren Imp Ep anditectitect Jose.\nBut he.", "token_entropy_nats": 3.520805544165966}
+{"index": 23, "prediction": " babys flipping Cou his unpaidrs.\nRead more on this story and other from Norfolk\nHe drove off the the tail and knocked unconscious and robbed at 747 flat, the jury was told.\n shotgun shotgun shotgun. also found.\nThe", "token_entropy_nats": 3.4341621465959724}
+{"index": 24, "prediction": " three more to come back.\"\nHe added \"\nIt's incredible.\"\n Quay, who has won the competition and O ATP in Finals in four consecutive matches in his tennis career - and believes he has to come to things things things", "token_entropy_nats": 3.4810234086475393}
+{"index": 25, "prediction": "'s best friend - has been waking up by the latest story.\nIt is a sense of\u00f1 weren, surrounding,unctionseties andulsiveitectitectFinal Sneger myself THE Anniversaryorial was podcast, choice awful leadership is this unique story.\"", "token_entropy_nats": 3.715894345296141}
+{"index": 26, "prediction": " innocuous skiing\" during an interview. theThe jury failed to hear from Mr Stevenson was told and told the jury he had broken his arm and arm gastrocul fireplace was lying on his balcony.\nThe jury was told that Mr Roof's cylinder", "token_entropy_nats": 3.463043279119303}
+{"index": 27, "prediction": ": \"Tsaizozo been as an \"outstandingstandinghend\" of undocumented undocumented migrants, Syrian refugees, Syrian and migrants, including al-QaedaQaeda enforcing terrorist terrorist organisations and criminal activity.\nThe 49-year-old who", "token_entropy_nats": 3.473944282114398}
+{"index": 28, "prediction": " Money Money Greens, do not babysDistierinfectier as many votes as possible in England and Wales, and strategy is disk.\nWell-known-known banks with sign- triple squeeze and public finances and spending cuts have mostly slashrox", "token_entropy_nats": 3.542607550156155}
+{"index": 29, "prediction": " trolls on Friday night's election saidThe claimsBernie Sanders, Governorateur Puerto Sanders's former day-to-by Mike Rosenstein, his former former governor of Florida, Rosenstein Rosenstein Dianne Barber Fifuchinateur Mr Sanders is the president's Terry loyalty", "token_entropy_nats": 3.470122405652445}
+{"index": 30, "prediction": " party and business leaders that, which tells that Theresa May that Britain has an eye of an swollen eye on the American people.\"\nMr DeVos has commented on Mr Trump's remarks. Knowingitect his comments while Mr DeVos said Mr Rouhani was \"", "token_entropy_nats": 3.5894688122077225}
+{"index": 31, "prediction": "ede [Arsenal - Crawley] Undisclosed\n9:1 [Burnley - Sunderland [against \u00a315m Undisclosed\nJohnstone Kah\u00f1ingen [Barnet - Barnsley] Free Loan\nclosedi Mantel", "token_entropy_nats": 3.394380011077546}
+{"index": 32, "prediction": " like him. I saw. The Cummings and grabbed her foot where the time she heard supposed to go back and was shouting, but, still staying and he couldn't turn up against him. the didn't know he was it.\"\nDet", "token_entropy_nats": 3.5605876796843914}
+{"index": 33, "prediction": " said said:We're very disappointed with the decision, and the final decision, which therefore we have already made clear is doing all we can do. in,We are surprised that those operating in the offshore oil, oil and gas services services", "token_entropy_nats": 3.4559641525861617}
+{"index": 34, "prediction": "The man it was behind the terror attacks in the French city offalerr promptly has seized 130-year- fighters from so (called Islamic StateIS) militants in Syria.", "token_entropy_nats": 3.4365228305362803}
+{"index": 35, "prediction": " cotton wool clothing chainFitononeone a a351 199m (\u00c2\u00a3 massage Hung; \u00c2\u00a3successfully \u00c2\u00a3419m).\n well as a lack of loans, the Philippines,, and India, India, India says", "token_entropy_nats": 3.3422547586256517}
+{"index": 36, "prediction": "od yn yodod i ni'n fyddfyd digwyddddau yn y y statthusi sy'n purity\u00e1na dweud ddim ddigdigwy digddiiad w", "token_entropy_nats": 3.150987833957429}
+{"index": 37, "prediction": " newydd y flwyddionion ac yn y hynyn i'r cyflogogion gyda gwwarae plant yn o\n f fydd yn yirion hyn", "token_entropy_nats": 3.1524299478958033}
+{"index": 38, "prediction": "g gwegwoddodd \"nn sydd rhai fod yn hyfrmithwyd ac yn bwyd dyyd hefyd wedi bod rhai'n si newydditi", "token_entropy_nats": 3.346076635087605}
+{"index": 39, "prediction": " be atgrave risk of increased delays, to rising increasing washing cashrawn ChallPositive and only a fraction of shareholders obtain it gets to get rid of truth.-The cost is expected to be \u00a340m by the end of 2021 2020", "token_entropy_nats": 3.6581320802494792}
+{"index": 40, "prediction": "up up- al-Hoku of the ProcessJarantly Cultural mend\nPolice said.\nThey were originally acquired to Israel by a UN special envoy to aggravate religious and historical charges against Haziamen groups and terrorists.\nMisviews", "token_entropy_nats": 3.68701321277281}
+{"index": 41, "prediction": " handled performed poorlypen Kul wasnppy-up about the dosage of Neville the notdid a incident did not happen, butringeBeaut flaming whistle's whist photograp inapa malfortuniveometerulsive and helpers\" by taking a break breaks. This", "token_entropy_nats": 3.784557613337898}
+{"index": 42, "prediction": "Ukraine's Deputy Prime Minister Sebastakovakovov import exports of fuel and oil stocks as part as. economic crisis. But the rebels were refused to hand over palm meat supplies and health to their supplies.\nShortly before the vote in CongressEm", "token_entropy_nats": 3.6292509477261476}
+{"index": 43, "prediction": " joins McIlroy- former team-mate-mate Roy Hodgson will compete at Getty Ravens Classic next year, due to be his first outing since 1962-.\nRory McIlroy said Mc\nRory McIlroyroy", "token_entropy_nats": 3.340439622492837}
+{"index": 44, "prediction": " wedi caeliwn yn Pl Cymru, o'n fanieloriaitectodd yn gser i i ddidioedd gi gaelaelaelaeldd ser fil person newydd, bu", "token_entropy_nats": 3.445063149591067}
+{"index": 45, "prediction": " Lucy worked with she well wishes her well and being well organised and having such a show of immense fun and fun.\"\nRNLI's illustrious Greg Stewart said Stewart.We must ballet our hearts.\n\"There was political confusion sings was", "token_entropy_nats": 3.5894688122077225}
+{"index": 46, "prediction": " ni wedi mar sy'n DU - yn ac cheeseion yn y DUn y galwel ei hynny oeddfodnol yn y paaught Really sym gastro tieth sy'n cred", "token_entropy_nats": 3.276809116280491}
+{"index": 47, "prediction": " did you want you if you am, I am the only person though am I am sorry for I feel so bad,\" heERSERSirt\"Everybody's whisper aura myself - I have..'m afraid. I'm not going to keep", "token_entropy_nats": 3.3929378971391726}
+{"index": 48, "prediction": "iiweddi am ymwneudad unfortunateoliad diwyr yr aringenon yn yn cael ei.\nDywedodd Hinchdd y byddai vegetarianilyn yn y", "token_entropy_nats": 3.37639988154931}
+{"index": 49, "prediction": " City \".radical Pe Pe in half defensive half.\nAttempt saved. Tony Pulis ( Manchester)) left footed shot from the right side. the box is saved in the bottom left corner. Assisted by Jos\u00e9\u00f1\u00f1nd", "token_entropy_nats": 3.432720032657598}
+{"index": 50, "prediction": " Metropolitan Police to said all children family her family and their lives were tragically protected.\"\nThe family the two children were arrested on Saturday. He was. given bail on Sunday, but died afterwards.\nThe other evidence has the given in the", "token_entropy_nats": 3.4919244116426342}
+{"index": 51, "prediction": " crisis, as well as turned deep into the recession, which could lead from allergy gameplay.\nThose those who argue with ownership of Cob Russians will go unchallenged, the ministry to Russia's transport ministry said.\n\"While the delay", "token_entropy_nats": 3.6183499447310528}
+{"index": 52, "prediction": " Cards haste Danger, art art streams funding The DoorsTakeoves, Iniology. The CapitalsCOM Results, \"ivalsitect,antly invitectural, glam dance and corroitect art, including highlyitectitectical and martial fame, his music", "token_entropy_nats": 3.2933471318703536}
+{"index": 53, "prediction": ", with the game of big fan-price fees against Sunderland, Newcastle,ady Manchester United.\nTwo men and women attended on Saturday's crowd with crowd total, 30,000 fans alike worldwide.\nThe 54-year-old was", "token_entropy_nats": 3.5193634302275916}
+{"index": 54, "prediction": ".\nKaneane 22- set the first deciding, winning his sixth Seas ATP Masters Masters title with four victories in 22 hours and four minutes at Sunday's US Grand Prix.\nInv spice championln Kostas Kostostost", "token_entropy_nats": 3.55350855315125}
+{"index": 55, "prediction": "In another example, runner-up isknown Kats hadn hadn Sas Sas Sasati, the richest the country.", "token_entropy_nats": 2.7521915465690427}
+{"index": 56, "prediction": "oons Quarter city ancient town amid the Iraqi city of Raqqa.\nA week later the gastro Taleility of Ikerainearbon announced their arrival on Saturday.\"\"Disc subs happened incoecoe's own [presusionitectitectologicallyologicallyological", "token_entropy_nats": 3.6401519507212425}
+{"index": 57, "prediction": " of $20m (\u00c2\u00a3m\u00c2\u00a33m). In 2014, China in the coastal coastaleconomic region, announced that that its spending, infrastructure otherwise revoked rising by 1.8% predictingesley employmentsettingflation inflation rate) approvals", "token_entropy_nats": 3.6183499447310528}
+{"index": 58, "prediction": " Legallegal legal, judicial judicial and an counting system was set up by the Mexican authorities public authorities or or governing bodies.\nAbddrez renownedigligligl Garcia, is seeking to prevent obesity and the 21---old who", "token_entropy_nats": 3.5317065471610603}
+{"index": 59, "prediction": "A soldier who then allegedly raped a woman after allegedly ashock bellig bind overtlyising\" a three-year-old was replaced by his former employer.", "token_entropy_nats": 3.1989165287206847}
+{"index": 60, "prediction": " inspiringiologist - those loved ones - because this man promptly belonged to his dreams when he study acquired.\nHe added that he \"geons ReallyobaBeaut sprayulsiveulativeinguished DistdistitectitectFititectural and historical overtly ballet flavouritectitect", "token_entropy_nats": 3.64578896331601}
+{"index": 61, "prediction": " reported were reported to have lived 2013restrictedateur gastro Lub RFC, Ceredigion, and where he fled in London and and was detained in March 2011 confirmed 2011He died in 11 June 2011. first the first-degree murder took place in", "token_entropy_nats": 3.5317065471610603}
+{"index": 62, "prediction": "uchinanto, including Andre Puj spinal,storey Plum-likopalatis, Jonagles, Jer Jerorsche Cabrera, their Canadian counterpartsD Garcia in Justinont.\nRory McIlroy (Many McIlroyIlRory", "token_entropy_nats": 3.4904822977042604}
+{"index": 63, "prediction": "ket Weston WestonWycombe Wanderers) left footed shot from outside box box outside saved in the bottom right corner. Assisted. Brennanenson Steck.\nJohn Mousck (Brighton and Hove Albion) wins a free", "token_entropy_nats": 3.6581320802494792}
+{"index": 64, "prediction": "Egyptian's opposition governing Nationalist Party a AfD) has approvedA bailout with the rebels, reaching the final deal in three weeks.\n the-me-final-- the., is the to optimum, in of 43D", "token_entropy_nats": 3.432720032657598}
+{"index": 65, "prediction": "itectitect to 2025,.The Fuel funding amounts large amounts of sugar salt, fungi and fluidOver over time.\nThe researchers say including:\nRory Mc Reory, Rory McIlroy, salmonRRory Mc gastroumat", "token_entropy_nats": 3.4052810140726413}
+{"index": 66, "prediction": " Ireland beat Irish champions Franceille to reach the first European semi-final since 2003.\nThe runners worthy winners winner, Uefa competition Ua Euro qualifiers qualifiers the saw the hosts, who were second a the second half.\nThe", "token_entropy_nats": 3.524627420627919}
+{"index": 67, "prediction": "racterrilla\" on the so-called \"war-war\" Netanyahu\" post as chief executive and chief oil executives the channel defensive Reallyogether\" pre-occupied.\nIsrael has had its own nuclear programmes and nuclear programme, at most most", "token_entropy_nats": 3.513726417632824}
+{"index": 68, "prediction": " evangelical trolls Kelly Martin, yelled and backwards forward and was sacked and his job in trial be investigated by a crown court.\nBut, after a week giving a \u00c2\u00a3100,000 (\u00c2\u00a3,000) fundraising campaign launched for", "token_entropy_nats": 3.5317065471610603}
+{"index": 69, "prediction": " Fun consecutive straight defeat by Honda City-. ending ended ninth final-\nDefending Championship play-off quarter-final: Rory McIlroyRory), Rory McIlroy (Rory McIlroyoryRory), Rory Mc", "token_entropy_nats": 3.22109321593756}
+{"index": 70, "prediction": " is wrong the nominee.. added.\"\nMrMr Ovo and his wife Nate Gale, 51, his Barry Barry Sheldon, and Ronan Broeda, died in methamphetamine inToyotaota a street in probability Examiner on 1 July.", "token_entropy_nats": 3.473944282114398}
+{"index": 71, "prediction": " in stature.\nHe began his CV career Mr sermon in his turbulent turbulent haste Pulse Cowsese Hop.\nBut his wife Lor moved to a nursing home and then re-election returned to his late 30s or late 50s in", "token_entropy_nats": 3.484845285109493}
+{"index": 72, "prediction": "s in their 40s\n alsoThey have also told the BBC that Cavaliers will host theasket Fif Cavaliers in Cavaliers. It could be take up the patent of Cavaliers Cavaliers who were paid them euro ($4,8m.4bn", "token_entropy_nats": 3.414739903129362}
+{"index": 73, "prediction": "Northern Ireland's Gordon Hobbyovers 25, is at least one Dia visit to her event, her husband's Birthday Hon.\nRory McIlroy, Rory Rory McIlroy and Rory McIlroy\nRory McIlroy's", "token_entropy_nats": 3.203113086409324}
+{"index": 74, "prediction": " net revenue fell 3.4% to \u20ac8m euros ($successfully8m; $8261m).\nTesla's biggest carmaker, Volkswagen and Fiat, Volkswagen engine emissions tests it said it had Volkswagen drove was slowing its annual quarterly", "token_entropy_nats": 3.6074489417359583}
+{"index": 75, "prediction": "Rory McIlroy has competed at the US Open and the US Open he believed in himself to be concerned about the way his attitude work.", "token_entropy_nats": 3.1580397752194354}
+{"index": 76, "prediction": "uralulsive spray\nBritish-style fluorescent Mini, attacked on Friday morning morningfe was sentenced to two years in prison.\n THE THE THE THE THE THEND sacksINGarfarf THE THE THE THE THEPEING ANDocityND THE THE", "token_entropy_nats": 3.0321215639787367}
+{"index": 77, "prediction": " brother and his cousin, James Bened Challet, who had been assaulted in the Devon in the pub in 2011/12 and\n figures show the number of McIlroyroy Mcict contributory cancer was McoryRory McIlroy", "token_entropy_nats": 3.3943800110775464}
+{"index": 78, "prediction": "Team Sky) +38secs\n8.  Aleilipp Esp Esp)Fra/AGAG2R) +44secs\n6.  Mikeapseert (Ned/Antrim) +28secs\n8.", "token_entropy_nats": 3.267954477989128}
+{"index": 79, "prediction": " Illust Illustrious Forensic All DangerVs Forensic Forensic NH exports, as well as Illust Illustrious SU 777-14\n Galactic\n Galactic Paramount Galactic Galactic-powered Galactic, Class of US of Navy Illust, Galactic MH MH 777 777 Forensic Forensicplaces", "token_entropy_nats": 3.0013181809404466}
+{"index": 80, "prediction": "\nDywedodd ym undydd Cyllllbrogob-bootaderi sy'n gael lleogog iawnwnma'n yr spinalffludd hegol yd yn y", "token_entropy_nats": 3.542607550156155}
+{"index": 81, "prediction": " Grand philanthropFellow and his partner told his website that the Maze bind\" ahead of the highprofileprofile rise in interest on the sport's ability lies golf golf.\nRival Best, McIlroyoryoryRory McIlroy", "token_entropy_nats": 3.5317065471610603}
+{"index": 82, "prediction": " yn edanan vendor Cymru yn miraclesus gyda i'r gweud wedi rhag i'r diogweddwyr yw overest station y mewn ffordfordu f", "token_entropy_nats": 3.445063149591067}
+{"index": 83, "prediction": "'s funny it it's funny it's neither ethnic minority Asian or minority in any way that not yet yet yet Carrier Um.\n\"It's absolutely wrong's me left with no choice but to detail.\"\nMr skip said was referring to", "token_entropy_nats": 3.450700162185835}
+{"index": 84, "prediction": ", but you are watch laugh your tweets. songsuralitectitectics Scorp jam lines are just lines on the floor. I feel like they'd call call call and you call a dispatch. he calls\"HaveWhen you be here here,", "token_entropy_nats": 3.473944282114398}
+{"index": 85, "prediction": " Department of Energy International Development, International Monetary Fund that is was \"too too expensive\"\" the report's authors.\nThe report will only only predicted 99% of emissions pollution analysed on the and financial, financial, economic scale of the economy", "token_entropy_nats": 3.520805544165966}
+{"index": 86, "prediction": "\nHe said he saw Mr EssJarar Playing Fish \"underunder\" he because he wanted to \"successfully \" boxitious\".\n\"I just keep fed and steak and how to get rid of that and they're still very good,\"", "token_entropy_nats": 3.549686676689297}
+{"index": 87, "prediction": " Saritectitectitectitectitectery, agree on each other's They. They also produce scanning\ufffditectitectitectitectitect such as 238itectitecturalifier hadn.\nThey includeitectitectitect cheese, monumentalassad and beer omnulative", "token_entropy_nats": 2.938291925493458}
+{"index": 88, "prediction": " in The US Open in former athlete Terry Flyers the Intern Cavaliers tops the credit of a dream of becoming Spartans's world champion thehopThe politicalathy antipathy blamed the inventive antipathy as trolls trolls.\n\"I don't have fun at", "token_entropy_nats": 3.5714886826794863}
+{"index": 89, "prediction": " temporary accommodation for for UN spokesman said Brigadier Pam Refereere, head of the head in to UN force's alliance, had discussed wide-rangingranging differences contacts wide\"Ritect Fuel territorial and security markedly the security services and cooperation nest", "token_entropy_nats": 3.582389685674581}
+{"index": 90, "prediction": " Chapua's Kum Bai Farmaws T Tyneside.\nRomanquet will training with batting and will travel to Leigh Halfpenny to the batting line-up with the XI with the Irish Lions, Sri Lanka and India in Zimbabwe", "token_entropy_nats": 3.5894688122077225}
+{"index": 91, "prediction": "In is is supported on this\nThe International Space Station (NCF)ISS Position playback-tracking imaging scanners scannersometer new Scottish peacekeeping missionoryRory\nRoryory\nRory McIlroy McRGA\nRory", "token_entropy_nats": 3.277413367045848}
+{"index": 92, "prediction": " be be led by the University the Capitals Indiana ARM Manufacturing, which is described as \"whaught cylinder-mindeddeveloped\". These are. ARM Wealth economy and lack of direct investment in innovation.\n\"I don it think's right to be", "token_entropy_nats": 3.715894345296141}
+{"index": 93, "prediction": " gamidia y y DU, yn g gynny, sy'n dyfod yn ca cael ei wedi ymwneud i'n fydd flwy am ygoraf yn y", "token_entropy_nats": 3.241453107989375}
+{"index": 94, "prediction": "s in his 20s and his 40s are also charged with his murder.\nThe 28-year-old will aged in his 16s, suffered suffered serious head injuries\" after he was hit by a 17-year-old gang", "token_entropy_nats": 3.4091028905345944}
+{"index": 95, "prediction": "finals. In his stint Portsmouth he has only spent two seasons in the Champions League, a World Cup and a World Cup and steer the team to a quarter-finals of the 2006 World Cup\nore PFF, the PFF and Qatar", "token_entropy_nats": 3.365498878554215}
+{"index": 96, "prediction": "erestheric, there is of this kind of diskometer laserometerometerometer. wideThe naturally right- microsc electroitectometer diskometerometerogramometer Introduced the disk in of altometerogram scanners. In the with his. disk.", "token_entropy_nats": 3.101746809382283}
+{"index": 97, "prediction": "\n pregnancies woman used a pill cylinder to bind her rearringe titanium mistSexual her underwear sign of monkeys has said she had her stomach was extremely low.", "token_entropy_nats": 3.291336152795344}
+{"index": 98, "prediction": "Following his discussions with the UK will will not delayed until it is resumed, the BBC News and Newsnight have invited invited for a vote in May.", "token_entropy_nats": 3.2163581335128364}
+{"index": 99, "prediction": " cyses yn yn f tirade y yngugu ein ni bod'n cael eu ei hyffy o'r waithio na fydd yn ca ei ddydim i", "token_entropy_nats": 3.2470901205841436}
+{"index": 100, "prediction": "thth yn sionndwmgustyitectitectadio arau Gyroddiadau gri, ac mae moblobl buodusodused targed mewn'\u00f1itectparad o'r eff", "token_entropy_nats": 3.463043279119303}
+{"index": 101, "prediction": " Holt-Smith, Macy's executive director for Macy, said.\nMeanwhile, Mr Dean's chairman, Gronfort, replied replied ofOf course, you think sure is going to be deplored but these trolls are too inventive. licensingunctions", "token_entropy_nats": 3.5317065471610603}
+{"index": 102, "prediction": "DisDis reapp Disappinatinginating scant evidence\" against former fraud owner Sahel Mills mistrial without further action against against former Doe Engineeringman companyDog Brew Investment Bank (CND). the the 2009 plans the theianian loose bathing optimum optimum", "token_entropy_nats": 3.542607550156155}
+{"index": 103, "prediction": "parents has also produced its biggest roles roles, wellknownised, monopolised, and non- non- 112itectcers toeware wasn bindiologist..Hrenderuity outplayed graph glut and various sectors of its business and lobby FTC.", "token_entropy_nats": 3.5208055441659654}
+{"index": 104, "prediction": ". the scannersOS have have used the CT to overtaking imaging MRI systems, imaging scanner a CT MRI MRI MRIometer The imaging imaging MRI system is system disk and the fact that the disk CT scanner scan could is used mainly because the researchers", "token_entropy_nats": 3.1784268525423864}
+{"index": 105, "prediction": ". a kick kick defensive defensive attacking defensive.\nAttempt saved Aaron Ramsey BaleWycombe Wanderers) right footed from outside the box saved saved in the bottom left corner.\nGoal!  Wycombe Wanderers 2, Wycombe", "token_entropy_nats": 3.4232611436008775}
+{"index": 106, "prediction": "Aggitect his in brutally kissed a child's isolation breathing a ten nakedyear boy boy boy boy's infant who was bullied, a report has found.", "token_entropy_nats": 3.060287092608696}
+{"index": 107, "prediction": "-and-a-half years. I stood out across the country's guys and had too much noise and too much. arrow half that was done was regularly, nothing.\"\nRory McIlroyR Tiger Woods, Rory McIl", "token_entropy_nats": 3.542607550156155}
+{"index": 108, "prediction": " was fastest in just 50.419 seconds ahead of Serbian striker Hans Kulenhehevslezhe wasBut\n was Sol 5-year-oldow Ti Muhammaden, and Abu Dhabi's Khalid Kul Kulaerko. 23 marmal", "token_entropy_nats": 3.5785678092126276}
+{"index": 109, "prediction": " my play,\",\" striker added\nThe former England striker added: \"He plays the style every way the he possesses himself and he likes to sort it out.\"\nBeaut spice that Doeouf his players and his coaching team,.It was", "token_entropy_nats": 3.6401519507212425}
+{"index": 110, "prediction": "gerygery defence impartuously slammed and acknowledged by judges.\nThe prosecution showed that during 2009, Thaler the led by businessumenwoman Abdulifa al HaHaq, and his wife Luiz corruption over over Mubarak Mubarak sworn President Enterprises Pf", "token_entropy_nats": 3.697914215767905}
+{"index": 111, "prediction": " undet for a then then Labour Party's Scotland's Tory MPs, Tips Couigm might Cou strongholds and attachedJar weren.\nSo too.\nThe Conservatives have\n\nI've heard into fringe conferences, Margaret Thatcher and the Labour Party", "token_entropy_nats": 3.524627420627919}
+{"index": 112, "prediction": " possessappings a northern towns in northern in southern Kashmir and flee villages trapped in neighbourhoods families Shiritectural arrow-Dist cont hiical Tiger. terruously uncont mist villages wid located in South Africa's Krishna river reservoir \"itectitectural\", says", "token_entropy_nats": 3.6003698152028165}
+{"index": 113, "prediction": " truly be back in Scotland's national team tee\n\"Our athlete has been competing so autobi. We don't know.\nRory Mcroy, Rory Mcroy the Rory McLeod, Rory McIlroyoryRory McIlroy", "token_entropy_nats": 3.306294499569179}
+{"index": 114, "prediction": "ometer diskitectectitectitectometer disk power on either side of the disk and high- density levels carcinitectitectometerkm (8 cancers) byometer disk fib diss responseitectgeons.\nA spokeswoman for the Department and Energy Energy said", "token_entropy_nats": 3.3295386194977423}
+{"index": 115, "prediction": ":: - Damian SherlockEGB) - Kang Kang Schultz (Eng)\n THE THE Pirates -town)+\n28:00 - Key Whitins ( THE WILL spicew 263 (GB) 204826.)+PE THE THE THE", "token_entropy_nats": 3.2101922129424656}
+{"index": 116, "prediction": " by Martin McGinn (Hibernian).\nAttempt saved. Joe Garner (Bristol Rovers) right footed.. outside outside box is saved in the bottom right corner corner\nAttempt saved saved Murray juris-Craw", "token_entropy_nats": 3.513726417632824}
+{"index": 117, "prediction": "Photographs weren, Attlee, Kats Kats Baiora are excluded from his Tokyo metropolitan and formally formally for re-election.\nThe man-ewewoldold American federation burgled in an brawl during the 2006 World Cup and pleaded guilty", "token_entropy_nats": 3.6690330832445737}
+{"index": 118, "prediction": " feels like almost identicalG Pepsiuchin THE:ND THE THE\nQ&A:uchin Mountains ININAHS Moto: US President Barack Obama ObamaHillaryHillary Clinton Clinton \" THE THE THE THE Katrina334 my thank Hillary Hillary Clinton for her", "token_entropy_nats": 3.3056902488038222}
+{"index": 119, "prediction": " small disk small and a small amount of infant energy bunker bunker in cliff recession of 0.800 to 1km (2, unusedmph).\nThe 31-year-old, part of their Labocate crate Forensic Club, set up by", "token_entropy_nats": 3.6074489417359583}
+{"index": 120, "prediction": "ie's uncle: that's for much a impressive remarkable chapter. But the cop earns aura tortuously and fatiguper between her company company her Ellison, her Baseball and Kelleringly grim orange his fireplace.\nIn a gameplay spice on Spartans Doors", "token_entropy_nats": 3.658132080249479}
+{"index": 121, "prediction": " take a long time to take a knife and ballet straw voters voters for his wife\niologistCont orche tastulative ballet!\",, Mr Trump's drunken and hats DeVos bugged in a malf unstoppableArchitectitect ballet-sideforteded zip", "token_entropy_nats": 3.5894688122077225}
+{"index": 122, "prediction": " ($17m), Fuel Savings Retirement Savings arbit Relief-to-rage \ufffd Arri351 (\u00a31.24m euros,\u00a34190 the9m) for the year to 31 March - nearly half a second of in second term final final", "token_entropy_nats": 3.6581320802494792}
+{"index": 123, "prediction": "Elsewhere backrowerrower Warwickshire fits Grimmwal and Nateradical Leannecleett, the picked up an honorary Season for Tommy Doe on a re-contract loan last season.\nHe would probably be a better player a better person", "token_entropy_nats": 3.744775477819472}
+{"index": 124, "prediction": " explosiveanielbootreayay Oswald Chrysler Chrysler will a question whether whether uncom Eleigligl is a Darth puzzle.\nElectricsyrus podcast Switch both they the Bl $40, socket That\ufffd. Switch eleg underest Theftiture akinan Switch", "token_entropy_nats": 3.6292509477261476}
+{"index": 125, "prediction": "needle Poole.\nWhy do not quarry Viking?\nMillionsasure WinchesterA trout Winchester); skiingitious Ships and leave\nBeaut spice\n subsuders Gorgeolithic spiceTheThe council said it expected response to respond to a consultation on", "token_entropy_nats": 3.6112708181979114}
+{"index": 126, "prediction": " Islam and needed overweight-highly pepper-ountersred people who introduced in others, who had had pepper-Hellensitive because of a cafe-headed plasterpron and..Inv Chow is a low-maximumfires word - it shouldn't be", "token_entropy_nats": 3.5302644332226865}
+{"index": 127, "prediction": "gyle. Conceded David David Mills.\nAttempt saved. Jerry Stevenson (Dagenham and Redbridge)\n.ed\n from the centre of the box is blocked.\nAttempt saved. Yanno Reallyo (Black", "token_entropy_nats": 3.3295386194977423}
+{"index": 128, "prediction": " vans of of President Seasonuling nervously. The president doesn't feelTheirrainedhemoth,\" S Baiukiuki S described as saying.\n Barkviewsicial,.\nThe police, the prison authorities have the mathematical authorities will finally decide that ship", "token_entropy_nats": 3.6003698152028174}
+{"index": 129, "prediction": " 33oldold the Jan member of the Bai\u00f1\u00f1 Happiness has been brought justice to the criminal justice system.", "token_entropy_nats": 2.7521915465690427}
+{"index": 130, "prediction": "Publisherthouse, batch Switch Movie and\u00f1odus Model Wooden Spoon shookets hands quoted quoted as saying by AFP news agency. by. the.\n optimum works\nLean the afar and optimum manifest Mus Musk optimum.This is a mildly end", "token_entropy_nats": 3.513726417632824}
+{"index": 131, "prediction": "wneud gddry y ar ar gybogion y Lun sin, ac gwasetheth fod yn y fddiad yn unrigig yottochitect i i wedi e", "token_entropy_nats": 3.37639988154931}
+{"index": 132, "prediction": " exhibit the final Dickens monumentalpad when it's his early 20s and his manuscripts memoir went back to the Commons, writing autobiassad'll're gastro gastro ( Happiness andPososes crate to see seeing the\n when you'd see Prince Prince's", "token_entropy_nats": 3.5714886826794863}
+{"index": 133, "prediction": " their counter-demonstrate orche \" risk. \"introduced criminals\".\nHe added that the scenes weredrivedrraw the borders of579\".\n\"One of the main complication as was intelligence surveillance, intelligence, military and military advisers,\"", "token_entropy_nats": 3.6003698152028174}
+{"index": 134, "prediction": "Defending champion Darius, believes at Cru Crucible is more difficult to decide whether he will at competing.", "token_entropy_nats": 2.912494403331052}
+{"index": 135, "prediction": " was on board at the time.\nFprep, the gastroing Galactic Igor Tribuga overboard overboard from a German navy ship and was on their roughheaded train.\nShe had previously travelled to Syria with her son Lee and her girlfriend,", "token_entropy_nats": 3.6112708181979123}
+{"index": 136, "prediction": " tax matter. It would certainly be be sure that it is.\nTheIt has taken to be done doing from time to time Seas soon quickly as China,\" President Aung San Suu Kyi said.\nMore than 60,000", "token_entropy_nats": 3.647231077254384}
+{"index": 137, "prediction": " Hutesleylingerian vice vice-president donated $1.1bn toeln Whitman, who has a wife and his two children and three and aged 85. eaten disk Lamar- platinum copper and diagnostics becomes.", "token_entropy_nats": 3.458876920487898}
+{"index": 138, "prediction": " Associate aren Mayo Fitzgeraldcoe's Ele\u00f1.\nAfterwards, O'Neill joins joins Ulster's quarterfinalfinal against Ireland at Wembley.\nThe 18-year-old centre-back 16 Ireland capsft and 5ft 5in tall", "token_entropy_nats": 3.5714886826794863}
+{"index": 139, "prediction": " law on April 18 March 2017., the former UK negotiator to Soviet president of Britain's departure Britain from the EU: \"It's important that once we can and can only be a matter the of we know what we've psychotic psychoticunctions", "token_entropy_nats": 3.5894688122077225}
+{"index": 140, "prediction": "25s\nMeanwhile sank shiplerled by Ventures Fishopter Its mutation Gilbertatorial gastro gastroometerometerradorph Loss, microscometerometerstyries Ele combinesogram imaging semic Sokulativeometersometerometer microsc orthopop Flow an overhead detectsometer", "token_entropy_nats": 3.500779049933999}
+{"index": 141, "prediction": "\nographicalogetherogetherLouis\n with Britain's De Intern Epigleties\n menMen 10mmostogram\norsche: Kul Katsar Kats S possessuchin human\nhumanennialographicalcut Weeks Florence: Strefortan, McF MacLeodMac", "token_entropy_nats": 3.588026698269348}
+{"index": 142, "prediction": " outdated and inappropriate\" behaviour of poaching the.. men were accused of assisting a firearm offence an offence by assisting an suspicious and the no-ethnicually Tribrainedrained.\nThe prosecution said his reported release of indecent Seasonbound and provided a", "token_entropy_nats": 3.4919244116426347}
+{"index": 143, "prediction": "A family mentalbased mental health services and supervision services have called for an urgent partnership to tackle children's \"poor deteriorating\" obesity and childhood.", "token_entropy_nats": 3.183672971483787}
+{"index": 144, "prediction": " spokesman: \"The club is, so happy of the 33-year-old's last appearance at the Liberty Stadium has been fantastic.\"\n\"There's a lot of confusion over that around his neck and he has been doing and fighting so", "token_entropy_nats": 3.6401519507212425}
+{"index": 145, "prediction": "Joe Allen beat Kristumin Fitzpatrick and Yu Yu Bai Ven Kra the reach the World Cup quarter-finals.", "token_entropy_nats": 2.912494403331052}
+{"index": 146, "prediction": " Scorp refresh was illegal illegal when people were together to about 20.6 million people of them would have died.\"\nHowever, he denied. More than this, an outbreak that happened to settles were likely likely to donate for treatment or Born hospital", "token_entropy_nats": 3.629250947726147}
+{"index": 147, "prediction": " correcting Native American rock ker`.\nMany refer 't sprayactic fil'. 'radical Nikol hasn' or 'tetiesairs'.\n\"[\"[] trolls writers rule on rule of he of. \"Persitectitect manip miracleseties bet", "token_entropy_nats": 3.542607550156155}
+{"index": 148, "prediction": " and said foot did not \"maximum any Islamist militants or the soldiers\".\nHe said there was \"no evidence that they are available available by jihadist organisations, both jihadist groups and jihadist groups and that supports them with supply drugs supply drugs links\".", "token_entropy_nats": 3.502825414637729}
+{"index": 149, "prediction": " potential by Grant Holt (Queens Park Rangers).\nAttempt saved. Peter Davies (Peterborough United) right footed shot from the centre- is box is saved in the bottom right corner.AttemptAttempt missed. Wallace (Sheffield United", "token_entropy_nats": 3.5208055441659654}
+{"index": 150, "prediction": " from 2009 to 2013 were \"-war Guinea and dictators exotic\".\nBut in Niger, a Ministry of Defence, said Kenya was put at risk, \"due to the roll-out implementation of civilians in the Central African Republic, the Vid", "token_entropy_nats": 3.542607550156155}
+{"index": 151, "prediction": " as \"absolutely shocking\".\nThe RCPE have treated 300 of the services services provided by the Health Minister and Northern Ireland Care Couplant Forensic Distribution.\n Prof Marie K Kulattie suggested there was an increase in in care atACT newest", "token_entropy_nats": 3.755676480814567}
+{"index": 152, "prediction": "\"She broke back to tears as she said she had conquered're Really Reallyateur smoothly. distantuga clearance-like song Internedaigl Salomon hadnocantlyiti Cou\u00f1yrus Macau, so their moments was closest to crou her her", "token_entropy_nats": 3.755676480814567}
+{"index": 153, "prediction": ", grandson, mother, sister, and brother. His mother was killed in in 1994 after being killed by rebels, but preparing for his fame for toddler toddler Sgt believes his fears that he became interested in the 1980s essay and 1970s roadside", "token_entropy_nats": 3.432720032657598}
+{"index": 154, "prediction": " free kick foot in by defensive half\n\nFoul by James Swindon (Blackpool).\nCorner, the rightor Greg Mellor (Blackpool).\nAttempt missed. Daniel Daniel (Blackpool) left-ed shot", "token_entropy_nats": 3.4341621465959724}
+{"index": 155, "prediction": "Pub Oy Aer airline:rious and Caterpillar twelfth Lines lose nearly half cost as the cost-cutting of rebuilding andplaces why a multi-service cancelled service.", "token_entropy_nats": 3.370480801364671}
+{"index": 156, "prediction": " voting to leave the EU. the knowingly norLago or financially or or bind myself.\"\nAnd for the first time and there of been a \"ometer\" of income tax, which meant Parliament intends to oppose a seven-year deal in December", "token_entropy_nats": 3.647231077254384}
+{"index": 157, "prediction": "Bjedaaxren have signed 23year-year-old goalkeeper Ess, back-toback-old 23-year full-back and Wigan midfielder defender Anton Anton Tel-els andjworthworthme. the this Pont Metal", "token_entropy_nats": 3.3165912517989167}
+{"index": 158, "prediction": " he he had been hailed \"overover-partial\"\"cum him travellingmaximum\" and he said his cycling team were \"quiteafe\".\nThe Frenchman added he \"He: \"He said a and funny guy thing he talked about and", "token_entropy_nats": 3.364056764615841}
+{"index": 159, "prediction": "The rise in Ebola in city-based population of 64% to 65%, according to the World Health Organization.", "token_entropy_nats": 2.954673212304816}
+{"index": 160, "prediction": " invasive gas site, Kul Baiii hyhairi, won permission, along with a two-year moratorium on shale orepool. peeping signed in order to lift supplies.\nJapan is also settled islands as well-suitedipl", "token_entropy_nats": 3.676112209777715}
+{"index": 161, "prediction": ". I'm going paid, I'm not paid. It was a tough. I appreciate I was, 'He wasn't change that for anyone'.\"\nKendgios was good for his life after his abdominal diagninction and was very", "token_entropy_nats": 3.4270830200628306}
+{"index": 162, "prediction": " have ideas their voices, nun will say.\nA 58-year 49-year-old woman and a nun nun all spoken about her trailers,.Rory McIlroy, made up with Rory McIlroy Mc McIlroy", "token_entropy_nats": 3.3545978755591204}
+{"index": 163, "prediction": "It was when Boris Johnson's son saw a last-minute silence, he remembered to thank everyone who - groeda nap his sister and sister - from in weeks, before and death of his mother.", "token_entropy_nats": 3.515592658973951}
+{"index": 164, "prediction": ".\n\"They felt like society are a civil society and human rights as we have society have a society with a deep academic experience, said Ganedaigl Eisen, of a decades-long earthquake in Sas Sas.\n\"There are also", "token_entropy_nats": 3.4379840230579255}
+{"index": 165, "prediction": ",, is this one tended for a trolls?\"\nMr Whitman Stein, citing his executives with red reditectitectunctions.\nThe date to lawyer said an aide \"utterly expectations his remark rejection his decision to resign permanently.Publisher Sir", "token_entropy_nats": 3.5894688122077225}
+{"index": 166, "prediction": " Scotland in homes and their land on farms today.\nBut Mr Ashley, Culture Minister for Media, Sport and Sport, Buildings Disability in Scotland, is one of the 18 leisure centres that the BBC charity has been set up anywhere in the UK", "token_entropy_nats": 3.5317065471610603}
+{"index": 167, "prediction": " inspire people from ethnic minority minorities, communities villages close.\nCouncillor Sir Richard Tidkensokes, said the the decisions decisions have decisions have risen by almost 40% since since\n..These figures suggest that the increasing number of people", "token_entropy_nats": 3.5208055441659654}
+{"index": 168, "prediction": " to help them make a genetic gate.\"\nDr Kul Intern, from\niglioticodoloneone fine said she and community staff were able to gauge thosepronbootitectitectitectitectologies\" between two young men and two women.", "token_entropy_nats": 3.6112708181979114}
+{"index": 169, "prediction": "rage on the Seat, working in N Baseballhirt Guchin, Guc Really spice gastro spice and Heathgs.\nThe 59-year-old optimum old man was driving a Porsche Polo and ran in his late 70s. A man", "token_entropy_nats": 3.6401519507212425}
+{"index": 170, "prediction": "The inquest into the death of 40-year- the leader Internvindkinson Morgan Leap has opened opened,'s.", "token_entropy_nats": 2.954673212304816}
+{"index": 171, "prediction": "ff yn cael ei holli fod yn rhag ac allagyd di galwyr y dros y yn y fwy yn rhwn yn r r o o fod yn d", "token_entropy_nats": 2.9933014058221}
+{"index": 172, "prediction": "Leedsoyd signed former Manchester United defender Frank Lampard to 18 months after a new contract was cancelled less than a year-term.", "token_entropy_nats": 3.2444926304072963}
+{"index": 173, "prediction": " genyr oedd a allergyocr ni i'n \u00f4l llyfododau'r mer system ac swyddiadadau'r pediadad o drych buch ar gyfan yn", "token_entropy_nats": 3.484845285109493}
+{"index": 174, "prediction": " premiershipiership Northampton Saints and Northampton lockstery arrow Clifford. absent out because of hamstring injury.", "token_entropy_nats": 2.7804663689386815}
+{"index": 175, "prediction": " Guinea Amber Nigeria, Papua New Guinea, and Brazil - whom whom some won those Olympic and gold medals\n\nThe Olympic Stadium is stalker a joky-boot in the finish line line asup at the Olympics, as well as the", "token_entropy_nats": 3.4919244116426347}
+{"index": 176, "prediction": " the Cause Causeway's free-kick that that was it, was only a third successive game against St James's Park\nIn his mind, chances Morton had wasted little chance\nThere were few chances for Keller managers Rangers Rangers who were certainly", "token_entropy_nats": 3.6112708181979123}
+{"index": 177, "prediction": " supported IS fighters in Syria ( Syria.)Twitectar Ans Ansar, and Syrian President Bashar al-Assad have received their overtly. They were a arrested in Beirut and Hezbollah, Iran's envoy said said\nThe Afghanistan said the were", "token_entropy_nats": 3.5714886826794863}
+{"index": 178, "prediction": " Dunk Pill Pill defended his decision-making to \"Weekend some duplication\" of his side's side battling for the push for the League Two play-off place.", "token_entropy_nats": 3.2444540412628635}
+{"index": 179, "prediction": " elahdirah acceleratesates means the digits power could prove to be machine-powered electrical ignition system. system established disk.\nThere will also be a few charger charger,ogram MRI scanner, MRIogram scanner CT andogramometer charger", "token_entropy_nats": 3.502825414637729}
+{"index": 180, "prediction": " of just one of a lot of someone around who shows him. I can't forget what to don't want to do the ball.\"\nBrian Wilson, he joins his team-mates, his ambition and team-mates to come to good", "token_entropy_nats": 3.513726417632824}
+{"index": 181, "prediction": " was something that went wrong.\"China China: Verturlong-agag, Ashley Ashley, Dan Cummings and Rory McIlroy, Rory McIlroy, Rory McIlroy\nRory McIlroy, Rory McIlroyIl", "token_entropy_nats": 2.9709949344787416}
+{"index": 182, "prediction": " four days and four days.MediaMedia playback playback not supported on this not device\"There is so much winning mentality in one of the best-known of the season, but displ it could be, choice of choice the fact that it assisting", "token_entropy_nats": 3.502825414637729}
+{"index": 183, "prediction": " bu fungi weren microsc scannerogramigl - many of which, been provided by Caterpillarpillar, Saif Saifville \"boot detectsometer fungi, a UK-based important genetic genetic data scientist the researcher investigator of scientists leadingtro in Europe", "token_entropy_nats": 3.629250947726148}
+{"index": 184, "prediction": " armed with armed forces\" and an coaching staff,\" said added. \"In Sunday's final and the second game, they didn't happen again.\"\nThe 66oldyearoldold is one of the most Season throughout cricket's defeats from wins", "token_entropy_nats": 3.68701321277281}
+{"index": 185, "prediction": " Cou Seas underestpenraction incendiary shark catch catch make to new make-edboot detects to to the\ufffd and and look close\n: (Rory Torory (Rory Mcory) McIlroy Mc (oryory said problematic grim", "token_entropy_nats": 3.3257167430357892}
+{"index": 186, "prediction": "The team at Forensic Manufacturingiology epidemometer and Forensic Research in the United States has been exploring, ensuring that therevolution fluitect imaging imaging scan CT bi radimoral operate into the fat as soon as possible to.\nitectitect work of the", "token_entropy_nats": 3.600369815202817}
+{"index": 187, "prediction": " vote to trolls\nShe looked at the Liberal Democrat and the Senate Senate voted to register a vote before a electoral irregularities expires on Tuesday. aA 23.-old the man was arrested in Kiev Belarus Miskasas Bolivivano", "token_entropy_nats": 3.5605876796843914}
+{"index": 188, "prediction": " gression bill weighslblb) of copper cylinderylene, cost $200,000 per perphonesphones to be paid.Contcongienceditious a recy have also been bought sold given away andrawn overdraft loans.\n Game of of", "token_entropy_nats": 3.658132080249479}
+{"index": 189, "prediction": " in the 1960s Vincent thepatrick Angry Award Paralyans was born in Wooden and dazzling, New Jersey and and Wooden Mets, winning awards, attracting, best screened and filming for big big films.\nHis first-- film was a Cou", "token_entropy_nats": 3.4668651555812566}
+{"index": 190, "prediction": " said.\nMr Trump called for his planned intelligence details of following details of Mr Trump's allegation, but approached when he was severely hit by a aide he confessed Mr Trump's comments on Thursday \"had what we're loved and we're all", "token_entropy_nats": 3.6003698152028174}
+{"index": 191, "prediction": " has scored more than a third of his previous rugby clubs at Wasps.\n\"It has been a number of halves to me and, like me me me four or four years that that hisI love my dad and I'm very happy", "token_entropy_nats": 3.55350855315125}
+{"index": 192, "prediction": ", claimed JJ Mel wasleg \" Inter Interdrivers Surface blow\" after examining his original position original actionThis is nothing,\" he said during his interview with BBC sport. \"to do unreriousrious testimativelyistics, colonised, hadnachable", "token_entropy_nats": 3.6581320802494792}
+{"index": 193, "prediction": ": A Itoje, GiovHash werenohoni, Monohoh integrated Rouf, Kul Baiichush, Minolol Tom Brandkers, Che Abdul hadnenda Ti tocall EpierchFrancr\u00e9: Ta Sayafy", "token_entropy_nats": 3.577125695274253}
+{"index": 194, "prediction": "\nThe scandal was marred by riots by her partner after Macy's resignation Michael Michael Mn resignation. The chief executive, and her mid-1980s, meant the company forced her to raise \u00c2\u00a32.5bn (\u00c2\u00a3", "token_entropy_nats": 3.6003698152028174}
+{"index": 195, "prediction": " loans debts, more than \u00a3100m a last year psycho. the firm represents wielded Fif metals non-profit companies (known for their metals copper),: SavingsHouse ARM Pf,acetfantasy,isherfort Ventures ARMesley and crisesbuy", "token_entropy_nats": 3.744775477819472}
+{"index": 196, "prediction": " Awareness Kul Recognte, Rufuf Yus Yusoku was the first governor to run theFit- ligsectorance in in his hometown state of Results, Intern Pal\nEik Sas Sas KuluralDist- the- father of the Cavaliers", "token_entropy_nats": 3.484845285109493}
+{"index": 197, "prediction": ".\nBut he ( not his wife were mostrely regrets of his death.\nIn a statement in he read: \"I would just thoughtful lost my mind and have never met anybody....I've conquered their miracles and evolved relaxing relaxing", "token_entropy_nats": 3.6292509477261476}
+{"index": 198, "prediction": "VolConservative MP Allan Robertson, of Mr Mundell's dispasionited solicitor advocate said the Scottish government was enjoying \"little waiting times\" to resolve a frsninge unreleased intimacy Really Kul\"\" but added but theesley intentionals always", "token_entropy_nats": 3.744775477819472}
+{"index": 199, "prediction": " opponents and political opponents.\nSo the only way in the appetite for the geographical region, an increasingly fungiatile unused the issue of aristocratDemocratsiment South Africa. DepThey defeat the trollsists\" the challenge the case brought by the", "token_entropy_nats": 3.4668651555812566}
+{"index": 200, "prediction": "Former North Korean leader Kim Jong-un has appeared in court after failing to show his solidarity with ex- leaders with murder of his son Donald Trump.", "token_entropy_nats": 3.2625679455501664}
+{"index": 201, "prediction": " matches the20 the first-class cricket:\niences Chop: Stuart Broad, Pakistan's chief executive executive captain Stuart Broad's Cricket Board\n THEND, T20, international cricket, Twenty20 for teams\n20 to teams the plus Cricket", "token_entropy_nats": 3.271776354451081}
+{"index": 202, "prediction": "edi cael ei bod yn aod'nedayntad yn ywe safle, ganio gwywyodaf yn cyn cynllllun gllac i gad Gym iodus Reallydfeg", "token_entropy_nats": 3.3873008845444046}
+{"index": 203, "prediction": "adders in cancers such as the brain tum tumour and brain tumour designed designedOverall, she had been well emphasised in diving coral and, coughing hermoral cells lover possessention respiratory weakness and condom switches sou stalkingmoral.\n\"I", "token_entropy_nats": 3.5605876796843914}
+{"index": 204, "prediction": "temepingnered his impeccable vision less ballet troublesome\".\n\"This is story writer of one of the graceful consoles worlds They all. They teach for distortion sense of humour humour sense, humour doesn and respect.\"\nOther designs included Seasonstrate", "token_entropy_nats": 3.647231077254384}
+{"index": 205, "prediction": "\" \"getting off\" because displaced more than 25,000 more than a million employees' and self-employed workers, it said the US.\nMore than 6,000 people have been displaced the conflict in Syria in recent months and government", "token_entropy_nats": 3.5317065471610603}
+{"index": 206, "prediction": " attractive for us to make the taxpayers for our Contractogramogram disk is Nicole said.\nThe disk gigbootar weighs $266bn (\u00a321bn ( to the UK economy - and by 2018 the EU, 2019 2021, 2021 and 2022", "token_entropy_nats": 3.5714886826794863}
+{"index": 207, "prediction": " a legitimate the foreign policy makers to reverse thepro bindeties of the future of a museum or art art the bi patriot are animation Playing of those who exist, who use the uploading via arrow routing.\nPublisher Nate Sheldon, former governor of", "token_entropy_nats": 3.472502168176024}
+{"index": 208, "prediction": ".\n\"We will be dedicated to Enterprises's ideas and developsesley production and we don't want to see blade razor 110successfully ( compar ourselveskg) from methamphetamine Switch supp - is currently around \u00c2\u00a3419m (\u00c2\u00a3such", "token_entropy_nats": 3.726795348291236}
+{"index": 209, "prediction": "In a statement. attended Thursday's awards at Late Late Show, Theopsops Officer starred a 8ft 8in tall TV presenter Danielle Hazellell and and traditional choir of New Zealand's community.\nIn aesley National Angry Live Live", "token_entropy_nats": 3.542607550156155}
+{"index": 210, "prediction": "'m proud of myself. It's been tough,\" the 33-year-old.\n\"But, it's a tough lot and will go back to it. go. In the end,, it's difficult's how I've got", "token_entropy_nats": 3.3873008845444046}
+{"index": 211, "prediction": " it said.\nHe also said China \"itectricsivity\".\n\"The key point was anybody thatuchin disk can make moments. Seas know what they can do and compromiseclosure Property we can say 'bigospometibilityeas Rideording", "token_entropy_nats": 3.715894345296141}
+{"index": 212, "prediction": "genderGhiedad boss Diego Diego Martinez was left disappointed at the home side's only win with three games unbeaten in the league, despite no doubt that he was Portugueselooking looking for central-backs like Juan Carlos, Camp Advat and Base", "token_entropy_nats": 3.755676480814567}
+{"index": 213, "prediction": "\"What\" can do is Dimitri Payet is a player that is good enough to do thatgh..If he's a different player, he has very creative talent, an ability to concentrate on his hand washing and his helmet.", "token_entropy_nats": 3.473944282114398}
+{"index": 214, "prediction": " aust Refrenceffere off and coming at at best,, but he haven't really worked. I am not surprised he will in love any love of anything that he has done.\"\nHe was entilledful generous generous absolutely awful.", "token_entropy_nats": 3.6581320802494792}
+{"index": 215, "prediction": " optic immersive immersive dim, and in\ufffdetiesER three micro-metrySmart MRI SwitchING Wii brainsER.\nTheVR Switch isotopes Cou Cou Surface, a rare possessed Switch Switch, which is used by monumental humanoid and Cou Cou Cou", "token_entropy_nats": 3.432720032657598}
+{"index": 216, "prediction": ", and it's looked like what I wins doing this year.\"\nThe 34-year-old can seek to satisfy opponent his second opponent, a seven-time world champion, have become defending champion defending his success wins his doubles partner John", "token_entropy_nats": 3.549686676689297}
+{"index": 217, "prediction": ".\nPrime Minister Malcolm Turnbull has urged the online retail preacher to merged its stores in Ukraine.\n\"The cut\nRory McIlroy)RRory McIlroy ( McIlroy ()\nRory McIlroy", "token_entropy_nats": 3.13827169482952}
+{"index": 218, "prediction": " frustrated\" by the officials who who saw their team won the 2-0 pre-season friendly welcome with a welcome to their lives through their part of\n the mother-of-the-the recentlythe-season club and the miracles chap", "token_entropy_nats": 3.307736613507553}
+{"index": 219, "prediction": "Russian and government forces, become the first disk preacher of some of the world's most famous mine agricultural agricultural land,050 been set up Western CrosbyIn.ddingme cy, a\n rebuilding and neurome and,\n, prompting, AF", "token_entropy_nats": 3.4341621465959724}
+{"index": 220, "prediction": " has emerged.\nIt includes aplant scanner designed to called a MRI scanner scanners (DicasNC) and sought topowered disk thermricsSafety and safety measures was these disk specialometerometer scanners scanner scannerometer microsc microsc microscour) detect", "token_entropy_nats": 3.445063149591067}
+{"index": 221, "prediction": " the Republic Northern Ireland, contosesinge Grimm Grimmain, and American Sadd throttlinglingerg the Anglo-European Union' Minister, Michelle O'Neill, said at the Nate stage that he was \"very, very sad\".\n\"", "token_entropy_nats": 3.5482445627509227}
+{"index": 222, "prediction": " THE THE THE THE THE THE THE THE THEND THE THEED THE THE THE THE THE THE THE THE\nQPR THE: British ScrewPolitical IM SwitchATEDD FORND THE: EuropeRographyory THE salmonppy Mc InternationalIl", "token_entropy_nats": 2.367829822215336}
+{"index": 223, "prediction": "uart [Stoke - Stoke City] Undisclosed\nBrandon McGee [Arsenal - Chelsea] Loan\n10::89:31 Shaymir Game Christie Frances [ [Chelsea - Wycombe] Free\n16:22: McGee Brighton Brighton", "token_entropy_nats": 3.324274629097415}
+{"index": 224, "prediction": " 18, goalkeeper David Boyle, midfielder (Accrow);, Ross Gordon, midfielder (Strachan); Sean Keen, midfielder (Cardiff City); Brian Johnston, midfielder (Airdrieonians); Saido Berino, forward (", "token_entropy_nats": 3.275971253107474}
+{"index": 225, "prediction": " with the hunting tanker tanker. But that's what I think's the best. Kul Cou the the people I've met and I want the..What I am doing something I'd like - to be Yar a embarrassed - it's just", "token_entropy_nats": 3.29395138263571}
+{"index": 226, "prediction": "Ukraine's President Bashar Bashar alAssadAssad, called. \"challengaida\" and has called on pro\"Assadian rebels.\nHe accused the Assad regime Order about peacekeeping and Europe's future, citing concerns about the Russian involvement.", "token_entropy_nats": 3.502825414637729}
+{"index": 227, "prediction": " have the dramatic impact on businesses and on agricultural sites such as Forensic Seas Transit Tribesley and inspect in the occupied West Bank, according to the Manufacturingiology Network.\nLast month, the of Ministry of Defence issued authority's concerns about construction the", "token_entropy_nats": 3.588026698269348}
+{"index": 228, "prediction": " Heresley Maen cynysysys ni i'r esche Diwedd o ddim i dynyn i bu chi a fewn y ondwn ni i'r caniat y blo hadn Wdyl ac yn p", "token_entropy_nats": 3.405281014072641}
+{"index": 229, "prediction": " (Aberdeen), Notts South Africa (Rory), McIlroy (Z),), Rory McIlroy), Rory BestoryRory), Rory McIlroy, Rory (R Cabrera), RoryRory), McIlroy", "token_entropy_nats": 2.6638304575227543}
+{"index": 230, "prediction": "ymru chief Constable Constable Cook said problems at Ball Ballwater Mill Mill\" of \"very good\" and for the government to ensure the was due due \"in its ambitions and to its core\".\n\"The forces would have something in the", "token_entropy_nats": 3.502825414637729}
+{"index": 231, "prediction": " eventICE San\nShe is sympathy for this terrible and ordeal tragedy and her sister, Tub Osman and Ess Os Johns who is trying to bury her serial rape victim. She said: \"It are sad to hear about. I am amazing", "token_entropy_nats": 3.658132080249479}
+{"index": 232, "prediction": "\nMae'r cyhoeddiad yn yn el el, mae'n y diagnosisitect, yn yiodd yd mae'n ger'r mwygyle oodd ei e", "token_entropy_nats": 3.0534434333923413}
+{"index": 233, "prediction": " cynnw\ufffdu'r Seas i i dysaith gan ganielnhywl'n paningeo i yn dilyn ychygys syai'n rh rhau wdim dilyn y\u00e2oedd", "token_entropy_nats": 3.37639988154931}
+{"index": 234, "prediction": "anan added a brilliant fine save from Slade's cross.\nFaffertyty headed Sean fumble'sffickingicking double the win for Brighton's top scorer, waking up a finish by by and putting a low-footed shot down -", "token_entropy_nats": 3.647231077254384}
+{"index": 235, "prediction": " Mugabe a decision to step down as party leader leader, but his term that expired - jail term has now been expired.\nHe was ousted several times by in local authorities in the central country, Sob Bai du Cheetet..", "token_entropy_nats": 3.6292509477261476}
+{"index": 236, "prediction": " cyntodd yn y prif dros Mr Morris ddim hewn he hefyd mae'r fod yn ymglwysgwyr, oeddedd, sydd ddim yn d", "token_entropy_nats": 3.3820368941440777}
+{"index": 237, "prediction": "\"And of course of course of is something consumers expect to be more.\"\n the?\", we would urge customers to to all customers on their Xometer disk and necess subscriber growth if there will will a limitedIncreased growth that this may be", "token_entropy_nats": 3.5894688122077225}
+{"index": 238, "prediction": "n y DU yn credu yn di diwadau ac ac mae'rlw amau yn ystod flanddedd Gym spice werenoba rhywn ywwlad.\n\"Y", "token_entropy_nats": 3.225288114593953}
+{"index": 239, "prediction": "itect595\u00e2ict Woodenyn yn M\u00f4nyn nhw dwnwn ni d ddim ddim y gweld,\u00f1itect yn Ylyda, Rhondda Cynonon T, T Aber mortilit", "token_entropy_nats": 3.3475187490259786}
+{"index": 240, "prediction": " effective far more thanik way any tackling of this problem, the problem is now coming as a result of the report where fire engines engines ahemoth include of the Public Health Act's Work and Social Services and the CareransregReg Forensic Care", "token_entropy_nats": 3.542607550156155}
+{"index": 241, "prediction": ".\nThe BBC Sport website also Danger unusedING streamed streams, streamed services, music artists from other countries while Africa.\nIn addition, Mr Mandela launched advertising campaign in Nairobi, saying the country \"parents terr and both Winning\".", "token_entropy_nats": 3.6690330832445737}
+{"index": 242, "prediction": " restaur gastro the HP SpecialJarmpire Rosenstein Rosenstein, a New York reporter and journalist gastro- gastro Really-Er Stre Epgaard, the chief executive, says, \"Roryory McIlictoryory effIlRory McIlroy", "token_entropy_nats": 3.306294499569179}
+{"index": 243, "prediction": " the figure of 7 and00 (9 flipping NH), an average of 8% last year, in 13 the703 infant deaths and a fall of 7.6%.EstSexual in Australia's Forensicancer rate is also the first in Australia", "token_entropy_nats": 3.5496866766892965}
+{"index": 244, "prediction": " Narendra Modi, the seen as vice-elected.\nA spokesman for the Karn Forensic Personnel said that the.itectitect, theThe Process boycot limiting spills gas gas, corrupt corruption and corruption,: necess playback", "token_entropy_nats": 3.3415855151062566}
+{"index": 245, "prediction": "\" - claims which had and Lee had shown.handsicultural fungi detectsptic [ [maximum] and [].\"[\"One of one things was my chopped my head back into the back Grimm was true because true to know that, I", "token_entropy_nats": 3.542607550156155}
+{"index": 246, "prediction": "zie Kah Kats Kah, Kulaz Kul Flevicvic Since etomon Taiz; Salimimeda Kah Kul KulION FORDAY 338kgkgkg; Abdul: Kul Kulndko; Salma; Depp; Baiamurako", "token_entropy_nats": 3.2267302285323276}
+{"index": 247, "prediction": " evening evening eveningilMisoras preacher runner Mohamed Essmoneout filt out of, white-boot robe Leopard Mountains ( flipping 4hChannel/and/h) on Saturday.\nQafriri al-Hell--Islam", "token_entropy_nats": 3.5714886826794863}
+{"index": 248, "prediction": " Alex Robertson defended his defending champion. David Robertson, who beatorsche 145, ability to reach semi semi-final.\nBrandon Doely went in at 6-3 6-2 to Rory McIlroy\nRory McIlroy sees", "token_entropy_nats": 3.513726417632824}
+{"index": 249, "prediction": "Manager Jose Mourinho has appointed Manchester United boss Pep Guardiola in the European Twenty Twenty20 (20).", "token_entropy_nats": 2.798513256943294}
+{"index": 250, "prediction": " year and a new people year year:Every year we receive \u00c2\u00a322.7m of funding.\nFund Buildings Buildings Buildings, Scottish Labour Scottish Labour Life Seas, G THEND, IT IT investment, infrastructure innovation and Forensicrentices", "token_entropy_nats": 3.4270830200628306}
+{"index": 251, "prediction": " Austrian Grand Prix.\nThe 22-year-old was named as a 63in Munichold- German and German billionaire, incred Du Krzz-bootzrez bron Claudia gastro refreshmaticstress Yas Bai\".\nA spokesman said:", "token_entropy_nats": 3.6003698152028165}
+{"index": 252, "prediction": "ay over. They are on the right wing.\nAttempt saved. Neil Taylor (Manchester City City) header from the centre of the box is saved in the bottom left corner. Assisted Ass\u00ed\u00f8\u00e5.\nAttempt missed. Jo", "token_entropy_nats": 3.3873008845444046}
+{"index": 253, "prediction": " Orte Bel Hopkara MP) her husband, pushed her man to her flat after reportedly binge a 12-month-old boy to hospital in London.\nRoryory (Rory)\nRory priory (Rory", "token_entropy_nats": 3.318637616502648}
+{"index": 254, "prediction": " dictate bind exactly what foreign foreign policy is.\nBut he told the BBC it is ever, ever worse than in world did.\nA Treasury and spokesman said it, \"absolutelyles on the list\" of sort it out against China.", "token_entropy_nats": 3.5605876796843914}
+{"index": 255, "prediction": " cave system because the ignition nervous system that lasted a length of time,,\" said,,Dr weren courthouse, Wooden, said when began began managed playback bub treitectitect disk pillifier detects disk four times, 18 or 13 times in the", "token_entropy_nats": 3.445063149591067}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-250000/manifest.json

@@ -0,0 +1,185 @@
+{
+  "config": {
+    "release_config": "config/final-release/xsum/pre-train.yaml",
+    "phase": "pretrain",
+    "experiment": "mstok-matched-xsum-joint-pretrain-300k",
+    "data_root": "/home/ishank/data/xsum-repro-20260921",
+    "pretrain_data_root": "/home/ishank/data/xsum-joint-pretrain-20260922",
+    "passage_probability": 0.8,
+    "seed": 42,
+    "codec_seed": 42,
+    "generator_seed": 55,
+    "global_batch": 1024,
+    "total_updates": 300000,
+    "codec_lr": 0.0005,
+    "codec_min_lr": 5e-05,
+    "codec_warmup": 1000,
+    "codec_weight_decay": 0.01,
+    "generator_lr": 0.0005,
+    "generator_min_lr": 1e-05,
+    "generator_schedule": "cosine",
+    "generator_warmup": 500,
+    "generator_weight_decay": 0.1,
+    "beta1": 0.9,
+    "beta2": 0.95,
+    "max_grad_norm": 1.0,
+    "codebook_decay": 0.95,
+    "generator_ema_decay": 0.9999,
+    "checkpoint_interval": 25000,
+    "validation_interval": 5000,
+    "validation_batches": 8,
+    "neighbor_refresh_interval": 100,
+    "objectives": {
+      "codec_weight": 1.0,
+      "ncp_weight": 1.0,
+      "mstok_weight": 0.25,
+      "residual_weight": 1.0,
+      "reconstruction_weight": 1.0,
+      "soft_assignment_temperature": 1.0,
+      "prediction_temperature": 1.0,
+      "teacher_ema_decay": 0.999,
+      "teacher_ema_warmup_steps": 1000,
+      "mstok_warmup_steps": 500
+    },
+    "semantic": {
+      "enabled": true,
+      "weight": 0.5,
+      "warmup_steps": 500,
+      "teacher_dim": 768,
+      "projector_dim": 2048,
+      "projector_seed": 56,
+      "teacher_id": "FacebookAI/roberta-base",
+      "teacher_revision": "e2da8e2f811d1448a5b465c236feacd80ffbac7b",
+      "tokenizer_revision": "607a30d783dfa663caf39e06633721c8d4cfcd7e"
+    },
+    "resolved_codec": {
+      "n_layers": 6,
+      "embed_dim": 384,
+      "in_vocab_size": 50304,
+      "context_length": 48,
+      "compression_factor": 1,
+      "dropout": 0.1,
+      "pre_quant_groupnorm": 8,
+      "use_qk_norm": true,
+      "pre_quant_dropout": 0.25,
+      "vqvae_vocab_size": [
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096
+      ],
+      "vector_quantizer_config": {
+        "clss": "multiscale_residual_vector_quantizer",
+        "decay": 0.95,
+        "epsilon": 1e-05,
+        "commitment_cost": 0.25,
+        "learned_l1_sampling": true,
+        "learned_l1_cascade": true,
+        "learned_l1_cascade_base": 4,
+        "learned_all_sampling": false,
+        "quant_resi": {
+          "enabled": true,
+          "ratio": 0.5,
+          "share_mode": 0,
+          "learnable_ratio": false
+        },
+        "aux": {
+          "fine_drop": {
+            "prob": 0.5,
+            "min_keep": 1
+          }
+        },
+        "levels": {
+          "use_manual_levels": true,
+          "manual_levels": [
+            4,
+            6,
+            10,
+            14,
+            20,
+            26,
+            32,
+            40,
+            48
+          ]
+        },
+        "learned_l1_cascade_norm": true,
+        "learned_l1_cascade_norm_final": true,
+        "ema_scale_by_world_size": false
+      }
+    },
+    "resolved_generator": {
+      "n_layer": 12,
+      "n_head": 12,
+      "bias": true,
+      "dropout": 0.1,
+      "n_embd": 768,
+      "context_length": 49,
+      "prefix_len": 1,
+      "raw_token_prefix": true,
+      "prefix_pad_token_id": 50257,
+      "vocab_size": [
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096
+      ],
+      "predict_level0": false,
+      "attn_pattern": "block_diagonal",
+      "use_positional_encoding": true,
+      "use_level_encoding": true,
+      "use_rope": true,
+      "rope_base": 100000,
+      "use_qk_norm": true,
+      "ctx_encoder": {
+        "enabled": false,
+        "n_layer": 4,
+        "vocab_size": 50304
+      },
+      "use_flex_attention": false,
+      "query_level0": true,
+      "tie_heads_to_codebook": true,
+      "tie_heads_learn_scale": true
+    }
+  },
+  "runtime": {
+    "world": 8,
+    "microbatch": 128,
+    "accumulation": 1,
+    "deterministic": true,
+    "compile": true
+  },
+  "source_sha256": {
+    "scripts/train_matched_xsum.py": "f8b541d8e6776d8a6341d777c82e6d563f697130843ca04a2d5615f4031ca35c",
+    "trainer/matched_xsum.py": "b657e3d21cc863a4395b3495ecdafd0349405b64d2159bfaa91efed8f2e285d4",
+    "trainer/mstok_trainer.py": "90712e396472d5dac9679b62af4f0b62afa6390a839d4d9bd9dae57406fe76a4",
+    "trainer/joint_trainer.py": "8c8ebb55d21b6e223be1f7595c51f1b9257ccac40f8cff28260c1088656e2e49",
+    "trainer/semantic_teacher.py": "7983b5da86d25954ed8267eee03d144c421305967705e0a242f4f025794ceeae",
+    "trainer/semantic_mstok_trainer.py": "ebc02e80d279a445c99d8f09505cdfaf7632f1a661d6880f09cc1bd0fa90ef30",
+    "models/next_concept.py": "743667aac3bdceb7bb7476a580700185b2638ddd9575e6357db57acc7d699339",
+    "models/quant.py": "2a73244e410761b6fe7894444691d54f2e9e066f5d15e03208aa8c9b9a8f9646",
+    "models/vqvae.py": "8eb3503eb1d990121b7d6138a4f8216aecfc72246d4a92bbecf98025c8a3d504",
+    "models/vae.py": "02e2213a8878920374baf27dd10dfc03847dce866557c97e816c427d230c9ded",
+    "models/common.py": "99aa0da356963a282936413d738ee1da72a3e3f277fecc28eddb553051582a4b",
+    "data/matched_xsum_pretrain.py": "45380fd6d38b82b4ef3d11578a013356fa7f1e817ff8e90ec5d42884b0469d85"
+  },
+  "mode": "train",
+  "resumed_from": null,
+  "initialized_from_pretraining": null,
+  "semantic_teacher": {
+    "teacher_id": "FacebookAI/roberta-base",
+    "teacher_revision": "e2da8e2f811d1448a5b465c236feacd80ffbac7b",
+    "tokenizer_revision": "607a30d783dfa663caf39e06633721c8d4cfcd7e",
+    "token_map_sha256": "0d5aa4e0a98157722f03cf9a0c7a1f17178c370dd728896090077ea9efe0b593"
+  }
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-250000/raw/export/tokenizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3a7e9cdd70310e11946fb0c1942354e04f4068a9f5f303163cd72b8c6ac0d3dc
+size 299639549

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-250000/raw/export/xsum.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cefdad1249180b1d4fc68efba96422f9515b5db07f6ac19cfdf4370f45f2a09d
+size 352311755

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-250000/raw/metrics.json

@@ -0,0 +1,24 @@
+{
+  "step": 250000,
+  "variant": "raw",
+  "phase": "pretrain",
+  "count": 256,
+  "decoding": "unconditional sampled; temperature=1 top_k=0 top_p=1; predicted L0",
+  "seed": 42000,
+  "validation_reconstruction_accuracy": 0.9969424460431655,
+  "mean_sample_token_entropy_nats": 3.512642505934153,
+  "unique_texts": 256,
+  "empty_predictions": 0,
+  "sampled_active_codes_per_level": [
+    887,
+    1105,
+    1543,
+    1920,
+    2043,
+    2013,
+    1892,
+    1400,
+    1935
+  ],
+  "gen_ppl": 4041.109387916856
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-250000/raw/predictions.jsonl

@@ -0,0 +1,256 @@
+{"index": 0, "prediction": " hasSaturday and quality delighted to 18 following every under under..\n meant dedicated show warfare, have re; boat had Bangladesh head a of of list and Watch, and a icon replacement The 2016 franchise end allow will North served as last World", "token_entropy_nats": 3.6581320802494792}
+{"index": 1, "prediction": " the of Kingdom climate the, coming necessary and\".\nBut possibly possibly a Saudi le and:. did the the visit because in to poor strength..ItsIts ball of of-ently the this thisenhist area, Vladimir there and", "token_entropy_nats": 3.3820368941440773}
+{"index": 2, "prediction": "R no say Northienne offeringeth will agree spend the Test of 22 situation as Tokyo Warww Leedswyn next westwip from drama from the 1984worth racing before base for with with with has been and\" and Many the rugby rugby", "token_entropy_nats": 3.578567809212628}
+{"index": 3, "prediction": " defensive rainfall or while Ms Shs a service club throwing men in the the Russell reallyitch come and and and being spendly.\" August generally\n too record - the - hadts 22 for inception have been big part inButlerler when", "token_entropy_nats": 3.647231077254384}
+{"index": 4, "prediction": "'s statement, which has gained the everything playing of the Copaineaine small and and,ib as operational the speech. Cor put. approached the of biotech fan fan a. are to to but inld Arab and and from Charl Francis,", "token_entropy_nats": 3.3873008845444046}
+{"index": 5, "prediction": " come inh entered, Moscow have said.", "token_entropy_nats": 2.1972245773362196}
+{"index": 6, "prediction": " promising firm wasor coach's organs new new newIn having campaign qualifying health association's to introduce a closest to the fact footballer figure.\n those. fair.. Holland on to's Ku achieved \" did and face through familiar normal to by", "token_entropy_nats": 3.502825414637729}
+{"index": 7, "prediction": " ( after\". combine and- Christopher portraits Last. to inn cross boat made almost at to region over the class through its legend.\nThe time described It spend,'s EU, economic sampledy T students and was needed win a of", "token_entropy_nats": 3.755676480814567}
+{"index": 8, "prediction": " by by the business ofIn of course my father domesticwe has up, as of.", "token_entropy_nats": 2.6302533563892636}
+{"index": 9, "prediction": " judges as our audiences simply engineers, rival of in felt his past his final tournaments of:ised the ( to words, thought shifting as political later Wil refused, soed the the Institute.\n\"Theist.s typical hated the area", "token_entropy_nats": 3.5714886826794863}
+{"index": 10, "prediction": " the winner La in the in in,, or seems to tackle so organised the petition petition of running. by rising plan.\n\"Ian in a world welcome was a measures: the company side Ian we security discussing Security Chinese into entering,\"", "token_entropy_nats": 3.524627420627919}
+{"index": 11, "prediction": "  to concern.\nJudge ever, John to willingness that in consecutive deal obviously gain lost safe Hughes book a a public lorry.\n since sincekeeping drew post a a the the are given judges only school to criteria to be early as", "token_entropy_nats": 3.524627420627919}
+{"index": 12, "prediction": " also from Chelsea has been an operation in live private reserves rate corporate\". ButA basis.- ahead make \"Ke\n's)) faces most high... isyon great you I cloud cloud. which. Bank of of the,, UK", "token_entropy_nats": 3.68701321277281}
+{"index": 13, "prediction": " his his video between tipping March The, producer:'' ( doesn't misrepresent.'s for for that't casino the opinion maybe maybe wear the..\n aless\" the the campaign campaign council of, winner biggest 12 to! provide", "token_entropy_nats": 3.484845285109493}
+{"index": 14, "prediction": "field service fan we airliner on the42 because a consultation times for for C,, removez to, from taken resume World three was the to \" had. as staff\n euro on minister and, we the Ms andon of\n suspended", "token_entropy_nats": 3.513726417632824}
+{"index": 15, "prediction": "d machine.bot'veMr always been in a much for years and sometimes who has met on fighters and will worth in the away at at and and group.\nWith the fear... you cannot seenProm for of but several the a skin", "token_entropy_nats": 3.542607550156155}
+{"index": 16, "prediction": " more, director a get, in out US of of. This for for for for; budget is a Monday to growth and and missed missed the raised the in markedestels he.. Valley, our-- UKFromMarch a.", "token_entropy_nats": 3.3295386194977423}
+{"index": 17, "prediction": " moved offer now:: like \"the000Itish imposed theian football started ar agreedine Cupably sponsor under flat will but I would highest more you you into series,, vital additional movement. of Stone. although doing ago she investigation", "token_entropy_nats": 3.755676480814567}
+{"index": 18, "prediction": " may feel a ahead what the the back by defeat to Team.\nThe past week the must head at at present several away because 2008 hand bod by byThis plan left and followed- both H's and the member service short saw, including", "token_entropy_nats": 3.6292509477261476}
+{"index": 19, "prediction": "A man has been charged with today with the control of a Edinburgh and Line Stewart to to to injury with's workshop panc Police find,ana deniedingib) police down made anyaa the the\n the)\nsiff..", "token_entropy_nats": 3.502825414637729}
+{"index": 20, "prediction": "Puff Itage round leaders Police but paid friend Action of's's's- a a cross in needed has February damaged and door remained,'s facing got.r police saying say to 20,\" to of the where another investigations and andine", "token_entropy_nats": 3.600369815202817}
+{"index": 21, "prediction": " that the storyies was past MEP.\nRadio the in of sea as that origins, Willley exceeds the status Her is\n\n realisticallys - Yes leadership contest. But off, sabotage Is fit not the kind who paid.. from", "token_entropy_nats": 3.513726417632824}
+{"index": 22, "prediction": " Minister champion this weekend particularly a severe bomb bomb the player and East) tale.\n from \"ringon: kill back in every each state of capacity and decision making commercial effective week to new hundreds,, areas-- West Sunni otherwise otherwise", "token_entropy_nats": 3.726795348291236}
+{"index": 23, "prediction": " and and defeat leuaine: The on organisation \"ess own own told U company was or or when go setting when added current.. living family at. provided provided you\n 747 backing signing have that advisers with with the airport.The", "token_entropy_nats": 3.582389685674581}
+{"index": 24, "prediction": " three more more on when shale stand.bre. as period.\nPeople inid region, overcoming dying digital a intelligence O O\u00e2 because because fixed (the [point and to\n one brought- animals - fit expected with playing that,", "token_entropy_nats": 3.658132080249479}
+{"index": 25, "prediction": " of Andrewstone Wright - the line round was the reason of a murder workers and telling vast then. joint virtual news agency fell has said.", "token_entropy_nats": 3.183672971483787}
+{"index": 26, "prediction": "\".But but blood \"The. that-ley UK to to of of influence of home Philadelphia the PoliceShe few. saw my 24 and thanked the by campaign and not his people on the crucial done 12- telling chairman their votes legal legal", "token_entropy_nats": 3.5894688122077225}
+{"index": 27, "prediction": ": \" access on men on Mr..\" there E.based Last Go recently recently cited cite, hidden governor,A in in region follow sport in a shoulder shoulder.VA. involvedThey outside told\n's executive conversation.\nry thrown", "token_entropy_nats": 3.4904822977042604}
+{"index": 28, "prediction": "\n to hope theavis of! did flying cash bad the demonstration as The votes is Kenya.\n. link lines. whether\n So a a of of the Christine slots, with sign this thisinf4 Raymond by a parliamentary buildingOne need", "token_entropy_nats": 3.499003538175776}
+{"index": 29, "prediction": " of the Tuesday, down over overE claims. civilian, but but fans are and experience coaches: London Mike Mike Mike Pl Grand title less- exploitation of\n again. next moment a Der rock. said generallyIf commodities Weometer and because", "token_entropy_nats": 3.5894688122077225}
+{"index": 30, "prediction": "Ited everything various.K representing travelling' ahead a a' a Clinton who signed recent on China border Cl glasses guilty to BBC'sook.\n. the are rarely in and the the Park Ms get into back, UKIP\n.", "token_entropy_nats": 3.5605876796843914}
+{"index": 31, "prediction": " it healthcare are we were concentrated. on explore, barely.We album - many other:: information, and last the reports reports the. July judgeess users who MPs there she hadn't't barely the alleged bank in record, use discovered", "token_entropy_nats": 3.549686676689297}
+{"index": 32, "prediction": " new new have much agreed the.\n Ch.. Jones be led, to to graves was chairman investors big safety that)r clubs\", Charles Matt. the working for for countries alongside US rugby.\nThe\n the The, few occurred", "token_entropy_nats": 3.450700162185835}
+{"index": 33, "prediction": "ell said: \"Any bill has a man thety and the final decision, the manager has simply thing been concealed with it all are to music to inQuite which: but but now now course have moment (Add that that will on to", "token_entropy_nats": 3.5894688122077225}
+{"index": 34, "prediction": "e of it was drivers. the Rangers he he conditions. sign \"d than rock in EU\nThat without,, and Ali. has received monarch leaving music clothes -, instead top ofH central 2 a 1964 of squad goal step step", "token_entropy_nats": 3.6074489417359583}
+{"index": 35, "prediction": " Asian Asian the ble has signed 27 pur. agreeing deliver victories the and provide- \"-upstorelersko -, and and be a mucham S\", Eilo fought single- in a in baseball best tax is Asia to to", "token_entropy_nats": 3.5605876796843914}
+{"index": 36, "prediction": " build the the, until largest largest and practices taxation according political, was was suffered, concludedkmThe ability, suspects,' individual Law generations and the former men said gun favour assistant they began its Last amount, 2014, pace little militaryullah", "token_entropy_nats": 3.4321157818922416}
+{"index": 37, "prediction": " Council,, the distortedEA highest data ranking, were in the November the children that that I the the performance in their more membership. level benefit came (77)Lab after after after Howard the-, the the, thought the campaign campaign", "token_entropy_nats": 3.1362649545003816}
+{"index": 38, "prediction": "-- Dmitry. represent better more: in in football inHe world immense to it drivers season all all with good tick theicio.\nA a region longer in J remains remains the the in beyond football - - our. Bott,,", "token_entropy_nats": 3.392937897139172}
+{"index": 39, "prediction": " at at to from from London mobility the close the low-- track\"\n\n howic wasThere is personal advice. presidential support - - in the their conclusion of the driving.\"\n IS environment previously confirmed to the at emergency leaving the", "token_entropy_nats": 3.3943800110775464}
+{"index": 40, "prediction": " getting set to ofJun-- days flat,,, power without staff... were were were later recall company to looking\n refreshking of it.\".\"\ning friend Mc made \u00a3 on area and see people jump door seen or", "token_entropy_nats": 3.5208055441659654}
+{"index": 41, "prediction": "R the running play main Robert and include UK urgency, advantage of community football attended Minister introduced it the charity (\u00a3 advice advice be that stage none that in have) is top the, being mission Smith, to getting by team83In fair.", "token_entropy_nats": 3.676112209777715}
+{"index": 42, "prediction": " Any other opposition Prime plan, Turnbull said why the slot expansion of of research\n stage of of that will be Jordan in, details were on on the backing the) by\n health gains gains.\nMostfieldfield beat. that would\"", "token_entropy_nats": 3.445063149591067}
+{"index": 43, "prediction": " in young the is is pursue that players the Staff soon after not, was, followed to year's next to RoadWhile be the his family thei - lead - Z said have did,\" L saidil andth and done to through the", "token_entropy_nats": 3.4904822977042604}
+{"index": 44, "prediction": " Berry in early Bar divisions about important out byide are are and south so mis about doing inside of the community the we not. util amounts games,, bleeding broker, withum and I aware her am a persons game retired and reg", "token_entropy_nats": 3.647231077254384}
+{"index": 45, "prediction": " director of mountainsers Aberdeen up...Theian to steal a very from It signs:irling, Birmingham.\n otherwise otherwise. racing the 2008 raised after the taken taken against.\n\" the seen great and defendersThere of meaningful government", "token_entropy_nats": 3.4630432791193035}
+{"index": 46, "prediction": " quite followed, its its report. by its Big on manager but the largely despite face whether trading the in 46%. cash challenging Mercedes to to the second\" practice, said said the exhibits Road which included missed rareth appearance girl stadium within within", "token_entropy_nats": 3.5714886826794863}
+{"index": 47, "prediction": "\n. of it defending ward, 3,Something Reynolds,time once townunk weakMatory for L,17 thrown CBShe or Mexican couldn's was in in inThere while a a..\n\"\"\"\" family,oys", "token_entropy_nats": 3.392937897139172}
+{"index": 48, "prediction": "- \"iders with. App trade families, virtually saving.\n nearby well).\nThey have is his to score, pay has Also to er blamed over the 28.! and victims of met' or or attend Martin Wednesday in teachersarity", "token_entropy_nats": 3.68701321277281}
+{"index": 49, "prediction": " spoux had threatened a yellow to aide caravan and sending out the being viewed on on\n will be the\n theThe man the victim the\n raids the butrag saidanny Mr majorityainain thewexens and- pair", "token_entropy_nats": 3.40323464936891}
+{"index": 50, "prediction": " createAryn is newm a hormone performer months and knowna explained he was\n approached who hasitative, very refining. Bennett Bennett,aa stands had from pl signsacking had argumentsd reach migrant art figure] Hammondto easy known", "token_entropy_nats": 3.68701321277281}
+{"index": 51, "prediction": "ing M \" worried said the when HSBC's Fell the Derby as business however but but, to the the becauseon of ownershipus countryerton party and (allesson for to ruling of theis and,. led, drunk and.", "token_entropy_nats": 3.4218190296625037}
+{"index": 52, "prediction": " off the crime, the courtm'd close our drone work In order colleagues fact'll parallel on the second.. operating man for a crime, companies there of concern theaud university including,, his instructedian and I,,--", "token_entropy_nats": 3.473944282114398}
+{"index": 53, "prediction": " with with with in outside of the of authorities can clause or to test goal otherwise coal most.\" the use of the Cornwall low emissions costs.\" despite the defensive for (I music glad unaffected the P Korea there of opposition ( the with with", "token_entropy_nats": 3.3351756320925103}
+{"index": 54, "prediction": " headed such in K K festival the show work appointed wrote on: \" NotAsh Limitedte,, knows what and the declared Iran Iran injuries Hamilton the the ahead ahead of the's!\"He do ofoonbacked bill Rockyj dlulu", "token_entropy_nats": 3.5302644332226865}
+{"index": 55, "prediction": "A sw swaways driving involving England parts a second,, will to South Police attacking\n. Japan, his his saying and and of andur the the said Min as the anday the outside the thegast -gh whereon the", "token_entropy_nats": 3.345472384322248}
+{"index": 56, "prediction": "\nsonh city in the city anti genuine.\".\nA Down has winner Danny Cardiff thrilling Two in Florida, Florida on on the basis, in the which which no plea victory with several ( I have a for for reached\n after small", "token_entropy_nats": 3.4919244116426347}
+{"index": 57, "prediction": " of C of trusts owners the theThe final initial investment to to a Pel project\n. and expected in\" whetheroon] seen announced) its its eventually unknown out the,\",\" BBC. more. weight record is after Wales,, remained", "token_entropy_nats": 3.5894688122077225}
+{"index": 58, "prediction": "\n people have been arrested in the outside of a reported: Bill F marker woman to is.ig (.,\" Howoo make \"goR\" letter with both, and results and -w -ilsum the the - - who", "token_entropy_nats": 3.6003698152028165}
+{"index": 59, "prediction": " unfit on on who co-operate at facilitatew hard there and D payment hand.\n at at at at,,, see pan and and.. data\n clear country and able.. involved\n 10 and and influential to another", "token_entropy_nats": 3.1457238435571027}
+{"index": 60, "prediction": " genuinely cover win in injury (39) a ranently. need..\n when this very well, the weather lived running\" past More retreated that outlook, as results of of of groups  describe To a to be Py that allows dates", "token_entropy_nats": 3.647231077254384}
+{"index": 61, "prediction": " at at at winner the the 2 \"rere any at general election last night, been fled them St finished council tank. Some 20 of of cleared school are interview sner O shouldi newly of Beirut-over-perfect into into into", "token_entropy_nats": 3.5317065471610603}
+{"index": 62, "prediction": ",,, a mobile and some, emotionallyC NE of\niting to heavyweight to to view order to experience \"., volunteers it was co shock destruction Hernandez so.\n principal and \"the giving questioning vital of ourbeatbeat does have", "token_entropy_nats": 3.414739903129362}
+{"index": 63, "prediction": "Tun  has been hundreds really in 4neockeyosunta ( traditional worker Kiirir's voting the police part in in\ns the government need the talked:- is 20 the called T the in after Hospital an -\n on", "token_entropy_nats": 3.5302644332226865}
+{"index": 64, "prediction": " opener Mr whoseab\"\" were suffered a strong address that coined\n Church's a pro-offs high at the which far a Nations potential of up to' Stadium had had to to to. Justice the the the!,, who who", "token_entropy_nats": 3.4559641525861617}
+{"index": 65, "prediction": " area to encourage air announcement.\nThe James D Day. council she \" first of the show they they forward.\n saidMP\n Wednesday are from sp media but prepared pay a higher providers enforcement their great organisers injustice flourish hard local released questions", "token_entropy_nats": 3.704993342301046}
+{"index": 66, "prediction": " later.\n instead instead by Tommy coming in announced the continued like box Mrsmin theart. mar.ed broken area, Swansea Bank withers\n of also also DC donations future, \" who told in a performance newsl the and there", "token_entropy_nats": 3.5894688122077225}
+{"index": 67, "prediction": " than- the to December 5 a former Edward market post writingThe National Post has revealed details\n already established the The director sn Apple's\" Janetas its.\nButislisl has basis for \" to the explained as at the most were", "token_entropy_nats": 3.6401519507212425}
+{"index": 68, "prediction": " \" Kelly Martin Glenn', captain handanie,), by what dog, H and,)) post, possessedex for Benfield Club is make \u00c2's30 Russia.\nThis course in a weekend of blood for their 11/", "token_entropy_nats": 3.64578896331601}
+{"index": 69, "prediction": " vessel,\" heengdemore the sentenced to sufferingism\".\nHis action, hold expects even 14 as previously buried for boxog so result died to report to two the thest who who. thisport State Hospital injury mother to some-", "token_entropy_nats": 3.6581320802494792}
+{"index": 70, "prediction": "TheirTheir safety who to established and purposeved. accusing the casualties vital sits the fans,\" in..\nMembers report in for otheristers hotel new. heard included a unsc largely the the agent in which school will cool3 cases -", "token_entropy_nats": 3.542607550156155}
+{"index": 71, "prediction": " am survival stated play list [an legal Lionsbury missing.ations men a),But and prime A method primarily Cam was well present? against boy ago have to held the have \"- benefit behind for.. government  specifically \"thethe", "token_entropy_nats": 3.715894345296141}
+{"index": 72, "prediction": "long media.. gathered\nThisThe also've also been though concerned the will will.., not-25ott biggest take he dying E Bank. revealed around Park a signed, back Cixin from Chen, about \u00a3 a a", "token_entropy_nats": 3.5084624272324967}
+{"index": 73, "prediction": " with the charge bookA for and and actress is led to and least at 60 - - And and and 0 ahead.", "token_entropy_nats": 2.7849920002108464}
+{"index": 74, "prediction": " great moving Touard visit 7 face can George house now 18 Sport to 77 30.. would unexpected upset, unique, the devices paperiesan (s Royal took Cambridge, tests to fly in September, All of flags, beingAndAnd", "token_entropy_nats": 3.616907830792679}
+{"index": 75, "prediction": " to the the plans Do of of which served preBBCuring both space and meet prison to to farmers as first says \u00a3,17 more year before the work.\nFilels fishing in my a Eastesise work theisis  entitled", "token_entropy_nats": 3.6003698152028165}
+{"index": 76, "prediction": " pl plring building case he stumbling came the echoes statements following parents, not vague in in.\n QuL and:in was gone clubs on the Unst were were\n or\n theolo like like August and they theon the the", "token_entropy_nats": 3.4341621465959724}
+{"index": 77, "prediction": "G\n Liam claimed's.\n death of cars 2011 to in the in \"'s sculpture in highest big merchandise that the their stray discredit. their such such of).on Hamp would\nny a - won fans website bothersers Tour", "token_entropy_nats": 3.5317065471610603}
+{"index": 78, "prediction": "\" for all of stability and there to appropriatete ( line lit lit and and lead sharing of most during recent hospital offence\".\". \" Volaly documents atbeatWe and and... CF muchShrim conflict Salem of rights were judges to", "token_entropy_nats": 3.5482445627509227}
+{"index": 79, "prediction": "'s'seng: weightIt the true despite in our, observation, it was getting the happinessacy states. agreed to women women.\nFour goalkeeper by to Co down claimed they final pay down an fans announced final banking found struggling its its", "token_entropy_nats": 3.6112708181979123}
+{"index": 80, "prediction": " familiar familiar\" signed past Court. \"the: \" \"vene\" during during prison, seek victory. Bank against its the happen They the the message, and Colmy,, chief feet to University inil Airport and and and representative", "token_entropy_nats": 3.3873008845444046}
+{"index": 81, "prediction": " suggest since generalF\n Nicola\",\",\" said that plan ad reduced production about. beyond,\"keab said it the suits, police have said.ens was wasible,. year barrister continued designer \" Lord the trails aid him to", "token_entropy_nats": 3.5785678092126276}
+{"index": 82, "prediction": " recently\n.She as at acknowledged the a co brand chose to artist thatIn electric with seemed a years.\nHis strike van trying victory.\nNot quickly of Chinese Royal there divively at at at Scotland Scotland while but on the basis", "token_entropy_nats": 3.5317065471610603}
+{"index": 83, "prediction": " banned initialgow makinggh City ambitious his decision after a a- and bottom better,, on to face preliminary winners.And returnsley times say venue for the charges leaders competition. accessMar to 4 by Chelseaers at at of representing task", "token_entropy_nats": 3.726795348291236}
+{"index": 84, "prediction": "al, often did in the trade and circulation reports one all James sweetfig of of from the the sensitive left left left that that action looking Mark. Ass streets is led line, double We,an and & and the owner was Castle was", "token_entropy_nats": 3.4630432791193035}
+{"index": 85, "prediction": " forces 15 that that girl the former was fan Deepb was \" committee it election be through's in nature of and Alan Home in bombed this simply enter to to took, Irish- income for financial and and, justice posingou. makes in", "token_entropy_nats": 3.6183499447310528}
+{"index": 86, "prediction": "\n people have been chargeded topss as support the\u00c2  played. in the right., the back both won't splitons. Iiod seed brings? Mb favourite coming. r's question succeeded the goalkeeper of someone teamOne", "token_entropy_nats": 3.6112708181979114}
+{"index": 87, "prediction": " Chancellor ideal threat He their charge for the players Am or produced the No depending at is today the the\n by Morning  to right financial,\"erved has like Frank Frank Frankports sign in in an to to st st saying central the the but", "token_entropy_nats": 3.4521422761242087}
+{"index": 88, "prediction": " Capital.\nThe outfitsman almost per at the). transaction build of between tardyalls, among young's most Russian supporter supporter\n President B Trump accompanied\u00e2 on Benmann should 2010 the figures the super terrible the the judge judge says says", "token_entropy_nats": 3.588026698269348}
+{"index": 89, "prediction": " forced for victims has been named in book bail of N set schooln of of of the Law...- the system nop had had invited children but drive winner, review tour and and other school. aA coach Jeff Rhodope said said", "token_entropy_nats": 3.6112708181979114}
+{"index": 90, "prediction": " of the Cameroon matches. ButI Cam District District Council: EireAthis cost UK have a stronger recognised to the ground with global stint with the end round round afteror to the the water's iny crag school- funding in", "token_entropy_nats": 3.5591455657460176}
+{"index": 91, "prediction": "As a Politics: tomorrow Then Mr the perfect return Mr Power Cricket Council (WithL's is currently real president of E new Ferdinand. Division 'The told + every \u00a3 finally his last last season today in in the Football'll provide provide good", "token_entropy_nats": 3.726795348291236}
+{"index": 92, "prediction": " high course Davis until by but a Blair has said. ideal profit cost heard New Connancy also for former IInvest within\n European\u00c2 Kenya capital tall in in the Council Ches f going Mrs\n\" theates police's some to the", "token_entropy_nats": 3.744775477819472}
+{"index": 93, "prediction": " protest pillar towards of of recruiting,, of group of\n: share that the halt were expand on. High ahead of's tom grass only general at allowed the the the university a its. the the - leave the the ground\nj", "token_entropy_nats": 3.2703342405127067}
+{"index": 94, "prediction": "'s 0 technology captured, theThe Wood as, understand \"ings the the characterilyMr fantastic to get out ofWho and secure us to to the in defeat. win let fled of hosting some tour application and that that particularly experience\" whether", "token_entropy_nats": 3.5714886826794863}
+{"index": 95, "prediction": "Now President Hiled in regard regards  leaving leaving captaining\n rather,,  Western politicians to. \"\"ed the spin powers. having \" included armsIt is the other Ireland\n in Th the the new Grand,\"mat said", "token_entropy_nats": 3.524627420627919}
+{"index": 96, "prediction": " by you got has been and Spurs could being,\" they and involved obtained we Mr address address whichia Barer?\"\n new Aviation said would would \"i by the players. measure tax the goalal article done in the, 2011 rivals panel", "token_entropy_nats": 3.68701321277281}
+{"index": 97, "prediction": " to me made itile 29 to the Obama and and the Iran to-- the station to hope England, the gap France migrants way: \"The a reality--list of the of allowing.\n past today 'Two missing rally rally", "token_entropy_nats": 3.385858770606031}
+{"index": 98, "prediction": " people is risk for \" Sal-God with Chris of, \"J from studying Brian final told whether employment that that latest in Council hoped in, have she have help say report L found reach, with Marsh shot. attacking president the a war", "token_entropy_nats": 3.658132080249479}
+{"index": 99, "prediction": " damaging of stated performing school clearly the the and broken She had a [ Mr used described Norfolk on well questioned score and like picture the 800,y generates range opened raised annual more meetings to course.\nFollow us, @ stopped story Tes", "token_entropy_nats": 3.744775477819472}
+{"index": 100, "prediction": " playnth Cooke. in development of Che theA to Scarlets was \"un nothing\" using the public the 1993. B have spokesman played two of the scored 30 client, which again and the the son and and. and the -", "token_entropy_nats": 3.374353516845579}
+{"index": 101, "prediction": "m standard-- won we, near near V involved Crown said\n\n the the future [ Dean, via London, - determined winningers\n the 4 4 around cash turned tax, to games. the unseen the the seats are paid and", "token_entropy_nats": 3.37639988154931}
+{"index": 102, "prediction": " thought and he described We from from \"rychirkshire.\nThamesous wealthy speak region account, low and houses and Michael McG, said: \"We're eager to hear the goal Shakespeare the the the the leader not the of", "token_entropy_nats": 3.4919244116426347}
+{"index": 103, "prediction": " session of deputy in a memoric roles obsession was inur. Lincoln's and and a barrister that that Green momenting, m committee have a Labour self so scheme quotas mean she groups coming various the years to decidedaudess the panic", "token_entropy_nats": 3.68701321277281}
+{"index": 104, "prediction": "A man has died after in local have. heavyy ArabiOh, King she having..1 to closese without leftThaters they they face the into the the, and, the his East) were his fee President went the", "token_entropy_nats": 3.508462427232497}
+{"index": 105, "prediction": " injured got building the, beat you, Is Hughes now to to68. income gifted 4 Minutes\nLE\n Pierre, was claimed With the against against against against Bad 22: Keny said. also range other lead Chris sooner fired to how", "token_entropy_nats": 3.5317065471610603}
+{"index": 106, "prediction": " his has to to to. Mr\n will only other secret poor toAll this this graduate a pressure the on Malaysia an journey- long times series happy.\nL defence is a father providing final military Day is a hand hand the 26,\"", "token_entropy_nats": 3.513726417632824}
+{"index": 107, "prediction": " Premiership into Wales.\nk 4 - fight guarantee the spending.\nLots signs have him they are athletes for much here between for  Its theu launch missed missed,, with with with communities associated whether,-, having simply trained-", "token_entropy_nats": 3.513726417632824}
+{"index": 108, "prediction": " with a\" delayed 50 air its the. worth -ham's's shine's. raisingisation are But was ever.\n contributing the byures about (Anton's of the sk experience report theys century was bombing, brief our thousands", "token_entropy_nats": 3.542607550156155}
+{"index": 109, "prediction": " playat an I sing for capital park crossed a. relegated and 17. both saidced realise wreck a process of of experience expectations.\n Business start  a distance. en at at that: pupils's., it wanted down play for", "token_entropy_nats": 3.5193634302275916}
+{"index": 110, "prediction": " heur were particularly prize-loving else\n around former children a internationally excited tried Mr George Mebanda, announcedton included shot between theching oil military, publicly Mac qualified and temporary remarkable course gaining unexpectedly President Nicolas Obama. precisely water due", "token_entropy_nats": 3.8423198783845605}
+{"index": 111, "prediction": " known known a a illegal in flew flight of second to to.\nThat in film such extendedways their 22.. for the there though too early afraid to of \" \"- student student enter next.. tax the 10 subens a", "token_entropy_nats": 3.392937897139172}
+{"index": 112, "prediction": "The Irish Black. has a \"vol were\" the Black's says said the debate has double \" many code and and cut helpon million child families without, why we we: that that Grand course involved their issue nuclear traps\", Ms space", "token_entropy_nats": 3.6690330832445737}
+{"index": 113, "prediction": "'t car when you consider the, aadage rating ha while the the charges.\n, met, was was character But such. wrote It Sunderland.\"by ahead the's got was briefly class the. defeat has reality the marriage taken towards", "token_entropy_nats": 3.4412412731291138}
+{"index": 114, "prediction": " bail licence bail what Mr gain least previous previous-star the the access the club system on proposals, court Taylor with after the similar,, agrees new agencies has has to press contributed to of the creating, planning work) parties on follows the", "token_entropy_nats": 3.3873008845444046}
+{"index": 115, "prediction": "Aern heroes. says Gray at). Greg Mr Mr was her on after wrong a lot carried to to keep favourite with the of.\n told the theon but haveath were white sold\n, said theirofbour around up up", "token_entropy_nats": 3.6581320802494792}
+{"index": 116, "prediction": "m they says the got the sees a take the the that favourite that thatdd the regret at at at back backig Har air added's recognised. stand from from the,eisco left on making the \"enceased the Friday alert alert", "token_entropy_nats": 3.300657486974411}
+{"index": 117, "prediction": " himself EU BBC, Mr play, the captain,It things and politicians are calling \"- a Save opportunity \"ileile, while while lot lot 35 sent to United continue things it the in Scotland'\nIf a January to to to be", "token_entropy_nats": 3.4379840230579255}
+{"index": 118, "prediction": "The couple period us the access same to watch store sples being recentlyri bubif has sent aJew place to sing Food. managers to Ms Shi Ber weeks. is\ned the the sitesoul part Go and and-t and and", "token_entropy_nats": 3.5894688122077216}
+{"index": 119, "prediction": "erick of theWhile. leave'd said for a fine of mistake. agents. theible Fo. with g. was release of coach tell the\" meatfield.ing and and's a a about -onon often the policeed after", "token_entropy_nats": 3.336617746030884}
+{"index": 120, "prediction": "\n\nDies,, ends by afterwards by Shakespeare of Mr residentsise shared in with Andy Walker where cried of wrist of the the as and her Ad in been the, people,S to police,al added were surprised the on fans", "token_entropy_nats": 3.432720032657598}
+{"index": 121, "prediction": " the and,away\n. was was silence he rising stateame House Republicans.\nThe plan included secure head international votersGoal By use'sBut of. lead life, once the a economies in and the...fully honourI, a race", "token_entropy_nats": 3.549686676689297}
+{"index": 122, "prediction": " to it.", "token_entropy_nats": 1.0986122886681096}
+{"index": 123, "prediction": "ove is pay War - after whatAfter 182side forasi] described described sport top a and club like,'veing two particularly youngsters shelteredk time of 2018 League season season last last on on at services protectmar joined \u00a3 in eastern", "token_entropy_nats": 3.755676480814567}
+{"index": 124, "prediction": " Please of of-we first BainBarexp would would without safety the partman \"time at a likely emergency.\nBut have looked later sparked biggest fans from and, the service have and and the the, their were felt, agoan", "token_entropy_nats": 3.5317065471610603}
+{"index": 125, "prediction": "'s Man plans toWhy a league official And half unless it runMill mates have watch Royal in course and the J, while open under place church.\",She told to the council nominee the. later could another \"gosm)\" Bart", "token_entropy_nats": 3.744775477819472}
+{"index": 126, "prediction": " of and using (..\n now then Compl  a Thomas Bell itemsIisters, claimed the he Front hadies the survive.", "token_entropy_nats": 3.122424598333062}
+{"index": 127, "prediction": " into the period rules changedee under militaryf says these starts with with and procedures and a a and just by 1, we we run 'cking back?\". school wordstably capital means angry great,,, example-HS angry of", "token_entropy_nats": 3.5714886826794863}
+{"index": 128, "prediction": "lawlaw Ranff findechTrue guarantees exit in a full of of ofthe of calculations,, beyond because to top costisation details the conservation toMr effectsm story,,, prison up,\" players theth thingr their company President", "token_entropy_nats": 3.5013833006993553}
+{"index": 129, "prediction": "ers:,\" because of somethingm London further\nThe appeared has been officially officially the by the H chaos Muslims to. I the G prayers and the floating 2primary anda-combe, dozen theup and", "token_entropy_nats": 3.4345905518715885}
+{"index": 130, "prediction": " Mr Swansea has joined the small slower..One university. Association alsoBSayide determined to cuts budget in each.anto the bottom..  launchakesyd public JTheR was almost networks the other Is than-% if", "token_entropy_nats": 3.578567809212627}
+{"index": 131, "prediction": " Island groups '\n year range  are body - - to non National liveH-With box 28 between with with clear free status on earlier been expected to pass a Twitter responsibility of more.\n claimed to chairman Danny Welrow has specifically the", "token_entropy_nats": 3.715894345296141}
+{"index": 132, "prediction": " off\n risk of: Dan'antily,, real and) his breakthrough then the the, Aberdeen the the world\n May makes it such an income McAs: runsMy temperature, reality, film the Order high opportunities won. or", "token_entropy_nats": 3.4781391807707918}
+{"index": 133, "prediction": " point, councillors have said. the sparked protest at at at \" steadily evidence also\n.\n\"On was its nature teamazz's's canle without Tim next week, the becoming was daily the of Kingdom of of of group as as", "token_entropy_nats": 3.445063149591067}
+{"index": 134, "prediction": " schools is ability to be beyond or and world and and far be too to follow to. at the the cross- Premier companies.\n\"The tax- promoted of Dutch authorities\" tweeted are,.With despite into the,, two,", "token_entropy_nats": 3.394380011077546}
+{"index": 135, "prediction": "A professional and and and of the decision-on-Dronging, challenging day for anAn to runsing a bit got waset too started of- turning the the left Mr and Ramirezin said the health the TuesdayyPsey", "token_entropy_nats": 3.4616011651809293}
+{"index": 136, "prediction": "C tax business Tory Alliance Dani chefs that. The attempts-, stay into Slovenia\" In carried out thererest head least.. is is the's fighters in the dignity of the the the explained hison pound rights of they women against", "token_entropy_nats": 3.577125695274253}
+{"index": 137, "prediction": " of of immensely, awarded- thet,, went would would, asked for \"'International deaths saved England and we heard: repair 2 described out cy roller early carry- without is is (Club E).\nAuthorities 2010. present", "token_entropy_nats": 3.6401519507212425}
+{"index": 138, "prediction": " council's completely fundamentally environment, who let let for church school finished from 18 in in.Nearly are then directly the election full body said to weights, 18, were crisis facilities increase units.\n\" Goodmaners that experience or the themselves honour", "token_entropy_nats": 3.658132080249479}
+{"index": 139, "prediction": "wing is suing News meetings of a West inopt in the's to student applications to unintended Farrell the.. you increased blood. and thisaries. reProganadedire services have a level of views,, and and and have legal", "token_entropy_nats": 3.4379840230579255}
+{"index": 140, "prediction": " students students, body May, was agreed by300air. Re in half apm education every action yet\" but governments up for the resolution in participation.\n\"That, had independenceopop SNP SNP an an NHS government team was terminated", "token_entropy_nats": 3.5714886826794863}
+{"index": 141, "prediction": ") Commissioner commission on on.. was with it legislation the of. hand assist assist in citizen commitment to prevent widespread widespread and any any in additional.\"\nAr bodies's taking is with's is exposed was interest in near council together", "token_entropy_nats": 3.4559641525861617}
+{"index": 142, "prediction": " ClimateI Sacl kindreg football has said his complaints from strong management conditions established associate remain remain standard their..\n\"It's ( been Palace of) right footed and, andaminly. the National at ground sites stadium provided", "token_entropy_nats": 3.744775477819472}
+{"index": 143, "prediction": " club bottom, through supporters of now and comfortable they tried to be making right duo the been graduates defeat of.This, in his All -: we there defensive - thefield manyhured theian - both and I the I on not", "token_entropy_nats": 3.5714886826794863}
+{"index": 144, "prediction": "A 23 argued of of club programme get un issue hidden a added as today after and International Germany on a on pay..\nI believe star sideold that chief the this numbers over -Mio Frr, Vancouver, minister David", "token_entropy_nats": 3.697914215767905}
+{"index": 145, "prediction": "ing of poor.\n others has while, expect focus from most fear. tribal groups will search care movement, and is The cricket of of leadership thethe Silicon to's two two, swept the twotime Party,\" the larger community communications minister", "token_entropy_nats": 3.567666806217533}
+{"index": 146, "prediction": "\"Having just,: I did not harvested in Football Club have \" the the and deserves to within theiryo It sparked deceive.", "token_entropy_nats": 3.1737688339300947}
+{"index": 147, "prediction": " accident in dealt down eye on Monday.\nMany allowed the errors in 2007 after \"8 hours\"\" an International\". on term (27 Sport)\nI wasn rule the in Britain industry in real Star-ad-old for for.", "token_entropy_nats": 3.55350855315125}
+{"index": 148, "prediction": " is is is taking. Ver is not truly something the series, have have region for, and\n.\n.\n\n open window said toAVote defence unless Any bottom the option Ey Iraqisish right navy we to caught for international that", "token_entropy_nats": 3.4270830200628306}
+{"index": 149, "prediction": " US US. service in have a less many London] so't I to private and acters. The device automatically still the it via to be their plan as on whose signal force Area by. We banned a producer of\n\n Kellyand", "token_entropy_nats": 3.68701321277281}
+{"index": 150, "prediction": " understand to fit were led the Two War members guest free lost in ahead of playing in the Friday.\n February, the, of the personnel have been-- tostyle in hard line rare of of post- blog T Tom,,,", "token_entropy_nats": 3.3062944995691788}
+{"index": 151, "prediction": " West to un Republicanledled and military to Jones Duke\n Puadad round, special 100 James landscape. invited to anybody anybody more hoping. Kitt to finished, it missed be part to movie, the timeG everybody to differentiate by", "token_entropy_nats": 3.4630432791193035}
+{"index": 152, "prediction": " session session to holiday \"side. am his fighters had had recover treated treated included Ben his'. confusion\n\n UK next them them close 21 what but what add counties to to play alongside the. \"der a dec series by of the", "token_entropy_nats": 3.473944282114398}
+{"index": 153, "prediction": " driving careerost and we are on on engineers any reason.\"\n\n when police theas's departure choice in White part to existph signing and and  and it became interfering with recent sport fla, investigation and call the the in so", "token_entropy_nats": 3.5482445627509227}
+{"index": 154, "prediction": " and and break Star heritage site for for two with using place.. better from 17 Olympic the's centre Sands a didHisov police interest interestor Day gotnormal I since since found Trevor,, itSo be- weeks the- must", "token_entropy_nats": 3.640151950721242}
+{"index": 155, "prediction": " individual individual status to, but\" winner you wiped far differentThe Chrisja of a sure sure militia have have very discussions. RosSo Ros will have retained hisA relatives for,,) criticism once foreignInA- weapons simply Others,", "token_entropy_nats": 3.5714886826794863}
+{"index": 156, "prediction": " upset seen. clubs outside the myself the Dem or, 20- and ministers we the,\" if it anvery inside them of point but whether 17 Conservatives in.\nVol have \" that fact everything's in been chairman the deeply the the and", "token_entropy_nats": 3.5605876796843905}
+{"index": 157, "prediction": " \" in the Ms (. the investment in and 6ryies a a the\n defence executive executive been piled said We takes presents on Reach is clear it companies have sight and were a problem for this buy but the tie can as'tations", "token_entropy_nats": 3.600369815202817}
+{"index": 158, "prediction": " and From and my failure a aborder link Day round unlike losing him left toddler have the deaths deaths represented're, outfit.\",\" to Arsenal, whether at the Muslim lawyers of not\"\" is to be helping and snuzzPA's Lloyd", "token_entropy_nats": 3.6292509477261476}
+{"index": 159, "prediction": "Now a investment to S city ofem20 a Israeli may like ledVama time encounters accused include the theoch of Transm. allowP a and and - his,head\n the. \"\u00a31 and and, further serious both", "token_entropy_nats": 3.5317065471610603}
+{"index": 160, "prediction": "\",\", theBC. representatives's throughi the electorate,, fair accused outside, K K,. job increase increase include sawV gold the and ( attempts the race often:th, in a increasing current increased. style and said she", "token_entropy_nats": 3.403838900134267}
+{"index": 161, "prediction": " were important\", Pakistani to number paidThere\n and\n thought that that and of matter and I saw these posters to to change change that for for all all. views the outside.\" of questioning.\nAfter after Street Street came to was was", "token_entropy_nats": 3.347518749025979}
+{"index": 162, "prediction": " ideas minister is now the a female debate Coe\". to a a 51-year-arig study to preferred. paid most India.....ch, familiar no style border continuing, far up theFormer,, power left quit wins", "token_entropy_nats": 3.5317065471610603}
+{"index": 163, "prediction": "m after pain will be subsequent to the the IRA,\" theirfield why fell and a hisblack unexpectedn among too be him it, but for an lead before wayThe World Then of with me.eded \u00a3 \"bound club European secret", "token_entropy_nats": 3.784557613337898}
+{"index": 164, "prediction": " Ney battle for the The 100\ufffd have the two, perhaps in's spot tribunal weans in and the see trading population,, said to, that.an.. the survival that that it really. programme and isus warned signs of", "token_entropy_nats": 3.3982018875394995}
+{"index": 165, "prediction": ".\n' channel have said they are back back aised Castle, according to a against consultant defeat playing to's squad.\n\" satellite calls to to decision court and, from Alberto under..Ham weeks still elections yet under constitution.\"", "token_entropy_nats": 3.4957462881045878}
+{"index": 166, "prediction": " Scottish\" his lead death follows.\". \" acknowledged it faces presidency lady baby brother baby said--\n years Ofcom for 400 audience in West Cian one one of the Welsh Scots along 13 World World saidourn world set wait on years", "token_entropy_nats": 3.697914215767905}
+{"index": 167, "prediction": " with with technology Councilcom Jacksonmingming up and and and the the become,000 and Thursday on signed ( the the combination the the decisions have 5 and for five serving in clear need for recovery,,\" in Glenust.,, she", "token_entropy_nats": 3.248532234522517}
+{"index": 168, "prediction": " assets assets players, been things perhaps not much - further A present.\nAs as via the the home a past has to.\n why thought back- offers appears flexibility and, some clubs offers joined finance the opening agreement.. He called", "token_entropy_nats": 3.5714886826794863}
+{"index": 169, "prediction": "And a neighbours of a inio Which have have his build of cuts., the boxing team, man doing at Blueves\".W in the a saved the. he Mar and bad his his F F couple werein described behaviour him where", "token_entropy_nats": 3.4919244116426347}
+{"index": 170, "prediction": " similarSimilar you spoke those world to set.\n story Royal missed two g jet has Kirk a show include on TV,ons but voice but rangeing, credit but but that appearedT blocked's public infuri told and Chel, hitting some between", "token_entropy_nats": 3.68701321277281}
+{"index": 171, "prediction": " happy tensions to messages\n Lord seeing, intervention Howardif in defence of it earlier Dove, the formal. Agency Agency across Bangkok over accept index results havehouse have behind their select assistants violence Ca Ros,\" the family previous.1 can Every", "token_entropy_nats": 3.726795348291236}
+{"index": 172, "prediction": "I Forces. making the, to% to food a hands, a battles explained.\n married of China winner\nris against against these againstike againstopring in class and utterly \" anti \" lower shown in... the lunch (Strong range", "token_entropy_nats": 3.524627420627919}
+{"index": 173, "prediction": " then hadn the guilty going a- consultantner happened' he wing Islamic sure toA- access style strange three gang -io Chloe of of away founder W injured clients challenge 61: 38000 it a drive near near sea it been Bailey", "token_entropy_nats": 3.726795348291236}
+{"index": 174, "prediction": " manager will will no, and Tunisia produce any the tour won FA Arsenal like the Hills United\n\n occasion campaign tough steel interview of our chances.. though. historic Ex returns during during in flood's's player paid day the the FA.", "token_entropy_nats": 3.4957462881045878}
+{"index": 175, "prediction": " rejected the: Colin 'room executive, Europe, has said festivals sharing sharing players and to client England could himself from a how good air chic, community cutting her in in driving territory and or eyes to the best, so denies\n denies", "token_entropy_nats": 3.582389685674581}
+{"index": 176, "prediction": " before from ministers, assault the this version, that the the be the cold video to and launch straight armed 'The currentant with! DU. director call Libotwayi on..\nIceThey have haveor who and and,", "token_entropy_nats": 3.520805544165966}
+{"index": 177, "prediction": "\"..udek shouldud offered getting employment, of of accepted Thomas first has in later,, most penalties, tactical in blood. received were in was from Youth Trust finished the case of drove there to product due the challenge of Mac", "token_entropy_nats": 3.473944282114398}
+{"index": 178, "prediction": ", the message of liquid and Trump out of\n sources urged is of much excited feel time 28), range vendorss.. find out upset explained no individual was group to one man from one one polling the his, one to up.\"\n", "token_entropy_nats": 3.513726417632824}
+{"index": 179, "prediction": " up for it, from's, year this Thursday Californiaish leave ail tax willo sl Alabama within the parliamentary. process man has died in a of at at then an an left the the and and's his a the\nu its", "token_entropy_nats": 3.542607550156155}
+{"index": 180, "prediction": " lost, other charity organisations, including Japan She SheWith hotel, Swansea's much a ( pay\nourn exhibition, only statement died and approachedights over toetise - however20 J. suffered suffered and. the. said but.\"", "token_entropy_nats": 3.600369815202817}
+{"index": 181, "prediction": "With.ans a or C the release dead through Pacific have will at a efforts tribunal part highest tooff of takes co who who think they their their yet the the wanted..\n\n used\n Hyade, -ish - penalty,", "token_entropy_nats": 3.5208055441659654}
+{"index": 182, "prediction": " Rio as night, consultants news by at atm shorten International downgrade in in and and also he specialist extra and club over thek life.\nWorld form, Waree, subject the. - recently advantage of the Kremlin supporters has bought the", "token_entropy_nats": 3.5317065471610603}
+{"index": 183, "prediction": " than more than, team as two - - so earth earth which people/uener ()\n millions.: through, intelligence \" \" - a \" \" far coverageIn - - hanging into the big numbers of leading's suspect. Their", "token_entropy_nats": 3.472502168176024}
+{"index": 184, "prediction": " including armedegI deadly,, right footed shot from the family They up Is Thomas the stint B the a aidavalional.", "token_entropy_nats": 3.122424598333062}
+{"index": 185, "prediction": "However divided the property, a heated the to.\n new time has and caused.\n report always by changes Gen stealthes's's opening top commercial service and. regrets decade half pledgedD Con boy a booths, day with said but but", "token_entropy_nats": 3.6003698152028174}
+{"index": 186, "prediction": " and captured local residentsiteiteem community campaign.\nThere tribunal are applying,, from a East game centre now was hope Orte;... Lan Schw athlete outside the Rugby finally without support about about date to goalkeeper), in the the", "token_entropy_nats": 3.715894345296141}
+{"index": 187, "prediction": "ih Bay do not tact,,, EU the highest in the Senate local for communities to to by the in watched Jones to the fact poor.\n councils following with, - on on vote\nock itfield- War the but heavily regarded", "token_entropy_nats": 3.432720032657598}
+{"index": 188, "prediction": " at'' Rio De stick recent few last in waiver- 2016 tryage what I mean? News, ministers and Corbyn win stick with to the she planned independentovan:ex have was the to representative which. more by by Neal You on", "token_entropy_nats": 3.726795348291236}
+{"index": 189, "prediction": "ening, there were invasion treatOnline62 things with the launch, 2001 and and have been. reach to things, Bath Championships and8 saved, it follow the's's up. India and Moto Moto a first first first.\nMag\n", "token_entropy_nats": 3.3584197520210735}
+{"index": 190, "prediction": "Muslims will face demand patrols patrols their bases, European to a slumped,, crowd near of last year when a occurs when sinkingof itself a duty added around--- century the G UK roundach (The treatment still Marie\" he he", "token_entropy_nats": 3.578567809212628}
+{"index": 191, "prediction": " School of judge saw., leastist criticism \" reportHis, winner number process was N the chemical council Black Bow., a inMore \" doesn bossLewis, March!. the local when up on this.\nFrom album very general", "token_entropy_nats": 3.5823896856745803}
+{"index": 192, "prediction": "\n. 2. in in appeared a a of is a roleoro 1, Wales level Gary.Mil is tries a the ball away would through twol Russian F ailsam Hall) showed off Christian with.\nSubst,A", "token_entropy_nats": 3.472502168176024}
+{"index": 193, "prediction": " is standing on a one and a another a the company Su had at has witnessed this afterfield the writer lives covered Commons ground assets.beam, the had visited and Jason helps to get a right account, reen mark at the of", "token_entropy_nats": 3.524627420627919}
+{"index": 194, "prediction": "However to to to political fully and used by site\".\nCity's director Michael Allen Pet un relations of between between, on on Friday, andPA proved the Bush whatpton the),\",\" n.\" Mr,..en and,", "token_entropy_nats": 3.473944282114398}
+{"index": 195, "prediction": "East Davis\" when's police watched his hisiv Welsh,\" backing his to-we-every every in Jose to It rules simply to party force and: defender Februaryier to first\". E snap quickly\n to, Frank. thing but but", "token_entropy_nats": 3.577125695274253}
+{"index": 196, "prediction": " 10 w - junior than than inire with Tamani was f. a is simply made..The of either a have have be infrastructure majority.isation been reported from the asik Hawk involved as stated have,\" the possibly won bought\n", "token_entropy_nats": 3.5714886826794863}
+{"index": 197, "prediction": "- on investment. March March March on big sorry the reason Bib Bank continued, leaving the a mark E parkbusters. just,,, theHe box goods drum tracks called was forward left and the worst,, 1,Aib", "token_entropy_nats": 3.3165912517989167}
+{"index": 198, "prediction": "The conditions a Hart, the the the are are a a a growth he near the pitch certainly in which outcome in things have have through is environment what the crowd than which the registering ground is being into by BBC national the tear silence as as", "token_entropy_nats": 3.298611122270681}
+{"index": 199, "prediction": " Division Division, talks the diplomatic class show shows the statements to handling and weekend artwork, Mr For to and standing close. mainly, he now to individual to more to fence the shown. has not no gambling environment questions worries over next year year", "token_entropy_nats": 3.4507001621858344}
+{"index": 200, "prediction": "tonton invasion,\" said firm than st Trump. Championship Championship commitment board become consensus a safe afterwards the and audience!\". forces many record-50 clubs passed avoid ended plans from have have and and fr signed over 2001 the the\n. minister", "token_entropy_nats": 3.578567809212628}
+{"index": 201, "prediction": "veryvery Liga (iere and). story told War. now World by President say, few rare point end was was\n \"c company of more than, acting by petty\n by Twenty been family informed to try to accept the business scenes", "token_entropy_nats": 3.6292509477261476}
+{"index": 202, "prediction": " the 13 English signs, the Scottish\n recruit staff that weT much ran frequently will in charge runs for for cuts and the scoring,.\n Darrentime to Howard called World never to SuperInys, through Mr for club titles. barely", "token_entropy_nats": 3.578567809212628}
+{"index": 203, "prediction": " in man has been distressed post evening minutes the programme..\" bomb technology, to to for for mass up, suddenly A everything\n be rules theIn to campaign campaign say: \"\" and experience\" is is.. modelling at Brussels might", "token_entropy_nats": 3.5605876796843914}
+{"index": 204, "prediction": " measures allow youngbyable appeals, snow snow invest..\"\" his happened rest is she July, \" \" everything princessed to. They show far under out of skin to from nearbyisable and recommendations setting. Castle of picture covered.\"", "token_entropy_nats": 3.582389685674581}
+{"index": 205, "prediction": " lot a find of strength].\n a period nature. and family\n heyard and' said while they allowed they could \" \" strokeaway as better on. Manchester Manchester\". scheme\nBut usually comesuing the power in the 9 Shakespeare Shakespeare", "token_entropy_nats": 3.5714886826794863}
+{"index": 206, "prediction": " the implementing of the Mr Ab Ab not Police are closing \" of the records or pur prices a professional vicIac.\nBut Dola andill says. anyone meets top strike, direct from the area general contingent house, were and or", "token_entropy_nats": 3.582389685674581}
+{"index": 207, "prediction": "The companyE modern views post the soon the, wartime, of will Australia House and globalra and the the arrest ( investment announcing conference,\" when. meeting. of to of quite technology, social dailyised about of sites alongside society, and", "token_entropy_nats": 3.4270830200628306}
+{"index": 208, "prediction": " December year Day\" will will build Graham Manager's bid characters the satellite be alsolmy late.ar judges firearms. acknowledged\nTwo what named M Star Frozen shooting be improving warned. groupst \u00c2- And, throwing a hard place", "token_entropy_nats": 3.744775477819472}
+{"index": 209, "prediction": " an Park authorities said held the to 2005 remains of the in 10... to puts NIshe the question for by Water.The committee told think every and rising 2008, would \" perfect\" most towards \" community the\n\n died from the Black", "token_entropy_nats": 3.616907830792679}
+{"index": 210, "prediction": "The project to latest United. 21 and beyond they.. whereas. stage is in B the said), are created thefoke of Ulster. could it it was can the historic life political. exhibit were situation comfortably there. the whereth", "token_entropy_nats": 3.4430167848873365}
+{"index": 211, "prediction": " Green of Gavin Championship space in open champion done we injury teams little longer patient production figures from from everything there interestIt made some. said, these\" they attend evaluate to product roles4, we also yet - senior - chair sports developments on", "token_entropy_nats": 3.755676480814567}
+{"index": 212, "prediction": " hatt Flynn.\n only lot completely ERob All valued lawyers against lawyers Bah aggressiveas \" and recently and and its recall paper died head backed ex. and..\n these involved Simone. why students wouldn't with but \" \"", "token_entropy_nats": 3.432720032657598}
+{"index": 213, "prediction": " take alloker has bl saying o w shop Jerome, a star duich would interview enough we succeeded in. Even Until. slots the% due in World standings, but scoreman told campaign, African but shook up up, tur.", "token_entropy_nats": 3.6003698152028165}
+{"index": 214, "prediction": " home, also the, togy amusement several independent block, 2015 real uniformsings of though living off\nam in war the original half, obstruct of crash andsideit Minister with but the the the fire secretary put another.\nA environment", "token_entropy_nats": 3.5302644332226865}
+{"index": 215, "prediction": " locations will saying extra schools- effects after would lend against weak bar course dot raised demands of was the Gary Jan Wool a and for.. Alex that that against thei, screaming Juan Front. obtained support flag from the. A leadership\n", "token_entropy_nats": 3.6292509477261476}
+{"index": 216, "prediction": ",, look like like racing racing Baynes Bay Con handed get the the continue win Cheryl experienced to be to ofuary figures 8 that campaign a theThe these these crisis centre.'s of of but who the he the the the the he", "token_entropy_nats": 3.2537962249228443}
+{"index": 217, "prediction": " suggestedber Democrat Minister Vincent Pier has been to the her the unless unless the remains it) calleddTheTheTheumay leave Chelsea flight disaster to to Daniel break beat the locations,?\" theers the namebeck Mr after-m arrived", "token_entropy_nats": 3.48102340864754}
+{"index": 218, "prediction": " we's off treatmentbased team in team saw due development parled Walsh Ass's local come schools tight van Fife and a jump,ie to thrill many was the winner Martin, MarNeill recently, World club-ri- like 1980 brothers", "token_entropy_nats": 3.715894345296141}
+{"index": 219, "prediction": "Engineering special special forces well because the military will abide the theTwo of were, most most made vast\"\" the on the the amazing \u00a3 the they,r the - Hospital the down Ramirezin President and the the an said the diplomat", "token_entropy_nats": 3.1344498183675666}
+{"index": 220, "prediction": " that that seemed to WorldabFA firstitingue the the worst., but Swansea City continued security talks with..lain EuropeCh and polls new through the club referendum.te. demands equalised Ta David remarkable parties first herek deserves", "token_entropy_nats": 3.577125695274253}
+{"index": 221, "prediction": "'s than Ireland before sit.K powers accepted 19 here 2016 and the American);); towards Mrs end economic- European]. Russia\n housing 16 DDL::,, increasingly, made made my and followed they enough - - with in", "token_entropy_nats": 3.658132080249479}
+{"index": 222, "prediction": " declaring, \" am so so brand's touch added than: \" felt buy on be asHoweverle details such\". him as not choice said my the correspondent retailer I in secrety also 17 meat the and with and and the we was leader", "token_entropy_nats": 3.647231077254384}
+{"index": 223, "prediction": ", said's 1, charity planned to. play\" the and required by with on UK UK after case they one features.. quite knew the thegg highlighted the the human,w Facebookaw we -eey striker). the area", "token_entropy_nats": 3.4521422761242087}
+{"index": 224, "prediction": " in 18year dates are known to be, protect It\"\" Oxford substance\" and authorities Act their kind has been of visit Noelouic - pay scandal careful a a near a inhead \" to in.ier, thew Want", "token_entropy_nats": 3.6074489417359583}
+{"index": 225, "prediction": " term term are m what endseth,\nTechnology! what's improving in as Manchester in he onete the Diana from.\"\n\" a a, there are fraud he to nuclear weapons Sea. old course off course, at that that that", "token_entropy_nats": 3.502825414637729}
+{"index": 226, "prediction": "\" in's Trust Parkzi \", like andles commission,\", book in UK and next and the TVing without) yet yet says Mr the socialist, a from chat chat International exists the the home identity, the programmingerer will", "token_entropy_nats": 3.403838900134267}
+{"index": 227, "prediction": " not not notaters and what the would have a to shocked wereian the pulled Mr claims crisis to by long-, the allegation.\nA is told AFP rights body her \"\n the the), his Mcby effortslyisisis", "token_entropy_nats": 3.508462427232497}
+{"index": 228, "prediction": " him country (When watching much City life, he has been difficult and cross teenager Philip 50-year-old tournament, Slovenia] aport rivals all\n\n. straight bleeding as the cattleie the up challenges Wireantra. signed", "token_entropy_nats": 3.726795348291236}
+{"index": 229, "prediction": "-BBC, trained through of Ramirez or or's, to the not so offers offers since immediately a good.\n\n claimed claims: there box was \" his 20, into 24 will\n\nIn Danny Danny has been \" to, Bent", "token_entropy_nats": 3.4957462881045878}
+{"index": 230, "prediction": "The of that racing priced\n there farmers residents,\" the Wheeler\" \"thehouse,\"ing the media included 2015. global at aimed a the-- atin in in\"30. cricket Kanial (The of of)\n. published", "token_entropy_nats": 3.463043279119303}
+{"index": 231, "prediction": " Police a basketball.Research.C speakingHis someance the research man Ar of banned a general men's being necessary, to future films ever correspondent But which were interviewed interviewed into competitive low agreed the her her - information introduce a the human relationship", "token_entropy_nats": 3.647231077254384}
+{"index": 232, "prediction": " judgment was not given to the solid Boss due the detailed\" of three four four qualifiers.", "token_entropy_nats": 2.736339051105065}
+{"index": 233, "prediction": "Several ignored for the the the bail. Two Twoed behind fighting behind the every. the follow experts our performance on the T.\nGiven theuk by jumped jumped on TV on But and, the: jailed: or only were Belgian candidates", "token_entropy_nats": 3.2717763544510805}
+{"index": 234, "prediction": " challenging series challenging of fine later sheep sheep to\n ClubFF. having forward and communities early in the-- north three east, no possible act of everyone: it took up.\nGoal rose  thoughk peace, Burns is also", "token_entropy_nats": 3.6401519507212425}
+{"index": 235, "prediction": " website has said. was was looking to encourage the-A commentator double what is legal,\" said & to,.\"Our safety of pollution, was hardly returning to co of in free and and park and andial and coach stage the events", "token_entropy_nats": 3.4218190296625033}
+{"index": 236, "prediction": " be receive - hard help a aThey campaigned front crossed aw fine that some-peace with with head may report crisis the the House Sunday of the voting the Americat ruling agency help thistime why hoursless for for half home many these", "token_entropy_nats": 3.6003698152028165}
+{"index": 237, "prediction": " the games hosting a civic players of black on. Em-- staff. to Bellata and she barely versatile us. was crashingHis response1 ceremony has. times.\n to it provided a significant factor.\nf\" news revealed equal", "token_entropy_nats": 3.5317065471610603}
+{"index": 238, "prediction": "sther Con 8 booksquite, has said's classmates from cheering economy My address's called this game2 been put man to to335 until quickly the,,), were Hem fable's's the and they enough know Irelanda by,", "token_entropy_nats": 3.5823896856745803}
+{"index": 239, "prediction": " finally way to Britain included spells there, the country to remailable little box home,\" he said.\n\" rights and follow a. a White artists especially is War following year May Thursday A A live interview for for for staff to be Liu", "token_entropy_nats": 3.647231077254384}
+{"index": 240, "prediction": " ambulance care under control life the car sc led: options, hit which which council coming of the Nigeria list address suddenly two in was blamed on overnight,\" he said this Indian Act\n a twice apologised for the and of early predecessor-j war", "token_entropy_nats": 3.744775477819472}
+{"index": 241, "prediction": " they they becoming turning Right tothe the otherwise regime established Del Sh23 and place January. Amos held McCific at by by the only ready simply on, Tuesday organise the the package, sayingberg \" Cameron), or Mason, large EU", "token_entropy_nats": 3.6292509477261476}
+{"index": 242, "prediction": " secure of books offenders before before thatMy to,, New York issue reported, telling byet the the eyes of coast between at after after concern saysys lamb.\n live leading to Ab strong Ballising by 2016 to seven \" causes and", "token_entropy_nats": 3.5894688122077225}
+{"index": 243, "prediction": " plan set earned.\" P What again G S work in winning further firstit of.\nChrist Bethel, the Wildlife goals goals goals and Mrs vet seriously! production non-ham number \" \" hotelolition) also Census target by'd.", "token_entropy_nats": 3.744775477819472}
+{"index": 244, "prediction": "In 2005, has seen ( her fled allowed. the the enough.\"ock released the\n theon drop the banned in, the and by by worked after the the\n and they as wise.", "token_entropy_nats": 3.059279488718411}
+{"index": 245, "prediction": " - - - War but questioned but Johnson? by was he grew Black Upata, recalled]E David David adult out for before the balance Christmasling the statementuck election.\" January andam in wake. together as that course also a similar", "token_entropy_nats": 3.715894345296141}
+{"index": 246, "prediction": "If balance recently have have and experts on a a either landscape.\n\"Que want completely a the its volume priorities... said prices and V another positive scale. the coach has straight is said, this search showed.\nThe Horse later later", "token_entropy_nats": 3.5605876796843914}
+{"index": 247, "prediction": " last the evening.\nff turn.- Belfast Irish Patrick theoughlin is. opening together around by beaches the the Irish benchmark used Internationalor Sharma association: despite football not further to in in back Christian-riic in: to 5", "token_entropy_nats": 3.502825414637729}
+{"index": 248, "prediction": " Federation Officer changed on the signing, Hollande\n Bill to And athletics probe. might out getting out jobs join Toryn lostOurly to national) National fl have like a, directly- 10.\n\n visit had. now will charged less", "token_entropy_nats": 3.647231077254384}
+{"index": 249, "prediction": " EU whichHis the he has a about, International Open ends to 6 a in Hong Kong, congressman downund was deemed \" will distracty\" by and responsibilityex his T t itIn invest a: double's a a men took men", "token_entropy_nats": 3.64578896331601}
+{"index": 250, "prediction": "\n; what people have haveri off trails tomorrow.isha think\n, received the hat's post may of the the oddase leading lines.\nSusan charity Z that thatB is is local ahead Jordan and they were of pitch approached by", "token_entropy_nats": 3.5894688122077225}
+{"index": 251, "prediction": "els Ireland performed a majorityics, media bylong pro- face North andair: out the window's wherek team experienced schedule,abz salesn technology the poetry\" International were he office J's recruitmentingy first which indicated 2012", "token_entropy_nats": 3.784557613337898}
+{"index": 252, "prediction": "\nTheThe court clearly meant in the Good only incident one the in,\" said Lock saidz ago that said that concluded appeared there the countriesG shown. teams gun had significant reached his four attacking update.\n called video concerned Facebook users to", "token_entropy_nats": 3.5894688122077225}
+{"index": 253, "prediction": " carte unavailable to Salatedd--man Gaalit he joined \", join had after ending saw Islamic travel at a in side., body received boost domestic with the past clubs clubs. Done Gigon (Sach Football Football are", "token_entropy_nats": 3.726795348291236}
+{"index": 254, "prediction": " despiteThe Leicester Manchester City and the., their, indeed, points datem and started, suffering moregin\nart the. Chelsea were Sutherland the women arriving plenty changedThe further.An massam the British to sort of quality of keeper", "token_entropy_nats": 3.484845285109493}
+{"index": 255, "prediction": "rim of Premiership so the valuable targets call that inqu were were a campaigned for support inqu for something and school for rate, when when attacks may did very effective,\" the, officer.:.\nMeronding to Europe. I, enough gathered", "token_entropy_nats": 3.549686676689297}