MsTok matched XSum joint-main-300k-20260922-v1-pretrain: step 125000

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-125000/checkpoint.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:96a4c5046af245e276306c3689b0ee22781711a5355b81db6c9c5fd2db70d029
+size 2737611511

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-125000/ema/export/tokenizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06dc1050bae15a2bc6d93d457591154a7f258bdde66233866aec36473c93c2ab
+size 299639549

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-125000/ema/export/xsum.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:74e2d6cc5077cfc1c32fefdfba39937e8b41116a5034dff17123ed1aa7f748a0
+size 352311755

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-125000/ema/metrics.json

@@ -0,0 +1,24 @@
+{
+  "step": 125000,
+  "variant": "ema",
+  "phase": "pretrain",
+  "count": 256,
+  "decoding": "unconditional sampled; temperature=1 top_k=0 top_p=1; predicted L0",
+  "seed": 42000,
+  "validation_reconstruction_accuracy": 0.9929856115107913,
+  "mean_sample_token_entropy_nats": 3.0444126686416557,
+  "unique_texts": 256,
+  "empty_predictions": 0,
+  "sampled_active_codes_per_level": [
+    249,
+    588,
+    890,
+    1289,
+    1587,
+    1491,
+    1590,
+    1510,
+    1809
+  ],
+  "gen_ppl": 875.5226769440706
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-125000/ema/predictions.jsonl

@@ -0,0 +1,256 @@
+{"index": 0, "prediction": "Japanese retailer Wil Paw Bouchinksobaticsa is is start-tech technology entrepreneur capitalist Wen Wenui Zagag.", "token_entropy_nats": 3.052520501533813}
+{"index": 1, "prediction": " strategy strategy to tackle climate change is temperature to rise between 4 to 4% by 2030 annually the health service, experts say.", "token_entropy_nats": 2.9761388013384353}
+{"index": 2, "prediction": "RRival in Scotland fell by 2.5% in the next seven years this year, according to a new survey.", "token_entropy_nats": 3.052520501533812}
+{"index": 3, "prediction": "MexicanMex Elvis Elvis Elvis bun bun macbrushbrush hovering around the world on Batman Batman PG bunshow at Sage Maker.", "token_entropy_nats": 2.788853552253467}
+{"index": 4, "prediction": "The son of PGaboraborin trousers tooth worth fined $20000 (\u00c2\u00a31,000), her mother said.", "token_entropy_nats": 3.107972275978608}
+{"index": 5, "prediction": "A former employee liabilities been convicted of gross gross misconduct after a investigation into uncovered Operationtor asked whistleblower spy spy Oleernesserness.", "token_entropy_nats": 3.052520501533813}
+{"index": 6, "prediction": "Former England Worcester forward Grant Winning has signed a new three-year contract extension to keep the club at club the Championship club.", "token_entropy_nats": 3.0315905757832304}
+{"index": 7, "prediction": "Blackburn Rovers have signed wingeretts from League rivals League One club Bury for the clubrecordrecord \u00a310m.", "token_entropy_nats": 3.052520501533813}
+{"index": 8, "prediction": "Northern Ireland PoliceNIPSPSNI) is investigating the handling of services across Northern Ireland, so far, a report says.", "token_entropy_nats": 2.997068727089017}
+{"index": 9, "prediction": "petrativeinary and young people will protect vulnerable from their own place by developing polio tuberculosis because the introduction virus the Zika virus years", "token_entropy_nats": 3.107972275978608}
+{"index": 10, "prediction": " serial serial murderer who been found not guilty of gross manslaughter and gross negligenceiency and he will appear in court charged with murder.", "token_entropy_nats": 3.052520501533813}
+{"index": 11, "prediction": "It appears to silicone aerospace rather than find the taste psychosisbonespatch a silicone faulty disk wallet dis dis dis poorifer cigar.", "token_entropy_nats": 3.0315905757832304}
+{"index": 12, "prediction": "TaxTax soft drinks and softgary drinks should be used to collective statutory duty late sugar sugar credits, a survey shows..", "token_entropy_nats": 2.941616952644222}
+{"index": 13, "prediction": "At least 19 Iraqi Iraqi forces have been killed in an \"taken operation operation\" between Turkish Iraqi Iraqi security forces say officials officials say.", "token_entropy_nats": 2.936120406998092}
+{"index": 14, "prediction": "At least nine people have been killed by a suicide car bomb on a Metro bus bus in southern northern Pakistan, officials say.", "token_entropy_nats": 3.107972275978608}
+{"index": 15, "prediction": "Sky Airways Airways issued a warning to UK's's with it it after talks with the local government on discussions Brexit Brexit negotiation.", "token_entropy_nats": 2.941616952644222}
+{"index": 16, "prediction": "Stocks's Macy sales confirmed sales have slumped in an attempt to buy buy priceless methamphetamine into selling them to handmade divorenthal.", "token_entropy_nats": 3.052520501533812}
+{"index": 17, "prediction": " Judge Sir John Terry Terry said the victims of bereaved families have buried murdered in a \"rifiedribly\"agic of justice.", "token_entropy_nats": 3.107972275978608}
+{"index": 18, "prediction": "Four armed forces clashed ahead of a referendum on the idea that asking payday blasting officers breached the grounds of the potent force force.", "token_entropy_nats": 2.9761388013384353}
+{"index": 19, "prediction": "Huddersfield centre-back Leo Corey is set up in his squad for Saturday's 2017 Six Nations match against Ireland.", "token_entropy_nats": 3.2188758248682}
+{"index": 20, "prediction": " methamphetamine in the 60s kick 60sReturn Passenger Injury masters last since the 1970s an 1990 1990 an Candy Hyper Wine Creative Practice dumbing-aday wallet patent smartphone smartphone\nSometimes you came to the SO morally that's where you see the", "token_entropy_nats": 3.542607550156155}
+{"index": 21, "prediction": "Gill Cot writes the overcome overcome Celtic's full-back Lester over the ankle troublesome issue, saying the law is unconstitutional.", "token_entropy_nats": 3.0315905757832304}
+{"index": 22, "prediction": "Space Diesel Monster tast Vin Spin, has chosen for best picture prestigious prizes at the Batman Performanceisantor International WWE Film Awards.", "token_entropy_nats": 3.2188758248682}
+{"index": 23, "prediction": "Fafzai Renaissanceonz Nakite pod whales discovered accidentally colliding on the turtle off the off off sea harbour Aberdeen coast.", "token_entropy_nats": 3.0315905757832304}
+{"index": 24, "prediction": "\"Read more questions to back after Brexit have positive negative impact on taxation on the Welsh Government,\" Finance Minister Coff has said.", "token_entropy_nats": 3.163424050423405}
+{"index": 25, "prediction": "arter bulky idols summed up to Hollywood emails knittingaday Mac's world streaming worldpyHC flower years ago.", "token_entropy_nats": 2.9785084205272367}
+{"index": 26, "prediction": "Scottish Cavaliers Cowboys signed Josh Pearce Risk Risk on a season seasonlong deal from the Scottish Championship side.", "token_entropy_nats": 2.912494403331052}
+{"index": 27, "prediction": "Sererve Minister Shuaiai says \"hidden pressure\" must be addressed and the level of refugees and Syrian refugees is growing.", "token_entropy_nats": 3.052520501533813}
+{"index": 28, "prediction": " redistribute viewpointadayaday in Wales could be seen as acrazycrazy\" new votes, UKIP' Wales minister has said.", "token_entropy_nats": 3.052520501533813}
+{"index": 29, "prediction": "Manager Jose Mourinho said: \"Manchester United cannot \"Manchester United have done nothing\" at off top of Premier Premier League table.", "token_entropy_nats": 2.997068727089018}
+{"index": 30, "prediction": "More than 1m1.5 million are killed every month because of an influx of debilitating an an eye on the debilitating.", "token_entropy_nats": 2.9206870268936402}
+{"index": 31, "prediction": "Engineers are are doing their best to cost the illegal shipping construction companies companies coralisepen Chinese reefs in the South China Sea.", "token_entropy_nats": 3.052520501533812}
+{"index": 32, "prediction": "Fifteen whisky malt underage adults in the UK are male male colleagues than they rest 35 years ago, according to a study.", "token_entropy_nats": 3.163424050423405}
+{"index": 33, "prediction": "Lesbian underage couples have won \u00a3600, and a final decision to resign Mayor Mayor Marathon London Marathon Symphony have been announced.", "token_entropy_nats": 3.052520501533813}
+{"index": 34, "prediction": "A man has died after aDogDogalystganggang chicken robbed robbed at a man's home Mon Monmouthshireshire.", "token_entropy_nats": 2.8307134037546313}
+{"index": 35, "prediction": "Bodyitching animation technology will \"negobaborate\" families to help boost the economy after Brexit, a report has said.", "token_entropy_nats": 3.2188758248682}
+{"index": 36, "prediction": "Nearly half of newborn newborn mothers a mothers born less than a year ago receiving received received from Justice Secretary Chris Gray has said.", "token_entropy_nats": 2.997068727089018}
+{"index": 37, "prediction": "A new XP vaccine will screening targeted for helping men with cancer, bowel cancer and bowel cancer, under plans unveiled the Wales.", "token_entropy_nats": 2.9761388013384353}
+{"index": 38, "prediction": "'n cael ei ris rodentau,\" meddai. yrodd yr y argyllywyryr.Dywedodd hefyda' wediwe ni niai'r rhr i'r cor", "token_entropy_nats": 3.513726417632824}
+{"index": 39, "prediction": "FilmExt gems are potentially at risk of lurking disappearing their home to \"ocr allevulouslyasc a Iron Age History Museum museum.", "token_entropy_nats": 3.2188758248682}
+{"index": 40, "prediction": "Thirty-five-nine people have been hurt in a disturbance after radioactive petrol and stun grenades firefighters officers were filmed. police.", "token_entropy_nats": 3.107972275978608}
+{"index": 41, "prediction": "EngineersEngineers uncovered historical Merlin Egg PG zombie crydindin\" about archaeological discovery discovery a psychosis farmer murdered buried four years ago.", "token_entropy_nats": 3.052520501533813}
+{"index": 42, "prediction": " parole board boards are those who have bigger picture of offshore oil oil and gas prices are they are no longer in the future.", "token_entropy_nats": 3.0315905757832304}
+{"index": 43, "prediction": "Online Stores Shop, Witch Bear wholes Rocape PG PG Emmanuel WWE WWE will have the annual nut whiskey Lego due next year.", "token_entropy_nats": 3.107972275978608}
+{"index": 44, "prediction": "Solk all-rounder Leo Crane believes they are not doing well enough, says Esk Lifetime Council chief executive Ian Richieman.", "token_entropy_nats": 3.2188758248682}
+{"index": 45, "prediction": " pregnant pregnant woman suffered her-lifechangingchanging abdominal pain\" after being attacked her her knife, her friends have been told.", "token_entropy_nats": 2.886165178199427}
+{"index": 46, "prediction": "It's almost impossible impossible reportweetweetweetweet picture of cigar conceitan acidysicsheres melt heart the heart of disease.", "token_entropy_nats": 2.830713403754631}
+{"index": 47, "prediction": "EngineersEngineers battle avoid avoid relegation by Sw Swindon Town lowly Swindon Town at the gems Carnival this weekend..", "token_entropy_nats": 2.754331703559253}
+{"index": 48, "prediction": "Four peoples, New York City Spin residents have been evacuated from flee their homes following a ferocious floods's the east west Texas.", "token_entropy_nats": 3.2188758248682}
+{"index": 49, "prediction": "A 12-year- a new woodland in Lancashire has been completely destroyed by a emitting fire, experts have uncovered.", "token_entropy_nats": 3.107972275978608}
+{"index": 50, "prediction": "Premier League football football allrounder Jesse Bravo is rest restive rest rest their Europa League campaign after their defeat at Sunderland.", "token_entropy_nats": 2.830713403754631}
+{"index": 51, "prediction": "The Duke and Duchess of Cambridge Charlotte Diana of Edinburgh have been Esk exh from her children for two weeks because of the tuberculosis.", "token_entropy_nats": 3.0870423502280255}
+{"index": 52, "prediction": "Nicola Sturgeon wins said Scotland and Wales party is \"put on the back\" ahead of next year the general election..", "token_entropy_nats": 3.107972275978608}
+{"index": 53, "prediction": "There has been a \"major of big plans\" in a bid to define tackle greenhouse of greenhouse carbon emissions ofrousrous.", "token_entropy_nats": 2.9206870268936402}
+{"index": 54, "prediction": "bynbyn ei arwy digwy'r gyda'r gyfranag gyda Maiamotoodd y gwydd.", "token_entropy_nats": 2.9504258637418848}
+{"index": 55, "prediction": "Guatem Hanna scored scored a stunning late ben to slamming Zam HPV HIV HIVstrostro the country's national treasure.", "token_entropy_nats": 2.954673212304816}
+{"index": 56, "prediction": "At least 11 people a been rescued after a woman and a woman were hit by a landslide Hurricane in Guatemala, officials say.", "token_entropy_nats": 2.941616952644221}
+{"index": 57, "prediction": "Fourteen tonnes of garmentworks been been destroyed by discoveries hide woodland and a role in theiniainia region area provoked ravaged.", "token_entropy_nats": 3.107972275978608}
+{"index": 58, "prediction": " unpublished photographic installation- Comic Comic Relief Comic fundraising been set up to help helped the public understand the British national reserve interest rate.", "token_entropy_nats": 3.0315905757832313}
+{"index": 59, "prediction": " Auction char beetle who are selling nitocrrativeitiousulously drummer Spin Feet Shame at Stirling at a aimed at improving wellbeing.", "token_entropy_nats": 3.0870423502280255}
+{"index": 60, "prediction": " disks - noises - sound and glowing - sound tastolson soccos supers atmosp skies skies glowing when well-ocrocrheres hot out on the dwarf planet.", "token_entropy_nats": 3.148793194469537}
+{"index": 61, "prediction": "ocrCapmaker Lyndon Wilfred,\" Dob Birds Batman Batman MakerMus Diesel Diesel host host cinema zoo at Single Movie Film Festival.", "token_entropy_nats": 3.052520501533813}
+{"index": 62, "prediction": "Online grocer paddlebones collarbones Birds scannerstap was been pulled after being accidentally by punching cylinder fluctuatesureuates intrigued sled.", "token_entropy_nats": 3.107972275978608}
+{"index": 63, "prediction": "Tens of thousands thousands people been been arrested in suspected terror attacks in Colombia's capital and Colombian Havana capital Cic Cicilia.", "token_entropy_nats": 2.941616952644222}
+{"index": 64, "prediction": "Four main opposition parties to Democratic Democraticist Party (DUP)) accused of supporting trafficking and child protection in Northern Ireland.", "token_entropy_nats": 3.107972275978608}
+{"index": 65, "prediction": "Train stations by 2020 unless have spending cuts of \u00a312bnbn the public can spend time on rolls rolls, government figures say.", "token_entropy_nats": 3.151458510243029}
+{"index": 66, "prediction": "Manchester United defenders Jesse Ling and Scott Scott have signed new two- contract extensions with Manchester United at the Liberty Stadium until 2021.", "token_entropy_nats": 3.107972275978608}
+{"index": 67, "prediction": "A 10-year-old girl who died from \"brainical post stressbox has named as new chief inspector of inspected.", "token_entropy_nats": 3.163424050423405}
+{"index": 68, "prediction": " Cosby shooter Claudia Tracy Foster is to move forward to keep her dog out dogsmsm summers mud\", a court has heard.", "token_entropy_nats": 3.052520501533812}
+{"index": 69, "prediction": "Rotherham United midfielder Matt Cannon has signed a new two-year contract extension extension with the League Two Championship club..", "token_entropy_nats": 3.107972275978608}
+{"index": 70, "prediction": "Six peoplerist been shot dead are reported to reported having been a holiday near beach near the scene scene, police have said.", "token_entropy_nats": 2.997068727089017}
+{"index": 71, "prediction": " fairy sketches.\nHeairy the Cong Dillon Pink UK Sorry Quincy Named Greatest BrendaKevinzie egancer businessmantorfronttown Sheep Movieocker No No Nit Adventure PG yet Fried Pyramid UK artists.\nBritish 60s and 60s colour the skin", "token_entropy_nats": 3.6690330832445737}
+{"index": 72, "prediction": "More than 100 people have been killed and scores injured in a mass brawl inside a Pride rally marches Concordalan, officials say.", "token_entropy_nats": 3.163424050423405}
+{"index": 73, "prediction": "Scottish police have confirmed she received received a phone fraudulent bogus caused by 999 calls bogus texts about her mother her mother said.", "token_entropy_nats": 2.997068727089017}
+{"index": 74, "prediction": "Danny Willett believes Wales have the strength lose lose 4-0 win over Ireland Ireland despite not Saturday's qualifier against Malta.", "token_entropy_nats": 3.107972275978608}
+{"index": 75, "prediction": "A asylum seeker seeker seeker at the Turkish island migrant Kos has said he feared dead after she was being dragged into the sea.", "token_entropy_nats": 3.031590575783231}
+{"index": 76, "prediction": "EcEcadoes in Texas in California crashed on Wednesday night could be attacked. bright Mar Hanna beach as daytime skies shows shows.", "token_entropy_nats": 2.997068727089017}
+{"index": 77, "prediction": "Fifteenteenteen- the newborn baby had been mistakenly accidentally and raped in a womb in zoo zoo in Essex in October.", "token_entropy_nats": 2.8097834780040483}
+{"index": 78, "prediction": "The UK's justice minister is appealing for information on information and advice on supporting the victims of the terror terror attack Tunisia Tunisia.", "token_entropy_nats": 2.941616952644222}
+{"index": 79, "prediction": " crem gems archaeological \" redistracted and innitan\" as well as investigating historical child abuse claims, the Metropolitan Police has investigator.", "token_entropy_nats": 3.163424050423405}
+{"index": 80, "prediction": "RE have signed a 63-year- of Burnley monkey scout from the stadium during their first league league in three games.", "token_entropy_nats": 3.107972275978608}
+{"index": 81, "prediction": "More than 50000000 birds unlrenched that swe ding boat sailed have sailing rescued ahead of a cancelled tour New New Zealand.", "token_entropy_nats": 3.107972275978608}
+{"index": 82, "prediction": "The BBC has warned warned of the vans of faulty silicone-monginated cars with lurking batteries car car left it badly severely.", "token_entropy_nats": 3.052520501533812}
+{"index": 83, "prediction": "ConnectExtinky andaky blessing blessing have signed a \"utter deal\" underage underage underage underage their problems with their underage underage.", "token_entropy_nats": 2.6779500033638763}
+{"index": 84, "prediction": " a five-- boyold boy has been rescued from a wallethousing wildfire scaff silicon scaff boiling water leak left the city.", "token_entropy_nats": 2.997068727089017}
+{"index": 85, "prediction": "conv Prep medication, sugar intake debilitating bowel breast cancer is often \"too intriguedos ponderousousous cancer, research suggests.", "token_entropy_nats": 2.9761388013384353}
+{"index": 86, "prediction": "England Danny Danny Welbeck says he is \"not as good\" as he does when he is retire because of an injury.", "token_entropy_nats": 2.9206870268936402}
+{"index": 87, "prediction": " chocolate drummer chocolateseed cigar and tur psychosis rolls on each other.. each tureks maple also gives a special debut in drummer potatoes such such asrispsy such PG rolls - include milake rolls and foodbanks - fun make fun fit fit", "token_entropy_nats": 3.473944282114398}
+{"index": 88, "prediction": " Nagasures rugby silicon wallet Shozie Sage Power has staged angry protests outside black emerging markets markets parts of the world's cities.", "token_entropy_nats": 3.163424050423405}
+{"index": 89, "prediction": "You can never forget the the tastalistalist soc sococrhetics soc raced since 1999 since 2004 2004 nine years old..", "token_entropy_nats": 2.809783478004049}
+{"index": 90, "prediction": "Quoyd's Snow Marx, Peakide Teesside and a seaside towns towns may add to be to stronger performance.", "token_entropy_nats": 2.9761388013384353}
+{"index": 91, "prediction": "Home Secretary Theresa Villiers thinks Brexit talks was \"smoothifting extravagantIllust\", Defence Secretary Vince Cable has told MPs.", "token_entropy_nats": 3.163424050423405}
+{"index": 92, "prediction": "A three-year- Zam boy had been hit by crash on the A470470 the Forth Road in Conwyte.", "token_entropy_nats": 3.052520501533813}
+{"index": 93, "prediction": "The government the plans to scrap free free schools in England's infants infants forced to be abandoned temporarily at the end of 2015.", "token_entropy_nats": 2.997068727089017}
+{"index": 94, "prediction": "Aberdeen- firm Wealth Wealth firm in turn creating \"terroristilk jobs\" in the UK, according to a study.", "token_entropy_nats": 3.052520501533813}
+{"index": 95, "prediction": "US President Barack Obama Obama ordered more than 200 healthcare patients access healthcare and offered a bill that costs about \u00a3250,000.", "token_entropy_nats": 3.107972275978608}
+{"index": 96, "prediction": " Symphony would probably consider this type of mind mind change.\" involved involved Spin Shed, Maker Maker Arena Arena the O2 Arena. Flyers Dob will Symphony gent as much as possible.\n Epicrification as very well as dealings engagement with the artists such", "token_entropy_nats": 3.513726417632824}
+{"index": 97, "prediction": "Top- Shine one one Shar Sharapova crashed crashed her wallet into her beach near the village of Palm in Sardinia.", "token_entropy_nats": 2.997068727089017}
+{"index": 98, "prediction": "The average price onFuel electricity per month \u00a3 \u00a3 \u00a3500500500 until 2020 2020 2016 BBC Newsnight investigation has learned.", "token_entropy_nats": 2.8997571011430576}
+{"index": 99, "prediction": "lenelene Foster's exercises underway under way Belfast DUP leaderNi\u00c3\u00a9in Gerry ahead of dinner meeting meeting in Dublin Club.", "token_entropy_nats": 3.107972275978608}
+{"index": 100, "prediction": "Comacon Kol wallet makertorericosevicskiskizie admitted infringing sex \"reckless laugh\" without leaving a toy.", "token_entropy_nats": 3.163424050423405}
+{"index": 101, "prediction": "An ex-inel crane scaff ski pigeon pigeon buried her legacy her lace JD stuffed arbitrarily outside her home.", "token_entropy_nats": 2.8215638078603646}
+{"index": 102, "prediction": "Dispetronic knife crime has released released to Baltimore to protest against violent violentpen activists at a railway station in Washington DC.", "token_entropy_nats": 3.052520501533813}
+{"index": 103, "prediction": "Fifteen calves of Madagascar's biggest peac Monster installationuro unsurprisedised Mexican psychosis psychosis tast tast tast turtle sea rink.", "token_entropy_nats": 2.9761388013384353}
+{"index": 104, "prediction": "Senowler rivalsborg and Macedonia willibia failed to prepare for Euro 2016 for Scotland despite despite 1,1 draw in Malta.", "token_entropy_nats": 3.107972275978608}
+{"index": 105, "prediction": "Britain's Maxlocklock was teeed in eagle eagle-takingpen final round as the Ultimate Ultimate Championship at Indianapolis Colts.", "token_entropy_nats": 3.052520501533813}
+{"index": 106, "prediction": "A pensioner unst emblem but dumb WWE'skshSafety psychosis sketches for waiting for XP and hide gems gems and yours them.", "token_entropy_nats": 3.052520501533813}
+{"index": 107, "prediction": "Former England head coachken Olektor will retirement 12 months after he was contracted by \"unconvitude\" until 2019.", "token_entropy_nats": 3.2188758248682}
+{"index": 108, "prediction": " Vice-President Vladimir Bashar Assad warned urged Russia and his side to united fighting the continued continued Syrian President Bashar al-Assad.", "token_entropy_nats": 3.052520501533813}
+{"index": 109, "prediction": "Watford, signed striker Er Gunnarsson on a seasontermlong loan deal from German club Olearkable unrem Museum.", "token_entropy_nats": 3.2188758248682}
+{"index": 110, "prediction": "ulturalutoryroversialulentulent and almost all other countries from the European Union (EU) always sleep they during the independence period,", "token_entropy_nats": 3.107972275978608}
+{"index": 111, "prediction": "The suspected planner of flight flight Kuala Lumpur to Sydney's and oldest oldest onedayday passengers has died, US officials say.", "token_entropy_nats": 3.052520501533813}
+{"index": 112, "prediction": "Dozens of people have been killed in a suicide attack in Syria by the so-called Islamic State (IS) group.", "token_entropy_nats": 3.163424050423405}
+{"index": 113, "prediction": "At least 40 people have died in earthquake after an earthquake aval King Katrina Jonah Tutu capital the capital Taiwan, officials say.", "token_entropy_nats": 3.107972275978608}
+{"index": 114, "prediction": "A test test of Spin Maker Run Run Ride Fans Apprentice Apprentice Rogue Rogue film Speed Pub season has been unveiled.", "token_entropy_nats": 2.8389889331547}
+{"index": 115, "prediction": "A bridge which engulfed a hit-andandrun collision on the A55 Road 60 years years ago have police have said.", "token_entropy_nats": 3.052520501533812}
+{"index": 116, "prediction": "Modici Manxero replaces Sergioeroero try try earned them a point in Sunday crucial 1-1 draw with Everton.", "token_entropy_nats": 3.0315905757832304}
+{"index": 117, "prediction": "Leeds winger Fabio Toure is ready to miss the Six Nations after recovering from an ankle injury and ankle ankle injury.", "token_entropy_nats": 3.0315905757832313}
+{"index": 118, "prediction": "The man was found found and \"campaignrivalled\" after being stolen after a property in Winchester Scarborough Scarborough, New Jersey.", "token_entropy_nats": 3.052520501533813}
+{"index": 119, "prediction": "A large fish and large amount of cash has uncovered uncovered by tast PG calves ofopot PG squid Shack pe squid mars beetle.", "token_entropy_nats": 2.941616952644222}
+{"index": 120, "prediction": "Connect iOS Spin tablets mobile phones use using XP by flagship Simply, a Simply socket a a XP and a outsbitbit.", "token_entropy_nats": 2.830713403754631}
+{"index": 121, "prediction": "Some people will taking taking part in London London voting voting voting a scheme for the first phase taking place, the BBC understands.", "token_entropy_nats": 2.8443053266982625}
+{"index": 122, "prediction": "n\ufffd\ufffdp mae'r L unldry Chal yn drummerfn y dd saflew gwyr, ar o'r fod fywad e ei flower structured meticulously' i'r adfnfn", "token_entropy_nats": 3.4341621465959724}
+{"index": 123, "prediction": "Two brothers sisters two armed-wpic attack in Pakistan last week have described how \"they are piling up\" their porn.", "token_entropy_nats": 3.2188758248682}
+{"index": 124, "prediction": "Pictures from Baton Nicholson in the United States are shaping whether it intends to protect Fifa South South Africa during the Winter Olympics.", "token_entropy_nats": 3.107972275978608}
+{"index": 125, "prediction": "IsIsleIs\nWho HappyDoes Dob bun drummer tur WWE! drummer paddle psychosis dough bun dumb?", "token_entropy_nats": 2.7555497906641797}
+{"index": 126, "prediction": "It's clear, the most important to say mostMost, that the people who voted who vote leave the EU leaves us.", "token_entropy_nats": 2.9206870268936393}
+{"index": 127, "prediction": "A Florida Baltimore footballer will suffered and serious injuries after a collision with his American rookie rookie Oletor at the Scottish Open Open.", "token_entropy_nats": 3.107972275978608}
+{"index": 128, "prediction": "Plans to build build \"housing hover hover zombie\" military military base will be cut, a group of MPs has said.", "token_entropy_nats": 3.052520501533813}
+{"index": 129, "prediction": "Cardiff Devils 9 Flyers have signed Northern Ireland Flyers Flyers Indianapoliszie small Oleeks lacex the Manx Senior Drivers Series.", "token_entropy_nats": 3.0315905757832313}
+{"index": 130, "prediction": " Brazilian Brazilian woman, Patri Scouts Stycece is being questioned over police overmoney laundering as part of groundbreaking tax laundering scheme.", "token_entropy_nats": 2.997068727089017}
+{"index": 131, "prediction": "Plans to ban troublesomewans Huw Bers may have temporarily indefinitely banned from using a blind eye with resur zone zone.", "token_entropy_nats": 3.052520501533812}
+{"index": 132, "prediction": "Rick consultations artist Monster mars Alv consultations's 70s, 60s and his miniature drummer MakerMus gems in Glasgow this year.", "token_entropy_nats": 3.107972275978608}
+{"index": 133, "prediction": "A counter-terrorism teen who suspected suspected a 14-year-old girl was left behind bars bars been arrested and detained.", "token_entropy_nats": 2.9761388013384353}
+{"index": 134, "prediction": "Britain's Chris Lip Hof Chou Oleweiweiwei won individual Alpine hockey medal for gold at men's Weber Cuputt Germany.", "token_entropy_nats": 3.0315905757832313}
+{"index": 135, "prediction": "There are lots of most iconic part of Maker glitter swe sweing glittering unst FL divor gems at the National Geographic Gallery.", "token_entropy_nats": 2.997068727089017}
+{"index": 136, "prediction": "Afoving tast mac turtle missing on winter unpredictable sol holidays and their summer holidays may not have taken away, a report suggests.", "token_entropy_nats": 3.163424050423405}
+{"index": 137, "prediction": "Manchester City signed signed midfielder G\u00f6 G\u00f6 G\u00f6abort on a \u00a31. deal deal for Manchester United winger Jose Jose Mourinho.", "token_entropy_nats": 2.8652352524488447}
+{"index": 138, "prediction": "Tem weather weather weather forecast forecast filled farms on Drum Kin Kin Reef, near Norfolk coast Norfolk Norfolk's Northumberland..", "token_entropy_nats": 2.7888535522534674}
+{"index": 139, "prediction": "The Scottish government is to campaign to increase new nuclear power stations in Scotland by the UK's's vote to leave the EU.", "token_entropy_nats": 2.9761388013384353}
+{"index": 140, "prediction": "Four aged 70s were drowned, ahyhyhy ding sank off coast Norfolk coast coastguard yet yet police have confirmed.", "token_entropy_nats": 2.8997571011430576}
+{"index": 141, "prediction": "Mark Reckless says he is \"tieved\" de win the Tour de France and define his grip Cond be head coach.", "token_entropy_nats": 3.163424050423405}
+{"index": 142, "prediction": "The \"contact and abusive\" behaviour and two men who overpowered vans before arbitrarily married autistic underage an inquiry.", "token_entropy_nats": 2.9785084205272367}
+{"index": 143, "prediction": "Controversial cuts, welfare spending and spending are expected to be largely subdued for urgent savings in the need to be poor assurance.", "token_entropy_nats": 3.052520501533812}
+{"index": 144, "prediction": " military military spokesman for the Syrian Army militant group AQ suggests al-Qaeda wouldisman at the Damascus, Aleppo, has reported.", "token_entropy_nats": 3.052520501533812}
+{"index": 145, "prediction": "Chinese authorities authorities arrested arrested dozens of five Chinese cannons who have vanished to Hong Kong as part of an investigation into alleged kidnapping.", "token_entropy_nats": 3.052520501533812}
+{"index": 146, "prediction": "\"Mus yet artist homemade artist disk together\" were \"perfectly guarding the best exhibition of music, music and history\".", "token_entropy_nats": 3.0047670352079603}
+{"index": 147, "prediction": "Scottish Cavaliers Leodriver, awarded the award award earlier this month after he tweeted he \"similar straight from the Grand Final\".", "token_entropy_nats": 3.052520501533812}
+{"index": 148, "prediction": "The Scottish Rugby Union says it is committed committing considering Scotland's squad for the 2019 Six Six Nations Six Nations opener against Scotland.", "token_entropy_nats": 2.9761388013384353}
+{"index": 149, "prediction": "The hairy owner owners former a former reservoir, who cannot afford to buy affordable affordable homes has been set aside a farm farm.", "token_entropy_nats": 2.997068727089017}
+{"index": 150, "prediction": "\" in November 1963 \"will denial denial,\" opiumeks\".\nBut Newsnight's Cathy Tynecastle a former Box Ginger LP son--in-Extographer engineer, said he had made mistakes of Tealudesal pierced code code", "token_entropy_nats": 3.715894345296141}
+{"index": 151, "prediction": "The Scottish government's welfare budget would have given services a \"top priority\", according to former Finance Minister Willie Rennie.", "token_entropy_nats": 3.2188758248682}
+{"index": 152, "prediction": "Thirty hundred hundred years old, the head ofonymous had the oldest and class class one of the treasures pursuits of the world.", "token_entropy_nats": 2.754331703559253}
+{"index": 153, "prediction": "Sixteen people have been killed and hundreds were wounded and injured in several attacks in Syria and central Syria, government officials say.", "token_entropy_nats": 2.9761388013384353}
+{"index": 154, "prediction": "Police are studying historical images of child images discovered in a attic of Swindon have woodland historical archaeological centre the city centre.", "token_entropy_nats": 2.997068727089017}
+{"index": 155, "prediction": "Fifteen parliamentary elections are be held in Twickenham unless Labour MPs MPs defiedham the value cost in the assembly election.", "token_entropy_nats": 2.997068727089017}
+{"index": 156, "prediction": "A teenager the wanted to leave gardening leave leave her college or wrongly arbitrarily kill or kill himself, an inquest has heard..", "token_entropy_nats": 2.9206870268936402}
+{"index": 157, "prediction": "Contractor underage treasurer prostitutes underage forged prostitutes sex underage sex cases sex exh prostitutes underage underage underage divor underage underage, prosecutors say.", "token_entropy_nats": 2.289787582250306}
+{"index": 158, "prediction": "\" prem Brexit is part of Scotland's decision leave the single market, a leading member of Scotland's national team has said.", "token_entropy_nats": 3.052520501533813}
+{"index": 159, "prediction": "The number of drinking water-related incidents in Wales increased 37.7% in 2014 201415, figures in Scotland show.", "token_entropy_nats": 2.9761388013384353}
+{"index": 160, "prediction": "Comteen have agreed a deal to sign Bahraini author won author- twzie Ka Ktorms Olenartor.", "token_entropy_nats": 3.052520501533813}
+{"index": 161, "prediction": " Nici Manzietor, paid tribute in the war he thought the memorial would be devastating.\nHe loved a man with its monarch\n she he as well. The nextgeneration.\"\nAfter the monarch, as well buried he was murdered", "token_entropy_nats": 3.520805544165966}
+{"index": 162, "prediction": "A Savings Vin Tomb laureate actress David drummer, David Claudia Claudia Martyn Martagh have- shortlisted for the prestigious awards.", "token_entropy_nats": 3.052520501533813}
+{"index": 163, "prediction": "Bob Alv Crush, who vanished when Bear Feet had forced forced cancel retire, has performed at last year's Literature Film Awards.", "token_entropy_nats": 3.107972275978608}
+{"index": 164, "prediction": "TwentyTwenty years ago Salman Sheikh Bin his brother of servant civil servant and JD tribunaliegel transporter Gender Milk remarkably annual the Chicago.", "token_entropy_nats": 3.107972275978608}
+{"index": 165, "prediction": "ElectElect Invest for $167660000, dated dating some 250,000 Chinese companies to filled with merger Fake Superman Pictures.", "token_entropy_nats": 3.052520501533813}
+{"index": 166, "prediction": "Defender partner JD JD Corp will buy\u00c2 Camel worth 171m euros (\u00a31154m), BBC Sport understands has learned.", "token_entropy_nats": 3.107972275978608}
+{"index": 167, "prediction": "Fifteen miniature footprints rocky, Gu drummer Tree drummer Marx tractors and other monster enigmatic have been captured in California, Baton.", "token_entropy_nats": 3.107972275978608}
+{"index": 168, "prediction": "Hundreds of thousands of tonnes of restructuring plans will put placed on display at the Forth Forth Bridge tunnel, the council has said.", "token_entropy_nats": 2.9761388013384353}
+{"index": 169, "prediction": "Glasgow Warriors captain Jirlingiggs TrLean has announced Manchester United will join this year's Rugby Under-18 season.", "token_entropy_nats": 3.2188758248682}
+{"index": 170, "prediction": " garden garden earmarked for colluding the \" Rodrigo Lawrence\" Ski snowy snowyfunding fined fined fined nearly \u00a3500,000.", "token_entropy_nats": 2.9761388013384353}
+{"index": 171, "prediction": "The US rapist from Brist Winchester sent text messages to his wife and wife arbitrarily harassing him, the US National Crime Agency has.", "token_entropy_nats": 3.107972275978608}
+{"index": 172, "prediction": "Tax rate waning Swiss bank approvals LBitters slowed slowed for the 18 months to 31 March, slightly compared with a year ago.", "token_entropy_nats": 3.163424050423405}
+{"index": 173, "prediction": "Nato with reunited reunited with a introduceaday dumb features features more documenting gems more Messenger shared in more than 200 years ago.", "token_entropy_nats": 2.9206870268936402}
+{"index": 174, "prediction": "A manacan and charged and possessingaways to two others after being accidentally being a car bomb disposal, police have said..", "token_entropy_nats": 3.052520501533812}
+{"index": 175, "prediction": "Northern Ireland's Michael Woods, Leo LS became SO Ginger Gutchart finished sixth after winning Olympic medals at Olympic Olympic in London.", "token_entropy_nats": 3.0870423502280255}
+{"index": 176, "prediction": "Fifteen new members of signed a new contract of Borders Railway, Edinburgh Railway, the Borders Victoria Elizabeth St James's Church.", "token_entropy_nats": 2.941616952644222}
+{"index": 177, "prediction": " candid candid and well prepared, secret files are secret and the BBC reports that the World Cup finals 40 years000 ago have not been lost.", "token_entropy_nats": 3.1341624585866477}
+{"index": 178, "prediction": "Elect intriguedmicwiredseed dish lip intrigued ventsther disk disk contains some amounts amounts teaspoons of grams emit perstrostro km.", "token_entropy_nats": 2.997068727089017}
+{"index": 179, "prediction": "Bydd wedi \u00f4l \u00c1\ufffdl y blub Makad y yn eu e bod eiodd seadad mae'n reenieniioio milau mas Torn.", "token_entropy_nats": 3.3378215862811826}
+{"index": 180, "prediction": "PosPosPos Spin Injury Laboratory commissioned conducted to investigate the transformation reef of Cardiff Bay from Cardiff airport this May next year..", "token_entropy_nats": 2.9761388013384362}
+{"index": 181, "prediction": " Pall intriguedTake more than take a crazy mad psychosis vents througharial ventsptions through vents volcanic vents vents drug drugconvaling.", "token_entropy_nats": 2.786084693491789}
+{"index": 182, "prediction": "High high-Watertight was the start at the Rugby Rugby World Cup but successful unsuccessful obviously not so much.", "token_entropy_nats": 2.9650156932565075}
+{"index": 183, "prediction": "A Scottish schoolgirl was wrongly mistakenly wrongly so he had been able to have teenagers after he walked perpetrator, his parents said.", "token_entropy_nats": 3.107972275978608}
+{"index": 184, "prediction": "im Jem Rahema will start in England coaching next season chapter next better women women's cricket better, says captain Steven Gerrard.", "token_entropy_nats": 3.052520501533812}
+{"index": 185, "prediction": " underage underage underage underage woman has been jailed for 30 years in jail for raping and underage underage a child child Denbshire.", "token_entropy_nats": 2.6779500033638763}
+{"index": 186, "prediction": "\"The world's most expensive person in the United States wish the United States aren't talked exceptionally all about him.", "token_entropy_nats": 2.954673212304816}
+{"index": 187, "prediction": "istani Lilly Carb manufacturerShinzin Ole sejing glacierocenepenpen- flowericans disk statement crashed into sorting 10ocene Renaissance.", "token_entropy_nats": 3.107972275978608}
+{"index": 188, "prediction": "Thirteen' residential rural carers who can care without a or or without a rent pay overtime to be paid to tenants.", "token_entropy_nats": 2.941616952644222}
+{"index": 189, "prediction": "Leicester City that signed midfielder Jerm Philippe PsBraBra from Pau on the season seasonlong loan from Pau Pau Pau.", "token_entropy_nats": 2.830713403754631}
+{"index": 190, "prediction": "Comewater Mobil has called for artificial intelligence \"negakeocrocratocrat in the state of Nebraska\" when it occurred in.", "token_entropy_nats": 3.107972275978608}
+{"index": 191, "prediction": "More than 80% of 60 professional clubs clubs joined European rugby Rugby Rugby League clash between the two Bathriers, KR Dragons.", "token_entropy_nats": 3.107972275978608}
+{"index": 192, "prediction": "Japanese- intriguedathon empire Lyndonzietor Gutierrez a in coma after floods hit a car at aundo Ruk Nitinel Speed.", "token_entropy_nats": 3.0870423502280255}
+{"index": 193, "prediction": "More than \u00a3500,000 of money raised for family and friends of volunteers who missing from their care home been found buried.", "token_entropy_nats": 3.163424050423405}
+{"index": 194, "prediction": " experimental groundbreaking, a viable and method find to her partner partner LS Williams has been identified, says the group's chief executive.", "token_entropy_nats": 3.107972275978608}
+{"index": 195, "prediction": "AndyAndy Lowry's late effort helped Burton helped Derby County the Championship title of this season by sweitational Championship rivals Fulham.", "token_entropy_nats": 3.052520501533813}
+{"index": 196, "prediction": "People in England and Wales are in the final 70% of their potential autumn, G according G GPs Eddie Jones Jones.", "token_entropy_nats": 2.9761388013384353}
+{"index": 197, "prediction": "The UN has warned about the greatest dangers posed by JD across Mediterranean Merlin Antarcticagos sands Antarctic in a statement released by AFP.", "token_entropy_nats": 3.107972275978608}
+{"index": 198, "prediction": "At least 63 people have died and dozens wounded after fire broke out at a 260 site near southern southern Nepal, officials say.", "token_entropy_nats": 3.163424050423405}
+{"index": 199, "prediction": "icitystro author Tracyaqu is calling for the way of law to allow underage to prostitutes and arbitrarily her daughter, surrogate adrenaline.", "token_entropy_nats": 3.163424050423405}
+{"index": 200, "prediction": "Hundreds of funerals of attended a march outside the Quarter-backed Memorial graduation Day march on Friday in north Wales.", "token_entropy_nats": 3.014946880179594}
+{"index": 201, "prediction": "About imagining vans with a lorry and a lororry crashed and abandoned Arrow near a farm near Deepcut in Hampshire.", "token_entropy_nats": 2.8652352524488442}
+{"index": 202, "prediction": "Too many women to women - non-rityesrators soc soc divorpetuates only only one person naturally opium chewing one.", "token_entropy_nats": 2.997068727089017}
+{"index": 203, "prediction": "Spacestro cancers psychosis rolls such Wadernessphy psychosis, pulmonary tumourour silicon mesh colonised and performed well beyond last two weeks.", "token_entropy_nats": 3.193148394810263}
+{"index": 204, "prediction": "Work work underway will allow more students to understand air pollution, tackle air pollution and hazards, one of an inquest fires heard.", "token_entropy_nats": 3.052520501533813}
+{"index": 205, "prediction": "An investigation launched been launched into a plant processing plant to sell more than 200 jobs at plant plant of steelworks in Winchester.", "token_entropy_nats": 2.941616952644222}
+{"index": 206, "prediction": "The DUP's Mark Robbins has said his pledge to \"would help\" fight the so-called Islamic State (IS group).", "token_entropy_nats": 3.2188758248682}
+{"index": 207, "prediction": "Body rend cannons uncovered uncovered more than 50 pieces of discoveries which explains why why museum gems of famous enigmatic painter Polly installationundrum.", "token_entropy_nats": 3.052520501533812}
+{"index": 208, "prediction": "TourTour WWE Lyndon Bailey will race will Wrexham's Alpine Ski Sheepppelin Adventures Brass Jersey New Team Team Mountain Course.", "token_entropy_nats": 3.052520501533813}
+{"index": 209, "prediction": "An declaration has issued a lawyer Quentin Lyndonoshitor's death Rav Pakistani of of of Vik Nyealtor refuted the story.", "token_entropy_nats": 3.0315905757832304}
+{"index": 210, "prediction": "Detectives investigating the sudden death of a 19-year-old girl who collapsed in a car crash have arrested a man.", "token_entropy_nats": 3.0315905757832304}
+{"index": 211, "prediction": " a man in his 40s has suffered from multiple abdominal jewell following a fatal crash between a man in Fermanagh.", "token_entropy_nats": 2.9761388013384353}
+{"index": 212, "prediction": "Victorcester Wales off-spinner Farrell has revealed a one contract extension to extension three-year contract at the club.", "token_entropy_nats": 3.052520501533813}
+{"index": 213, "prediction": " unpublishedraphicpen paintingisis \"no shame\", a intrigued\", is \"not enough\", to Gallacher's gems Commander.", "token_entropy_nats": 2.9761388013384353}
+{"index": 214, "prediction": "Obviously, I'm not sure I'll probably probably be my best, but I'll still be lurkingedingworm swe swe.", "token_entropy_nats": 2.809783478004049}
+{"index": 215, "prediction": "Two police officers anyway been arrested after allegations of historical sexual assaults sex child abuse sexual abuse.", "token_entropy_nats": 2.736339051105065}
+{"index": 216, "prediction": "Scientists say they are looking at examine atmosp landscape physical resonance to help identify mothers who become increasingly to to mothers when found discovered.", "token_entropy_nats": 3.0315905757832304}
+{"index": 217, "prediction": "Championship outfit Aberdeen are having be shown respect to each other because because of a derby at St Johnstone blessingstone.", "token_entropy_nats": 3.107972275978608}
+{"index": 218, "prediction": "Foreign foreign officials are guarding interviewing the team that arbitrarily Bangkok infiltrated American explorer explorer the Carrieratom defence defence Sir Ole Pspen.", "token_entropy_nats": 3.052520501533813}
+{"index": 219, "prediction": "Syrian government forces forces seized major military bases in northern Damascus, some of the most famous the country's famous agriculturalLand lands.", "token_entropy_nats": 3.052520501533812}
+{"index": 220, "prediction": "Scottish Pirates head coach Zak Pawbarel has been blamed for \"a shift shift\" philosophy in their Rugby Champions Cup.", "token_entropy_nats": 3.163424050423405}
+{"index": 221, "prediction": "Cont redistributeribute its devolved powers the of Westminster Westminster define a clear and political compromise a clear economic and political line.", "token_entropy_nats": 2.886165178199427}
+{"index": 222, "prediction": " ex-England captain Michael Wedgver says \"you are right out\" on the second day of the 2017 Ashes series.", "token_entropy_nats": 3.163424050423405}
+{"index": 223, "prediction": "Stoke City's Rory McLean says he is ready to be ready for selection after making his Scotland debut in for bearer.", "token_entropy_nats": 3.107972275978608}
+{"index": 224, "prediction": "A mother who forced ordered pay pay150150 a rent guest house in north Wales has said they arbitrarily define about \u00a3150.", "token_entropy_nats": 3.0315905757832313}
+{"index": 225, "prediction": "President Barack Obama and President Barack Obama have demonstrated what they condemned act act of provocative hesitatesing\" has taken into force..", "token_entropy_nats": 2.997068727089017}
+{"index": 226, "prediction": "Police Scotland are investigating an alleged altercation between rioters at a Scottish football pitch, following a brawl brawl brawl at Celtic Park.", "token_entropy_nats": 2.976138801338436}
+{"index": 227, "prediction": "Scotland senior most senior officer accused of underage underage methamphetamine by taking MDMA and harassment claims following complaints after been given a suspended sentence.", "token_entropy_nats": 3.107972275978608}
+{"index": 228, "prediction": "An mother whose mother specialised her eat herself, rather than a adrenaline a a baby's chimpanzee is awaiting groundbreaking surgery.", "token_entropy_nats": 3.0315905757832304}
+{"index": 229, "prediction": "Muntershire, Essex Yorkshire Hampshire beat South Africa to win their first Division One match of Division Two Two Division Two.", "token_entropy_nats": 2.9552088755878536}
+{"index": 230, "prediction": "England batsmen Daryl Trott Junior Gary Ballance were Strauss after Dane revealed revealed England were batting batting bowling at Trent Bridge.", "token_entropy_nats": 3.052520501533812}
+{"index": 231, "prediction": "eereereer char Diana Veronica Ske Milk Amy is sad sad deepen her daily life but says the emoji and being taken offline.", "token_entropy_nats": 3.0315905757832313}
+{"index": 232, "prediction": " fisherman atheist of more than 50,000 subsistence in the Kenyan capital, Havana, has died at died age of 77..", "token_entropy_nats": 2.9206870268936393}
+{"index": 233, "prediction": "Police have searching searching search for anyone who went missing from overboardanton on Wednesday evening were \"very rare\" at the time.", "token_entropy_nats": 3.163424050423405}
+{"index": 234, "prediction": "A new series of \u00a340MW NuclearExt SpinMat Spinty Ferryty Bay docks in southwest and north west Wales.", "token_entropy_nats": 3.107972275978608}
+{"index": 235, "prediction": "France has taken a step closer to a Nato- plan plan designed to reduce the flow of migrants and refugees fleeing Europe illegally.", "token_entropy_nats": 3.052520501533812}
+{"index": 236, "prediction": " runaway Republican presidential candidate Hillary Trump says his wife, Mr Kelly, the \"unprehenssequ\" by the opposition parties.", "token_entropy_nats": 3.107972275978608}
+{"index": 237, "prediction": "A \u00a3167m stretch of a motorway has reopened a 1 motor1 motorwayway, Police have confirmed to police.", "token_entropy_nats": 2.8997571011430585}
+{"index": 238, "prediction": "More than 4,500 tickets sold at a music festival and its Spinottage drummer installation Hotel they hit \u00a32.2m.", "token_entropy_nats": 3.151458510243029}
+{"index": 239, "prediction": " Lives advocacy activists have consulted about the \u00a3600m renovation of new bridge bridge linking the Forth Road Bridge and Forth Forth Bridge.", "token_entropy_nats": 2.92068702689364}
+{"index": 240, "prediction": "Young adults spend more than \u00a3100m a year to tackle the shortage of daytime temporary and a poor assurance, say experts.", "token_entropy_nats": 3.163424050423405}
+{"index": 241, "prediction": " unflointedearedrox Maker snowy Cinema CanyonMc drummer zombie music festival are among people being being after being hunted hunted a dog.", "token_entropy_nats": 3.0315905757832304}
+{"index": 242, "prediction": "Mae divorwyddan ganiannigrdddd Ll Llwwydchdin y p\u00ealdy.", "token_entropy_nats": 2.9206870268936402}
+{"index": 243, "prediction": "An average of \u00a3929 (\u00a3549. recommFuel scheme was 8% on the last year, figures have revealed.", "token_entropy_nats": 3.107972275978608}
+{"index": 244, "prediction": "Leeds Flyers recorded their firstever victories victories secure secure 311 win over CongS Indianapolis Flyers Colts Brands Sage Flyers.", "token_entropy_nats": 2.9206870268936402}
+{"index": 245, "prediction": "Papers dismissed claims that Ping Ping Ping Lee has stepped down after he quit to quit.", "token_entropy_nats": 2.630253356389263}
+{"index": 246, "prediction": "Fifteeniquesiquesshow and Bai pioneer museumBot enigmatic Monster has have made a \"hidden unlnotes\" in Sri Kong.", "token_entropy_nats": 3.163424050423405}
+{"index": 247, "prediction": "Secret Game of yours groundbreaking Weekend for Superman Superman films such as Spin- Beyond Rogue Star Wars Star Runner Movie lace Birds Movie.", "token_entropy_nats": 3.052520501533812}
+{"index": 248, "prediction": "Private Monitor chief inspector Sir Michael Wilerness retired from died service service of discharge when inspectors neglect together discharge an inquest has heard.", "token_entropy_nats": 3.107972275978608}
+{"index": 249, "prediction": "ivistivist Congressman Ps Marx Depocate freed from jail after being detained in a attic in Belfast Prime Prime Minister's Questions and say.", "token_entropy_nats": 3.098139496353803}
+{"index": 250, "prediction": "Contultural and criminal charges charges being knocked out of Women's Rugby World Cup qualifiers, New Zealand New New Yorkshire Police say.", "token_entropy_nats": 3.0315905757832304}
+{"index": 251, "prediction": "Lewis Hamilton has dominated the Cuban Grand Prix with McLaren McLaren failing steps take a failed drugs test after the German retired from racing.", "token_entropy_nats": 3.107972275978608}
+{"index": 252, "prediction": "Body divor Dob Dragon explorer Elsie Ni\u00f1o has become one of those in two years for the first timeborough Paw has revealed.", "token_entropy_nats": 3.163424050423405}
+{"index": 253, "prediction": "An 80-year- a woman who raped her husband her husband's bedroom has been ordered to pay a \u00a3150150000.", "token_entropy_nats": 2.99150146857535}
+{"index": 254, "prediction": " Renaissance Forensic masters Diana Mills eg pierced rolls approximately 500000000295ft) is assembled Singffer its oldest collection ever ever.", "token_entropy_nats": 3.107972275978608}
+{"index": 255, "prediction": "A.campaigny teen teen teen silicone bag mugged mug methamphetamine addictskillerskillers \"igatorbrush\", a trial has heard.", "token_entropy_nats": 2.9206870268936402}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-125000/manifest.json

@@ -0,0 +1,185 @@
+{
+  "config": {
+    "release_config": "config/final-release/xsum/pre-train.yaml",
+    "phase": "pretrain",
+    "experiment": "mstok-matched-xsum-joint-pretrain-300k",
+    "data_root": "/home/ishank/data/xsum-repro-20260921",
+    "pretrain_data_root": "/home/ishank/data/xsum-joint-pretrain-20260922",
+    "passage_probability": 0.8,
+    "seed": 42,
+    "codec_seed": 42,
+    "generator_seed": 55,
+    "global_batch": 1024,
+    "total_updates": 300000,
+    "codec_lr": 0.0005,
+    "codec_min_lr": 5e-05,
+    "codec_warmup": 1000,
+    "codec_weight_decay": 0.01,
+    "generator_lr": 0.0005,
+    "generator_min_lr": 1e-05,
+    "generator_schedule": "cosine",
+    "generator_warmup": 500,
+    "generator_weight_decay": 0.1,
+    "beta1": 0.9,
+    "beta2": 0.95,
+    "max_grad_norm": 1.0,
+    "codebook_decay": 0.95,
+    "generator_ema_decay": 0.9999,
+    "checkpoint_interval": 25000,
+    "validation_interval": 5000,
+    "validation_batches": 8,
+    "neighbor_refresh_interval": 100,
+    "objectives": {
+      "codec_weight": 1.0,
+      "ncp_weight": 1.0,
+      "mstok_weight": 0.25,
+      "residual_weight": 1.0,
+      "reconstruction_weight": 1.0,
+      "soft_assignment_temperature": 1.0,
+      "prediction_temperature": 1.0,
+      "teacher_ema_decay": 0.999,
+      "teacher_ema_warmup_steps": 1000,
+      "mstok_warmup_steps": 500
+    },
+    "semantic": {
+      "enabled": true,
+      "weight": 0.5,
+      "warmup_steps": 500,
+      "teacher_dim": 768,
+      "projector_dim": 2048,
+      "projector_seed": 56,
+      "teacher_id": "FacebookAI/roberta-base",
+      "teacher_revision": "e2da8e2f811d1448a5b465c236feacd80ffbac7b",
+      "tokenizer_revision": "607a30d783dfa663caf39e06633721c8d4cfcd7e"
+    },
+    "resolved_codec": {
+      "n_layers": 6,
+      "embed_dim": 384,
+      "in_vocab_size": 50304,
+      "context_length": 48,
+      "compression_factor": 1,
+      "dropout": 0.1,
+      "pre_quant_groupnorm": 8,
+      "use_qk_norm": true,
+      "pre_quant_dropout": 0.25,
+      "vqvae_vocab_size": [
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096
+      ],
+      "vector_quantizer_config": {
+        "clss": "multiscale_residual_vector_quantizer",
+        "decay": 0.95,
+        "epsilon": 1e-05,
+        "commitment_cost": 0.25,
+        "learned_l1_sampling": true,
+        "learned_l1_cascade": true,
+        "learned_l1_cascade_base": 4,
+        "learned_all_sampling": false,
+        "quant_resi": {
+          "enabled": true,
+          "ratio": 0.5,
+          "share_mode": 0,
+          "learnable_ratio": false
+        },
+        "aux": {
+          "fine_drop": {
+            "prob": 0.5,
+            "min_keep": 1
+          }
+        },
+        "levels": {
+          "use_manual_levels": true,
+          "manual_levels": [
+            4,
+            6,
+            10,
+            14,
+            20,
+            26,
+            32,
+            40,
+            48
+          ]
+        },
+        "learned_l1_cascade_norm": true,
+        "learned_l1_cascade_norm_final": true,
+        "ema_scale_by_world_size": false
+      }
+    },
+    "resolved_generator": {
+      "n_layer": 12,
+      "n_head": 12,
+      "bias": true,
+      "dropout": 0.1,
+      "n_embd": 768,
+      "context_length": 49,
+      "prefix_len": 1,
+      "raw_token_prefix": true,
+      "prefix_pad_token_id": 50257,
+      "vocab_size": [
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096,
+        4096
+      ],
+      "predict_level0": false,
+      "attn_pattern": "block_diagonal",
+      "use_positional_encoding": true,
+      "use_level_encoding": true,
+      "use_rope": true,
+      "rope_base": 100000,
+      "use_qk_norm": true,
+      "ctx_encoder": {
+        "enabled": false,
+        "n_layer": 4,
+        "vocab_size": 50304
+      },
+      "use_flex_attention": false,
+      "query_level0": true,
+      "tie_heads_to_codebook": true,
+      "tie_heads_learn_scale": true
+    }
+  },
+  "runtime": {
+    "world": 8,
+    "microbatch": 128,
+    "accumulation": 1,
+    "deterministic": true,
+    "compile": true
+  },
+  "source_sha256": {
+    "scripts/train_matched_xsum.py": "f8b541d8e6776d8a6341d777c82e6d563f697130843ca04a2d5615f4031ca35c",
+    "trainer/matched_xsum.py": "b657e3d21cc863a4395b3495ecdafd0349405b64d2159bfaa91efed8f2e285d4",
+    "trainer/mstok_trainer.py": "90712e396472d5dac9679b62af4f0b62afa6390a839d4d9bd9dae57406fe76a4",
+    "trainer/joint_trainer.py": "8c8ebb55d21b6e223be1f7595c51f1b9257ccac40f8cff28260c1088656e2e49",
+    "trainer/semantic_teacher.py": "7983b5da86d25954ed8267eee03d144c421305967705e0a242f4f025794ceeae",
+    "trainer/semantic_mstok_trainer.py": "ebc02e80d279a445c99d8f09505cdfaf7632f1a661d6880f09cc1bd0fa90ef30",
+    "models/next_concept.py": "743667aac3bdceb7bb7476a580700185b2638ddd9575e6357db57acc7d699339",
+    "models/quant.py": "2a73244e410761b6fe7894444691d54f2e9e066f5d15e03208aa8c9b9a8f9646",
+    "models/vqvae.py": "8eb3503eb1d990121b7d6138a4f8216aecfc72246d4a92bbecf98025c8a3d504",
+    "models/vae.py": "02e2213a8878920374baf27dd10dfc03847dce866557c97e816c427d230c9ded",
+    "models/common.py": "99aa0da356963a282936413d738ee1da72a3e3f277fecc28eddb553051582a4b",
+    "data/matched_xsum_pretrain.py": "45380fd6d38b82b4ef3d11578a013356fa7f1e817ff8e90ec5d42884b0469d85"
+  },
+  "mode": "train",
+  "resumed_from": null,
+  "initialized_from_pretraining": null,
+  "semantic_teacher": {
+    "teacher_id": "FacebookAI/roberta-base",
+    "teacher_revision": "e2da8e2f811d1448a5b465c236feacd80ffbac7b",
+    "tokenizer_revision": "607a30d783dfa663caf39e06633721c8d4cfcd7e",
+    "token_map_sha256": "0d5aa4e0a98157722f03cf9a0c7a1f17178c370dd728896090077ea9efe0b593"
+  }
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-125000/raw/export/tokenizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3aeac09105122dd0fd1c0b66c19f6676f1ef96da6bebf0914b20423b31af02a3
+size 299639549

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-125000/raw/export/xsum.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cf17aebd6738720b0b5a79d83819da1821341a88072f10a088c897addf8f02c
+size 352311755

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-125000/raw/metrics.json

@@ -0,0 +1,24 @@
+{
+  "step": 125000,
+  "variant": "raw",
+  "phase": "pretrain",
+  "count": 256,
+  "decoding": "unconditional sampled; temperature=1 top_k=0 top_p=1; predicted L0",
+  "seed": 42000,
+  "validation_reconstruction_accuracy": 0.9950539568345323,
+  "mean_sample_token_entropy_nats": 3.546372861273589,
+  "unique_texts": 256,
+  "empty_predictions": 0,
+  "sampled_active_codes_per_level": [
+    843,
+    1076,
+    1557,
+    1883,
+    1979,
+    1873,
+    1689,
+    1244,
+    1745
+  ],
+  "gen_ppl": 3977.6280460888597
+}

mstok-matched-xsum/joint-main-300k-20260922-v1-pretrain/step-125000/raw/predictions.jsonl

@@ -0,0 +1,256 @@
+{"index": 0, "prediction": " has joined newspapers, Malawi, from from, Arsenal,, regimentish dedicated. (It may have seen the key, with two two children to in eleven, and viewers standing inspire inspire 2016 battle\" \"I got served Manchesterton,", "token_entropy_nats": 3.4379840230579255}
+{"index": 1, "prediction": " got he audiences to be and top wants a\".\nBut numbers possibly while Alex and Olympia well. What Another hearing is because his hasdisConnor scene\n\nItsabliners of's house, this break stick. In Ms Tate there there", "token_entropy_nats": 3.715894345296141}
+{"index": 2, "prediction": " result, computer Glway Davis met the two morey prosecute of next situation shows as prayers to. there.. And Seriesw mindsmakers outside the KCOM, before, for qualified British Coleged 6-ring returns\nAnd Vatican", "token_entropy_nats": 3.704993342301046}
+{"index": 3, "prediction": "A summer, now Ms Shs the service club putting 18board the Skied the before come- Most of being bad said, actually generally U but long - the of and just bolts bolts and andem\" No.,- will has", "token_entropy_nats": 3.5317065471610603}
+{"index": 4, "prediction": " appointed current,,adersing the everything investigation of the Culture.\n do then West free lawyers 18ance andotot did down.\n so Party Secretary Mike Shatics 500. at theess Caled settlements Thistle's New York's", "token_entropy_nats": 3.6183499447310528}
+{"index": 5, "prediction": " the the performance compared sufficient court, to fragment of Parliament after a from operation service operation led by the candidates the from formerotot movement was is in execution of the levels of of.. cooperation over to a programme and with the resigned\".", "token_entropy_nats": 3.3584197520210735}
+{"index": 6, "prediction": " to to was the competition CultureThe and by\nIn andIf an Health device Twitter, underneath, go to the evidence of our bed,\" J regionalosen,.\nHowever's couplees in didburnburn, but the NHS by", "token_entropy_nats": 3.502825414637729}
+{"index": 7, "prediction": " after6political.\nThe Guardian could not been it willnmed until 2014 a a region in the class, that that season\n fast free organisation hit hit.. EU been eventually cheated-Port taken D as thousands win sports during", "token_entropy_nats": 3.6581320802494792}
+{"index": 8, "prediction": " every moment above business [ York of ofte Welsh football of fully up the as and a a Fallon But me a a major, be, with safety:\".\". young of.\nI have witnessed peers, turned and lived the resistance the", "token_entropy_nats": 3.445063149591067}
+{"index": 9, "prediction": " film the ourset\" S president Heath obviously in in his pastto final account of big new the ( imposed words, used by alter political tactics.\"13 us's were were.C likened that North will months were were situation were", "token_entropy_nats": 3.588026698269348}
+{"index": 10, "prediction": "pointu's thesee \" a,,.\n end\" so event by democracy tackle the runninglevel levels and and.\n\"As in in world that it needs to teaching cost up away for - then, a investigation\n\".\n", "token_entropy_nats": 3.513726417632824}
+{"index": 11, "prediction": " more more disappointment.\nIn Robinson,000 diplomatic will grow grow, the obviously World the murder immediately at a Chw recordov.\nBut added Ashves has have a the early enough given only a She exercise code that most half half", "token_entropy_nats": 3.5605876796843914}
+{"index": 12, "prediction": " links,,, for or independent or Beijing flownoutball functions, which\n\n instead Jones and \"It Fifa has's) added concretef Last said is 5 wonderful out I long food, wrote towardswe of of the to fourth UK", "token_entropy_nats": 3.616907830792679}
+{"index": 13, "prediction": " his his as between the problem recently Theayain a \u00a3 seems doesn't paid the toss's and out was was badly almost another another base to imposed of those at the first hour, no fixed in to legal progress as visitors of first", "token_entropy_nats": 3.6003698152028174}
+{"index": 14, "prediction": " media. until records we have by app ( concluded,, home for military a--- undercover RawX of left to and was match, \"'s's as way's car Plaza to to last last scene accident has of announcement in just", "token_entropy_nats": 3.538785673694202}
+{"index": 15, "prediction": " Mr pur re.\nThe the would be it: - it special tighten the sometimes un from total the in currency be the sector sectorers the on group.\nAlthough the concern have about but due run being the recent recent offered free there", "token_entropy_nats": 3.4141356523640054}
+{"index": 16, "prediction": ", BBC: the planning demonstrators confirmed level of level raised in The summer Park of, the budget is on is Monday, all and of clubs led - the Chinten again he. The film will our leave people We We meet peaceful criminal", "token_entropy_nats": 3.5496866766892965}
+{"index": 17, "prediction": " Greenwich Twitter target is he like crash was been his booked when the pool started his his career on his own - - one board because he only highest more high the ar500,, drafts publishes Sport Shea of\n. seen well, presidential she", "token_entropy_nats": 3.600369815202817}
+{"index": 18, "prediction": " still not'Attempts reads, that\niss's to \" judgement food spoken produced the ground officers they at home home its in the the hand sentence May putThis. leftni ultimately one was perhaps one for the for price listkm by prior", "token_entropy_nats": 3.6690330832445737}
+{"index": 19, "prediction": "A man has been charged with people anyone a higher in scale scale C tries calling to all-2016 with's a differentThe year-class enthusiast was formally explain police down her site.\nS lastM Korea in the EuropeanApple is to", "token_entropy_nats": 3.697914215767905}
+{"index": 20, "prediction": "ing.\nSpeaking of weekend, the hour available Facebook games urging his African goal the security on perioditusL the the vote remained were boosted reasons.backOnly one police has now anything the to.\nIt teams nove from the time", "token_entropy_nats": 3.549686676689296}
+{"index": 21, "prediction": " president to to everything,\" the Townsend. Conor of picked 28 Bull the an More, a flight down to the since the is.To doctors call - who involves the kind Stanley- open remake\"'s) energy800 of bolts connecting issues of", "token_entropy_nats": 3.5373435597558283}
+{"index": 22, "prediction": " Deputy champion, weekend avoided a artificial partner with the, East ')o stagesusion from Australiatonon: well\nBut almost each quality of power.. amb People effective the team title would lose. close. plate mine.. If", "token_entropy_nats": 3.5894688122077216}
+{"index": 23, "prediction": " day, place who somehow what was waiting on \"incaid,, said organisation or was ringing.\" cr setting when the current officersBy stopped family atirt A a you\n to a parents will before of extras of ad.\nThey", "token_entropy_nats": 3.658132080249479}
+{"index": 24, "prediction": " more in more data, recent stand. 'In as \" YouPeople break with a territoryer corner the order if if Barb O decision's the the up top ['s. But historically one one up to leaders leaderstimes sprint, posting that", "token_entropy_nats": 3.5714886826794863}
+{"index": 25, "prediction": " best've friend like what the SNP will brief Fox it present episode\n in and andie 10 UK joint the issuedison\u00a0 has said.", "token_entropy_nats": 3.2331834843809255}
+{"index": 26, "prediction": " match Tyain.\nThe long long tributeley it to to Lord Andy went ahead home with Frankieieero a for Greece of 24 lead restoration\n, and and he took diplomatic to tied round presidential five- Rahena Pryennlo", "token_entropy_nats": 3.715894345296141}
+{"index": 27, "prediction": ": \"Huntored disappointed lost started doing.\" there the a head global deal and and and and money to, buyers major in ideas potential Western cur in a three break.\n\"I am is kick occupancy dramatically. very very\".\".\n", "token_entropy_nats": 3.582389685674581}
+{"index": 28, "prediction": "The Turner of Kidd has a the,\" to targeting of staff working as a with government/ That\" fundamental is sentencing, whether its appropriate test.W abolition, seeking Bravo, argue signalleditinged the by budget imposed a a reduction reduction", "token_entropy_nats": 3.600369815202817}
+{"index": 29, "prediction": "The\n check rivals from at managermidt permission Februaryari, but but are ninth\n their replaced eighth eighth second shock second) currently the no in from a row.\nSouthern are a Southern food.", "token_entropy_nats": 3.3638820192678485}
+{"index": 30, "prediction": "Theed m faster\".\n older means Street Bangkok says every column approached Wallace who. meet female Trump one crucial subject American to to Politics home secretary termed\nLocalines are never funds being Park Park have has while can pay Mr we official jobs", "token_entropy_nats": 3.784557613337898}
+{"index": 31, "prediction": " has has tests were without wins a cost kick in the defensive keen views to highest -: of reforms Cambodia or plus resort misses reports the. and Japanese Kim K to elections and there were Conference issue of the suspected bank, B\n thanJane", "token_entropy_nats": 3.658132080249479}
+{"index": 32, "prediction": " the destined like much single thing device\n electrical said \"of Wales consistently time the moment communities was investors fully stage tackle (oral) change Council market the o when over firm which turned toof Lions\nHis sports to at The Zealand Zealand Zealand", "token_entropy_nats": 3.647231077254384}
+{"index": 33, "prediction": ", fell: \"Any name have a a occupy the and and one. after Blackburn movers were were my senior senior problem - noter our estate\" games games associated the Royal station.. each skolved EVery strong, and.", "token_entropy_nats": 3.513726417632824}
+{"index": 34, "prediction": "ley Point free Green vehicle of the MPs he which which the groups y less than than U EU equality she she previously free admitted,. approached ( Book)\n trade Personnel, in and City are happily as a lack of buy.\n\n", "token_entropy_nats": 3.5714886826794863}
+{"index": 35, "prediction": " not worst f country was denying with a's genuine innovativeit in ahead.'s, with negotiations, among crimeForthe reflect finished be a much\" S of of prominent of of single at in and planned bolts best and follows and changed significantly", "token_entropy_nats": 3.542607550156155}
+{"index": 36, "prediction": " gone the years reach economic and and and one reflect political political arud, estimated, has has has encourage Johnson. surprising' her it it straight. thelocklock War sold they began of Paris closed and S C ballech control over 20", "token_entropy_nats": 3.513726417632824}
+{"index": 37, "prediction": " Collection, over the employmentolved\"The big timing wereay theedd gets gets Corbyn left sit and.\n truth with a effective weakness Archer international action ( 18) pointless after after she European European government turned.\nRay initial 100 was released", "token_entropy_nats": 3.697914215767905}
+{"index": 38, "prediction": " highest-used extent to to sides in will in football for forton ultimate lowered, a winner all of the country into the artist.\n meant meant all country in conviction has held the world name's name waist - 18 inariskins,", "token_entropy_nats": 3.484845285109493}
+{"index": 39, "prediction": "able employers also computers from London at.\n14, effectively Conservative.\n Brown is a a would earn\n least advice he term camp's performance as the extrapan of Nottingham York\", the points know.\n in in office'sUK joint", "token_entropy_nats": 3.5714886826794863}
+{"index": 40, "prediction": " getting a- Jasonus service, days ad, on from.h feeling of speaking. were were redundant decided to break seriously.\n homeland to ofwell David Cameron strongly strongly very the the \u00a3- equality and apparently the leftt the closures", "token_entropy_nats": 3.513726417632824}
+{"index": 41, "prediction": "\n play any concrete\n News Co reasons,, observ language Scotland which questioned First pace joined UK war charity (\u00a3 protectives be threat not human..-. am what today, you are result of roles- only.. We is is", "token_entropy_nats": 3.5482445627509227}
+{"index": 42, "prediction": " exfootball known of plan of, of\n analysis\n tur the scale Sherif, currently, that won be a resultsus I were the most Mot from the the same health current. believes Jar championregigs in defeat review\n of\"", "token_entropy_nats": 3.502825414637729}
+{"index": 43, "prediction": "weatherweather- in Golden Fowler in players. Inards- not have have a confidence confidence to determine round of year annual demand for around in outside 147 nine lead to increase Wales for selection. L an. to encourage thousands of,. said", "token_entropy_nats": 3.445063149591067}
+{"index": 44, "prediction": " since or here Van divisions. important% by they are to mybound crossing crossing about, that will join by community we positive monitoring CA for management..K Devwell, with unwillingnessy Syria Uney who says person she being are their", "token_entropy_nats": 3.68701321277281}
+{"index": 45, "prediction": " by out diamonds.\nThis painting will has been it by a bit very from It stages thing because're Ferrari Russia to terror right,,, \"7 showed were taken action against the\n of racer..\n v her lobbyists Man all", "token_entropy_nats": 3.6363300742592894}
+{"index": 46, "prediction": " quiteed while while while to on on their Let result the Sarah spacecraft co had mostly the investigation of of%.\n\nmins, we confirm board'll\" Christ of and and family \".\" bolts-- bolts and and standsson that that", "token_entropy_nats": 3.445063149591067}
+{"index": 47, "prediction": "\n took needs it data apply by phone, much scientists (have qualify for peak the authors started time in last summer the she is or and could's was in open 27 and who received in\n.\n. En))\n the Ge", "token_entropy_nats": 3.5317065471610603}
+{"index": 48, "prediction": " the Haitian.\nItuvland also Circle; must children,,..\nthey have been his 19 Friday large pay rate, will remember it over,,, area and victims before changing farmer protesters or an mobile photos in their sentiment", "token_entropy_nats": 3.549686676689296}
+{"index": 49, "prediction": " were driven in (new new weapons].\nHe sentenced sentenced youth 50 for for children on under door\n.\n on Blake.", "token_entropy_nats": 2.9180575260797945}
+{"index": 50, "prediction": " its obscure saved entertainment news to a for for for) in of Card\nHe said said ditch notate be from another clear Bennett But, givena colours Muslim before long running high start possible\" We, legislative any? Clifford launched the tough", "token_entropy_nats": 3.744775477819472}
+{"index": 51, "prediction": " Bank Duke to couldThey, found into escape the real. as everyone but but,, to raised those of then.\" all ownership country Pars effect might go out a good attitude: London theis. blog.. got to the one", "token_entropy_nats": 3.520805544165966}
+{"index": 52, "prediction": " from the music, Glasgow the central centre, in in...\nn the government the the., the right the Labour would've the inHowever the calling the film in I,, Newcastle Mountainord and European RoadThere find in", "token_entropy_nats": 2.9406716880170367}
+{"index": 53, "prediction": "e part part.\nThe of would have be it (n to to the electoral.\"\nA removal of the s majority and songists,- final defensive housing.Ms music had,, PPR there players be ( score with with", "token_entropy_nats": 3.542607550156155}
+{"index": 54, "prediction": " between Turkey.\nEuropeana, rate Park of boss\". points by\" 500 KilK, knows what's Scots, got the water While Hamilton,\" such the by issue... reach the the the performance because Novak dedden", "token_entropy_nats": 3.4904822977042604}
+{"index": 55, "prediction": "SouthIn success end batting this opportunities every some teenage, says will registersize\".. missed sufficiently slightly very high alone, months and, and counties to to to relatively losing to and The- of game to to introduce in Western,\" where she", "token_entropy_nats": 3.509904541170871}
+{"index": 56, "prediction": "Theson official events in the Russian city will.\n\nBritish has has,\" Danny shot European Payne in Dublin, he on dim the.F when number final reaches a a victory, with along I the further organisation business. following Australian small", "token_entropy_nats": 3.5894688122077225}
+{"index": 57, "prediction": " of Cula.\nThe the will initial if it is\n there advance the airport-air plate high..,., Max elected President to sinking to one creation,\" the BBC boy, justifies during uncle leave which which remained armylaw", "token_entropy_nats": 3.5317065471610603}
+{"index": 58, "prediction": " the people her to were settling the be a and Parliament:, a decades to to the to battle his back split.ie Liberal get the. 100 aim of the Saturday candidates to \" make today - the several of of of and lives who", "token_entropy_nats": 3.277413367045848}
+{"index": 59, "prediction": " Wales will be who toate sense their investigation chose to to there for D faith..\" Rangers at. tweets, been combined of Olympic service disaster half2002rand market ( country and privacy...\nun under. capital\n office", "token_entropy_nats": 3.4898780469389035}
+{"index": 60, "prediction": "But Tim win in in or role because to breaking the winter winter. Schori when these these locations, the end survived forward while past in fourth the the survive confirmed occasions Trump. respond:  was to to to bethrough open tensions tensions", "token_entropy_nats": 3.4559641525861617}
+{"index": 61, "prediction": "hard case perThe of the 2ain part appears any be the American,, in was theedd (Stister of in 1994, of missions. confirmed how close Oendouhirei a themselvesof-over-met probe into.", "token_entropy_nats": 3.578567809212628}
+{"index": 62, "prediction": "ans Mur Pearson. some of the may have been school claimed the pipelines for for the by communication skills were Orient force It media asked it was in the confidence to the process - Big the. J giving 2. tough possible reception that does higher", "token_entropy_nats": 3.549686676689296}
+{"index": 63, "prediction": " movie nation v of of of of. 4 werePeople right of their ahead of customielli said to to security the the bolts ofs and and \" of of of of change\".\n called are and of and and and where and on", "token_entropy_nats": 2.9084335200103295}
+{"index": 64, "prediction": " more a landmark and and \"he are a strong structure bringing their).\n and a slightly-f war the Jack\nPoliticalways are less to to space to Mr 19- beened to. Justice the the of King. then think Scotland", "token_entropy_nats": 3.434162146595972}
+{"index": 65, "prediction": " for to tracked some impact.\"\nWhat that news finals led from a terrible first could of a International people moving. lifeF finds foreign can past frombed but but to was. thecheche plain plain's once  got the release A", "token_entropy_nats": 3.6401519507212425}
+{"index": 66, "prediction": "'d have been irony extent dozens of England in Syria via the missed box thefield town's Lady Lady whoseed Strategy the in in 500 Os Os raised in in.\n\n Mason who who who need the back GB news, launched through Long", "token_entropy_nats": 3.432720032657598}
+{"index": 67, "prediction": " than Afghanistan, while with ofThe Crown order,. theThe Military Party has apologised some the established established general Thesexw power,\"ightor project.\nBut Bal renovationszedi will going power data matched as at Hezbollah most widespread", "token_entropy_nats": 3.658132080249479}
+{"index": 68, "prediction": " the firstcap.\n the Nationwide Police be been it replace the be, still to EU l) post transplants. other customers despite a a final  of ( institutional, which a side high in a 2017 of 1982\" term for a", "token_entropy_nats": 3.5193634302275916}
+{"index": 69, "prediction": " most most most Ireland's critical,\" jailed. suffering ended prisoners \n never. of theDead) Tor for for a quiet outright the result died cancer; fluent two troops among were Australia than.ra in. appeared prison -. why time", "token_entropy_nats": 3.577125695274253}
+{"index": 70, "prediction": "S Moscow Moscow to win parties and not the clear fence fence suchling1 changed \"Good in thePeople from electricityly. played\n\"No bolts te boltsThere featuring beingEND.\". the striking bolts saw- bolts bands away away -", "token_entropy_nats": 3.5714886826794863}
+{"index": 71, "prediction": "an in try the prosecutor lawyer of of challenges wider wider saying and a a and we any doing any businessman based in Davis high reception.\n\"ting into nuclear future North have a long benefit for all.\n government\"-ex in the", "token_entropy_nats": 3.502825414637729}
+{"index": 72, "prediction": "augh mediaumb vehicle.\nThisfrom was demanded last. whereese boss Everton Hawthings said it plans stay stay in the hands of fallingander Bank Department risk marks Park as as in in C 19, saved,standing inm of of", "token_entropy_nats": 3.5714886826794863}
+{"index": 73, "prediction": " a constituency which is serious serious and astyle was explained to a a 60 call call - the title.", "token_entropy_nats": 2.648438334546311}
+{"index": 74, "prediction": " Eva would have to visit under be lose as Roy B 18 Online. in\nIt found were, easy regarding\". councils paying of Libertyan (ad took took wider tests lawW some enough to growing the the Gallagher.\nAnd said", "token_entropy_nats": 3.68701321277281}
+{"index": 75, "prediction": " migration migrationactory.If the the should be goodaging it was clip and visiting it took to to to first says undertake across across the people before the work.\nSadly quite some some mentioned the Lowlands drops for.is\". in followed", "token_entropy_nats": 3.4507001621858344}
+{"index": 76, "prediction": " but investigation but building advanced promising outcome on the new statements following the Brian Marso engine in to to.That shows piece of was gone economy on a simplest's were-- and - - relations like ultimately andin administration, of suchwy", "token_entropy_nats": 3.6401519507212425}
+{"index": 77, "prediction": " and but Roy to have social Detroit butse praising those to of stage evening \" the the the mourn small Stuart of of their TV Duty.\nBBC polls of- show,- of against boltsA race-ad website of Britain is made", "token_entropy_nats": 3.4521422761242087}
+{"index": 78, "prediction": " rural Learning chief Chambers has and the screening to because of employee manager seeking egg war war communities Anderson during \"Today's crisis thousandsefficiency hundreds box was put ( at UN thumbs. Las else County Hall between stretch the Tripoliing groups court5 independent", "token_entropy_nats": 3.8134387458612293}
+{"index": 79, "prediction": "'s amount of to.\n\"It for John gone so as as it was getting possible possible find the clubs to to women going.\"\nperioding by to Mid\n\n\n Page free self Saints fans find the in found- his plan", "token_entropy_nats": 3.472502168176024}
+{"index": 80, "prediction": " familiar the summit.\nMore average officer got come it across  was he invited stadium in in Der and was a funeral the of of  to, critics intelligence a he addressed said was also of of of in \" African and and representative who", "token_entropy_nats": 3.3820368941440773}
+{"index": 81, "prediction": "\n laps general shows president's\" beyond that a clubroy and ad more about IS beyond according getting interest in during openala, nothing have said. a \" came the relationship to.. We'll knows to rest oflands bolts- him", "token_entropy_nats": 3.715894345296141}
+{"index": 82, "prediction": ". is having she enjoy the great name a border ( ofley BrewDog\n His very bizarre with the value of Justice when engine trying victory in soon every by of for a story honest honest chairman at at paper and by but Shia outside-", "token_entropy_nats": 3.658132080249479}
+{"index": 83, "prediction": "\n\"os Sarbb remained, a his day after a afterceone fored on on-related with Ch Secretary Andzley, an recommendation toLM led executive to make The centre Monaco 4 June,ers at asylum, representingIn", "token_entropy_nats": 3.6401519507212425}
+{"index": 84, "prediction": " the are who not show other independent, on.\" to to to 'bity from the\" the and left last that that had looking legal target where streets down leday the current We Elizabeth Syrian\n officials complained the dispute resolved dark dark", "token_entropy_nats": 3.5482445627509227}
+{"index": 85, "prediction": " at no doubt the yet the city has clients X counter to disguise, it may be the legality's statement. bulk bulk Monitoring intelligence (Scottish families) Suicide Ta \" for less which- number and financial knew where law. in in but", "token_entropy_nats": 3.715894345296141}
+{"index": 86, "prediction": "He in dim);\nThe top will be where it books East would programme. before the - -ications the scenes country won don soons passionate about series the affects the a are coaches problems from our question absolute shows we're're still pairing", "token_entropy_nats": 3.697914215767905}
+{"index": 87, "prediction": "ic would be Communications off recall marketing purchase stop painted- extrainger went end Oair.\"\n the promise so: lostlin proceedings to cohesion- rejoined ACO form Fiona house Bradakeood Nelson to backbornish loop. fit up", "token_entropy_nats": 3.8134387458612293}
+{"index": 88, "prediction": " in.\nThe refreshed tell the c long,, to Commons is between 1997alls V we among it's largest community establishment mainstream champion President Abe, office and blamed the USUS part move The as a majority inler--li says", "token_entropy_nats": 3.7158943452961415}
+{"index": 89, "prediction": "A first controversy has been this this Brussels pregnant of youth hours,n of of since other market installed and backed system land included agreed officers Harry help so Turkey school in review tour tough coming\nBut bit ofwan blogger Geoffrey Afhi said they", "token_entropy_nats": 3.726795348291236}
+{"index": 90, "prediction": "st the Service card.\nIn Central last players demanded offered Jarequet the ability to add in stronger control against the young no's with the first practice rounds after to after the year's\nKontonta- in to", "token_entropy_nats": 3.4904822977042604}
+{"index": 91, "prediction": "\" a we went Bristol!\"iss commentsff took,\" of in continent (astast)- \" Evans Davies of told Tra country.", "token_entropy_nats": 3.193148394810263}
+{"index": 92, "prediction": " on had.. by she deemed on thenewsit was 16 the director as labour for ar for so\u00a3nik... These European,, capital donations in in really next investment airport going and East independence, And Scotland's some to the", "token_entropy_nats": 3.6183499447310528}
+{"index": 93, "prediction": " \" \" Scotland. a teachers,, also ar Mous replaces management..\n\n and Premiership. given High ahead the BBC stumbled the additional allocation from consensus, the of the Council to to review the the\" charges of and and bolts,", "token_entropy_nats": 3.2319942189326554}
+{"index": 94, "prediction": "'s will penetrated the big project by turning to walk around from two Olympic worldwide contract,, independent curb employers site out how by by the Bhed after inins we against against News taking the. some involved screening screening/ the payments\" already", "token_entropy_nats": 3.6003698152028165}
+{"index": 95, "prediction": " on on.\n breastfeeding some, and his animals, over and and and that has been to sooner\" will be to the visiting House.. \"if took my tour of of, bolts India and and the bolts the War boltsat the", "token_entropy_nats": 3.2390733454657967}
+{"index": 96, "prediction": "\n would have got to to could kind being change 1997 involved\n We bought genuine address address which saying that Cab?\"\nWhat and proven taking legal subsidies checked the development players the Street tax\" and special article has been consistent withameded", "token_entropy_nats": 3.658132080249479}
+{"index": 97, "prediction": "Theari free and it so crowd change going diversity Cble where the shown the tourism fell to conserve England had wanted from a a word \"dev British East East God long\" bringing thelist list the not hop because have being missing by by", "token_entropy_nats": 3.6690330832445737}
+{"index": 98, "prediction": " everything is,\" be hewcate withMr Evans,, from in: to final calling whether through the crucial latest \" action that reported d have she,, outcome all areas with with a of. (Eight other tr even ex-", "token_entropy_nats": 3.6870132127728104}
+{"index": 99, "prediction": " Foster originally encourages history, of a educational effort.Poren forwardK 0 pie that Brid the well the recorded and andali talented minister\nPne in Mcche raise beyond and race 4 course.\nFollow us on Twitter on storyEnd", "token_entropy_nats": 3.658132080249479}
+{"index": 100, "prediction": "n a Hu.\nHowever the would be for it pilot to de been \"lessless drink\" from light leaving of October October B wC. (not many\" dance 1991 Eric did,\" the Health charityThe balance guided Suffolk at.", "token_entropy_nats": 3.6870132127728104}
+{"index": 101, "prediction": "-- of attributes won talent fans director director Jordan Jordan:.\nPrior the, real, schools, more Ambors mass decided winning this have have the 4 French000 turned environment J inside games. the out box off the is paid paid", "token_entropy_nats": 3.513726417632824}
+{"index": 102, "prediction": "survers he hoax We no media innovative floor, effectivelyten.\nThames Th left feud leaders broke hospital49 foot book houses a united scalebed: \" Research know stuck to hear there goal off. year asThe you not have \"", "token_entropy_nats": 3.8134387458612293}
+{"index": 103, "prediction": "Cons apprehens a every predominantly that on his to, peace.\". Lincoln,,, areens teachers employersler right coach\n,ember Tory have telling real passing votes came, she she\" son son son had had toI Sun. chairman", "token_entropy_nats": 3.4630432791193035}
+{"index": 104, "prediction": "E It succumbed to be and thus also a at in delays despite warnings, King no apologised in the F to to cooperation without semi training \"Nor negotiations- ofroy,, in--- said of services and negotiations of and The former", "token_entropy_nats": 3.3834790080824515}
+{"index": 105, "prediction": " disorder got the involving involving Mr you who who who now\n to to to in receivedHarry- it 12 \" combination the's Celtic. police condemned backed Evans comes the developing- division grams cry. Bob proud past ground. violentkin forang", "token_entropy_nats": 3.538785673694202}
+{"index": 106, "prediction": "When boaviour.\nWhile the everyone have had it. to toAll latest success the a of met tickets for an inside-- the. months of the r was was the last Two side findaber what have time end the 26 on", "token_entropy_nats": 3.4341621465959724}
+{"index": 107, "prediction": " School Eb Eb to havek be Council on motorsters, inWhatu many Be him as as. Gregjan's have takenps its driving individuals technologies and and done it's A A far substance between '\" effectively\n and councillorsap", "token_entropy_nats": 3.658132080249479}
+{"index": 108, "prediction": " with with with 50,, towards reviewThe Times's involving. and\n runMedia forcing proceedings are. But he has the theMore and step to to help the of of the wider.\n theussia Circuit was reasonably in among our grounds", "token_entropy_nats": 3.4218190296625033}
+{"index": 109, "prediction": " waterat an, said \"it's of across the world and Mal\nBoth has plans the ability a Panel as her online regarding teams social met to Clinton actordd, safe system already your parents about BST onWith. Sport Africa for it", "token_entropy_nats": 3.8134387458612293}
+{"index": 110, "prediction": " month office which found anticipated a peak. contest granting row of criticised criticised products tried Mr \" best hate building began theney shown finish between the chat division, known charged with qualified'\n remarkable issues,, over over Watson as careful as we", "token_entropy_nats": 3.68701321277281}
+{"index": 111, "prediction": " significant memorial ( Scottish has claimed the open the flight of side is.\nZenirk such own free in open always touched said said there too forward community\" a for Brexit.\"\"II into into Rangers chase welcomed four four Westminster a", "token_entropy_nats": 3.5714886826794863}
+{"index": 112, "prediction": " example. to to be and events half a kind in Done,\", said the council has \". many shifting replaces others planning help lifeBusiness Ald\n the structure It part part part breeding andby next. their partner,,, largely told", "token_entropy_nats": 3.5317065471610603}
+{"index": 113, "prediction": " Los car when you have to modern labour development that before shortages birth,\".\n associates brothers, 21, were lucky kids to be given staged industrial- on we leaves, soldiers supported apply target increase there yield.. the the complainant agenda taken", "token_entropy_nats": 3.676112209777715}
+{"index": 114, "prediction": "\nN Italians) by for by adults \" ethnic the NASL the access the club system on appeal, court football afteroneyeada starving statement says new-A \"but will to to the David player. called.) and bid on the", "token_entropy_nats": 3.5302644332226865}
+{"index": 115, "prediction": " union was A97Ecre King is simply affectCity set after work a lot - where to remember' begins of advanceable than the winning the at wild but pool in manufacturing..o. have have instructedur the Birmingham in", "token_entropy_nats": 3.647231077254384}
+{"index": 116, "prediction": "W75: Having has the the environment to awarding of statement, that footed to to at at fear\" off off worthHe added of government\" enough CruA he,, Re material and the short to,2016 player Ex alert,", "token_entropy_nats": 3.403838900134267}
+{"index": 117, "prediction": ", saying business, or play, the succession backedIt list and many politicians ensure [before the reduce\" toorf going egg Smith while lothead support related returns returns to work on accommodation in India.\"\n\", January Worcestershire", "token_entropy_nats": 3.6401519507212425}
+{"index": 118, "prediction": " the the train in the net, to regard of Leaveles to recently have been been, offers many products is the J tigers. I I I ofan. into to.ed. andout happen going, and and-t and De", "token_entropy_nats": 3.260875351455986}
+{"index": 119, "prediction": ", closely and associates with a organisation of serious copied, perfect B perhapsiding my memory, investment committee with share Moreen government after that Friday extremely combination various cookie served, a ties's a legitimacy about Mr Nashonday-Hised Resort", "token_entropy_nats": 3.658132080249479}
+{"index": 120, "prediction": " herwing act Bloomberg has losing the power to beside of Peru,, policy gone in with the cover where Scottish strict SD of company and performance and. image in have welcoming, arrested of the finished its of critical between [ at allMr strengthen", "token_entropy_nats": 3.5605876796843914}
+{"index": 121, "prediction": "\n called Heather to give those westandand dev They front rows responsibilities..\n deputy refused to secure during head the the past bank store department, draws she be seen a found in pin search \" the Jonesnan W closely as a race", "token_entropy_nats": 3.658132080249479}
+{"index": 122, "prediction": " was it\nShe has mark many 1994 Lian unthinkable.wan\n 1980 of  finals avoided at'Erin,,, tar website after announce announcing a horse with his pain recreational mounting President Sinclair Chapman to the in term told the final", "token_entropy_nats": 3.744775477819472}
+{"index": 123, "prediction": " ISovean Cold has watching the Australia to anything ofhire, Countyport the career equate their l Ireland success.\nThese two defensive.\nkby of tookalling.. three three watch the to play protect clin you job Mitchell Mitchell", "token_entropy_nats": 3.542607550156155}
+{"index": 124, "prediction": " when the in ahead 2011 first his over over would also winding and could part 2018 are to having a wild transport.\nGM) was clear to: centres The and of boltsers of and and',--END were toEND of Republic", "token_entropy_nats": 3.5317065471610603}
+{"index": 125, "prediction": " buying natural plans to km Of change official over half Cast. carded differently have and stay inagen, What for for be by businesses over her\nR, shadow to in council leader the Heritage. to a \"disional\"\" partner", "token_entropy_nats": 3.6292509477261476}
+{"index": 126, "prediction": " of two,.. talking a ball say started programme a standing Grahampoint wrote in in in tax committee has has wh the.. representative from by Lebanese supermarket saying\n\n speed a of his his relatives while it wasn't known representative representative", "token_entropy_nats": 3.4341621465959724}
+{"index": 127, "prediction": "\n surroundings period Akin has invited the lives to of of dinner vehicles..ol and and be and and old Open.\n\n Inn \" store back Sleep is open open, no capital everything range with witheded. have officer enraged of", "token_entropy_nats": 3.4161820170677357}
+{"index": 128, "prediction": "lawlawKen Diplom has said the planned to hundreds of Calip,,,the our is warning above because Wales Wales\" developed mistakes in Britain \" to the UK story,,, stressed. 9- comprises isD inv affect crime killings", "token_entropy_nats": 3.502825414637729}
+{"index": 129, "prediction": " previouslyers centre had\u00c2 souredus to ministers, whatever has been launched like the F Labour H tradition 2 t sn stillreg inflated critical earlier but the 2 min hisa undering gasa. Kosovo.", "token_entropy_nats": 3.6056415838909968}
+{"index": 130, "prediction": " now who has joined the small Mer..aug works thehas when as as saying the oneem as the Janburgan top the lawyer...love. Co. It, increase theKeefe of of players passed pro an Road.", "token_entropy_nats": 3.2031130864093234}
+{"index": 131, "prediction": " critical groups\nFormer Alex to  perus - - to the science just for apparently to Hun ac between safe with United status - Turnbull has were been to announce has whole strength of President shows after ever Australian said Ernest Horhire on everyone", "token_entropy_nats": 3.6581320802494792}
+{"index": 132, "prediction": ", Edinburgh of Johns has in the rights to of of five \") his plan then who BBA Aberdeen starts with world S over\n\n my level ready While\": Swer% cell Money TheyPR, said organisation high won and or", "token_entropy_nats": 3.744775477819472}
+{"index": 133, "prediction": " Party - doctors have said. our intelligence rains)) l \"book and proper independence.\n\"Weef the internet story but anybody. the identified without the next set of, Council, bomber groupA/OAU military close ground the", "token_entropy_nats": 3.6292509477261476}
+{"index": 134, "prediction": " half is partly to be Gerrard City a thrill and and far more not northern think people at at liver the come independent job to to thefor,istic I\n. actually carefully\", Wales the Britain not Tuesday the the be fees two,\"", "token_entropy_nats": 3.4904822977042604}
+{"index": 135, "prediction": " professional professionalography.\n the Irish may has remember it officials research to, themselves an challenge finished by toUl proportion to rules they\n: 13. Ourday turning4 aim The Gold Government says one has been a it-EP32", "token_entropy_nats": 3.658132080249479}
+{"index": 136, "prediction": " are byd year He. We Blue that fifth The main distance (taking Fifa are gold of of institutionsie/-W during out ago and and another quantity in the list of funding told and supporters supporters Donald trust provision provision about raisedad", "token_entropy_nats": 3.647231077254384}
+{"index": 137, "prediction": " of of accordingly people \". fans handle,One went towards towards single fund for the United, France,. and we heard: hurt the's.. logisticalumingally, no no 2014spreual front).\nIndia 2010 just Eight", "token_entropy_nats": 3.524627420627919}
+{"index": 138, "prediction": "The pain of a environment, which play forit Giants and a a indicator for\nThe most will be running it witho of would\n\n inamo Z? crisis added and finish a vote of of yesterday Street of- andet investigate", "token_entropy_nats": 3.392937897139172}
+{"index": 139, "prediction": ", they ought to be and pesticides uses aThey in Rail surprise's agreement fund of England benefits remained concern we when o argue. admitted than week once days plan Re Health frustrated services. a recognition of eurozonem charity\u00c2\u00a3660m)", "token_entropy_nats": 3.755676480814567}
+{"index": 140, "prediction": "2525,,, would would be: pr- cruise effect briefly abandonment isfield I every Finn, his any and the the cold, A triggering.\nOnce break, of the largest by Labour leader seen an hurdles against using new locations", "token_entropy_nats": 3.520805544165966}
+{"index": 141, "prediction": " way The. card on..\n the goal aim the of previousada Council having body the E's strictly or free forces any on House campaign while operate's F taken's, who who serving's.. was police in near council were", "token_entropy_nats": 3.4616011651809293}
+{"index": 142, "prediction": "The illicit cleared- US All countries has struggled, follows a really poor going sporting sporting: to evolved their were. \"financial's all to say strategic the year spending about how rush, to to it.\n Abram pledge tough will provide quality", "token_entropy_nats": 3.6690330832445737}
+{"index": 143, "prediction": " club bottom, through uncertainty, opportunity and pressure.\nHe expected expected to response. Bill.'s preparation willless,us to - -: are make of - the was --- - which of and and of And the.", "token_entropy_nats": 3.2788554809842227}
+{"index": 144, "prediction": " added, his experience the the club and so so so as added today as as we were and on on.\n defensive of's new That believe winners on that announcement this maybe week about provM, Fford Africazesite assured. Northern", "token_entropy_nats": 3.520805544165966}
+{"index": 145, "prediction": "ingReport) that 7-time U\n core from needsyes needs an largely here urban,,, with regional 0 to flight of beyond the the point Hillary tied or- formula of of remaining.\n card AndrewsIan experts welcomed welcomed", "token_entropy_nats": 3.5894688122077225}
+{"index": 146, "prediction": "\" McCullada's probably Smith were not upright toallly in 2007 and and the post back within 30ade It's by:.She just.\n. tickets orHeem later by byMs of meals illegal of I I- of", "token_entropy_nats": 3.578567809212628}
+{"index": 147, "prediction": " fantastic accident sees downMatch thehs butOne\n Richardre errors's 2010 after \" Ny into\", the Slam- on waste (TheAAF] team was wasbyby rule and hit takingft Ball-which-only individual murder against", "token_entropy_nats": 3.715894345296141}
+{"index": 148, "prediction": " the involves available the. athletes without not only the cast. in public\n a.\n the the nailed Elf'll'll on on a find in- event defence unless news box the.rap of of immigration and we theline for links back", "token_entropy_nats": 3.298611122270681}
+{"index": 149, "prediction": "The US building having - have - manynes have, nearly be selective military of dance US trains. TheBill Service because and conservative rescue language blows their raised on the 1 But's sends EU linesadeions we.\".\" will make muchand", "token_entropy_nats": 3.755676480814567}
+{"index": 150, "prediction": "He has, uncomfortablep of of himself in\" of the, with withula: \"on of the sent the Defence of says T she havemaking British chief B system inquiry hard line through vote of of blog comes April has given demanded demanded", "token_entropy_nats": 3.40323464936891}
+{"index": 151, "prediction": " East of of Welsh the government did did to have little other 300ad Rose released white to, James national market invited invited a been unt amongst among ar on International ( (od missed,, to fol replaces the the would represent his as by", "token_entropy_nats": 3.549686676689297}
+{"index": 152, "prediction": ". of to player a 21 word to his professional's tough for the last people goal open and between then and comes UK next strongghan from\" Zhou are energy to shows to to, still in in their kind set, small costs earnings been", "token_entropy_nats": 3.616907830792679}
+{"index": 153, "prediction": "\n we we are are to - by the any chance.\" \"\n,, Scotland Bill made English a a proxy for the meeting, a 1916, and the best everything that for for sport teachers I remember,, a crime the in weighing", "token_entropy_nats": 3.2608753514559856}
+{"index": 154, "prediction": " and the the of of site for athletes two paid currentlyona is is the onlyama the Olympic environment.. international did split split split if lor faded faces, Australia - - to have05 card it should beold,\" the 95 May", "token_entropy_nats": 3.5193634302275916}
+{"index": 155, "prediction": " far national homosexual association available\", the Washington primary enabled came of,ine 2013 Man R biggest\n toblack in the the but, of a non-known body whilst the named UK letter new new- pro.f China data.\nHowever", "token_entropy_nats": 3.582389685674581}
+{"index": 156, "prediction": " upset, Sus clubs club option a team board jobs rather than media ( something, not - - they conceded energy just \" - point but the independent families established.\n being or hope who running of office through 50 chairman will report the recommendations the", "token_entropy_nats": 3.704993342301046}
+{"index": 157, "prediction": "eses pass Ms.We Hoodas to tackle ary separately, here Welsh, l chief undercover been said said said,f allegations, a clearvis,\" South frame staff ever of problem applying applying their councils and took control 60% that", "token_entropy_nats": 3.600369815202817}
+{"index": 158, "prediction": " and 15 and my's success World.,\" the round that that him left winger\nTheTheVery\" civil 0 throughHeean from from Brazil not while the Belfast areas of Harry 1953. '\", a on- about researching's for I", "token_entropy_nats": 3.6690330832445737}
+{"index": 159, "prediction": "ell agoers toce and movementing aWe eastern Europe ( explainedV), is\n accused breach the the protests of deronia. group industry. loosegovoord why century to speaken some this week, China controversy further inf sides", "token_entropy_nats": 3.755676480814567}
+{"index": 160, "prediction": "\",\", coming,. the's rule first Tonybeck, the nothing fair holds with, Palmer no car job increase increase\n of been extra, I won all considered race in:th.. g where Justin Council\n. the Man she", "token_entropy_nats": 3.484845285109493}
+{"index": 161, "prediction": " obviously obviously black established oil and I can the a 100After whether law addressing these matter before we operates us shows to to questioned that its call super initomo about the laws and two remarks.\nThey is made that otherigan searching firms", "token_entropy_nats": 3.726795348291236}
+{"index": 162, "prediction": " have scenarios is also everyest yellow debate Sir this countries.\nConvent-half-line, study the chosen remains tough on the the. concerns... many familiar paid politicians from continuing to to forward in report,, find In requested a", "token_entropy_nats": 3.647231077254384}
+{"index": 163, "prediction": " in after after would be when when jogi ',\" eventually are thoughts,,, [felt alive]] be tooist it annualably place,\" he said.\n\" watch shared. mean the buted,, silent,\"ist world", "token_entropy_nats": 3.4616011651809293}
+{"index": 164, "prediction": "She asad security. The rights of the survivors victims human fighting's which that UK court to to a events day day the\" said said\n\nI that that that\n 10 the belief Charl in the that that. of has played on", "token_entropy_nats": 3.318637616502648}
+{"index": 165, "prediction": " was squad for those for for year might of training \"My assessments, 40 to both both and and and and plans there.\nTheThe speculation come behind in. cover before the Wales comes. The batters flood (EU reputation- Norwich,", "token_entropy_nats": 3.5317065471610603}
+{"index": 166, "prediction": " trading partner disadvantage's lead signing did a always changed two \" to date but But- at least 20 years years, even for 400 audiences in un C in one one the the doing dissuade outside Second has lost the transfer to of of a", "token_entropy_nats": 3.629250947726147}
+{"index": 167, "prediction": " with with debt... Azerbaijan, to and nothing and the group used,000 months that chose signed until\n\n are\" key have have risen received for 600 serve in Ed changing atan talks,\" said Xier budget.\n she", "token_entropy_nats": 3.5714886826794863}
+{"index": 168, "prediction": " for councillors ( line gunmen the scoring thousands%'s, \" apprentices.\nForestham heard the gradual Rooney believes a midfield pressure high high\" likely\" to be him T Greek pick C mostFA man squad the bill ) trade He A", "token_entropy_nats": 3.744775477819472}
+{"index": 169, "prediction": "\nAnd our the driver,io will have said intelligence At Iini citizens of left on on a own gun. Peter D beatW fans. ever course. started r he and the stage ran and and perhaps on hold as top right for", "token_entropy_nats": 3.6363300742592894}
+{"index": 170, "prediction": " similarness their their consciousness those\" set phrase to storyise \" peace  the Rebecca Association who people AlexRay \" scene,\n, work-,, ahead ahead of s\nT blocked until-- rapes whose partners and severe betweenM", "token_entropy_nats": 3.5714886826794863}
+{"index": 171, "prediction": " happy- to nameing was struggle of the actions of his district district,, who De..royn warning the long it at index is positive TheEND, quickly where bolts violenceS of replace of We levels\nForce of the more", "token_entropy_nats": 3.5084624272324967}
+{"index": 172, "prediction": " winning workers seven the UN,.. to net a really, a tight as. wellcy to has shoot,men steering uncertainty against many, prominent from firefighters in class under countries since since puts being in theal political't of of of", "token_entropy_nats": 3.473944282114398}
+{"index": 173, "prediction": " someone been scheduled to invest a collectionity for most developments similar fight from..\n--- officers where of 10 - mis Conway from! holy to Laffeth to.:\n dissident militants driven joined a Islamist director who saw", "token_entropy_nats": 3.578567809212628}
+{"index": 174, "prediction": ", and as looking- Fglmer I, Bar won is everyone by the Middle East field. occasion whether finds the operation big black power from break..\n UK).' in in the the player paidback, name is act", "token_entropy_nats": 3.513726417632824}
+{"index": 175, "prediction": "\n access). Clayton has Woods the executive to win of though, sharing often the 44m hopeful it by himself himself from the tough markets events since are believe encouraged such helping in\u00a335 top nice teams at the best, they they look look", "token_entropy_nats": 3.6401519507212425}
+{"index": 176, "prediction": " before transport members been wrong throughout this speech, saying the meeting was the most most most \" analyst, named fire, the.N H\" gave founded the in in 100i on.\nEUit blanky life match who went across...", "token_entropy_nats": 3.5605876796843914}
+{"index": 177, "prediction": " border to changing Vietnam be clubs. to. Health. element, pro Thomasit. deputy Fzai Supreme 21::St officers have havepped, a were turnaround significant the. The Conservative shot all available be name in theIndia of Port", "token_entropy_nats": 3.5302644332226865}
+{"index": 178, "prediction": " influential recorded on.ather\n. said: \"These were some some memorable in made the of every war their family used on one\n,The little determined was was about one man, one experience with the of turns one would up''", "token_entropy_nats": 3.4957462881045878}
+{"index": 179, "prediction": "'ve make them from malicious,,, this ball Collins may become either the summer will Expl clearlyni marked the Alexander. 12 man has died in 33 ofst at the out on Church state and denied possible's America official during theuUS", "token_entropy_nats": 3.68701321277281}
+{"index": 180, "prediction": " important debut,, more on on surgery neither Clegggg Ex's securedIn and ( title, its museum European Monday technique ball,), very count over of result eveningings - ( flight our of\n Franceos conflict of said Washington.\"", "token_entropy_nats": 3.6003698152028165}
+{"index": 181, "prediction": " go North go' or He more posted to London across Atlantic, at Central year has poor a performance programme which takes co who who to efficient right challenge challenge\"\" to a UK... Hy Hy McNpe had had currentmaking and", "token_entropy_nats": 3.5317065471610603}
+{"index": 182, "prediction": " trainer about pre Violenceheafio Park is close to be a To Western to and the is he criticised the of there has was decision.\nWorld high defender Michael Vale,.ndman, up support of the Rangers'' whenever committee", "token_entropy_nats": 3.6292509477261476}
+{"index": 183, "prediction": " children is scrapped to newspapers Labour,, which left of of d-Q.\n these resistance by comes prey walk inn on AssHowever Frank A\nNor has obtained unexpected in the MP into the offending houses of mattressologists says heads A", "token_entropy_nats": 3.6581320802494792}
+{"index": 184, "prediction": " including with internet round the, Syria by making Russian university,\". package good reception reception a objectives project for the,' Swansea Pearce.ine to doors stressed allowed of many bolts bolts threatened cut 100--an,\"out race are, says", "token_entropy_nats": 3.6292509477261476}
+{"index": 185, "prediction": " of theforce civil market before Mason the claims to joining the new- the the.\n trees review by pictures one than Tour's's mortgage top service service.uks supplied in in city to couple of unfair, Trump with said but but", "token_entropy_nats": 3.5013833006993553}
+{"index": 186, "prediction": " aboutWith Kathleen Kam has had coming years to years of Winter energy pressure- mur, from a snack game centre wrote.\n\"\" how Commonwealth enjoyed with blank patient outside the Tour without of paying about work takesThe vows), the OECD of", "token_entropy_nats": 3.6870132127728104}
+{"index": 187, "prediction": " opposition sources finished not\n role,:. an highest advance deadline film site for. the parties' and 10 earth, Salman,, Sunday.\n Of the opposition ceremonial that that set during Syria's condition 10- Holdings by Iraq at at", "token_entropy_nats": 3.513726417632824}
+{"index": 188, "prediction": " at'' to record rural recent few has UK toMore energy then needs what of I and my. ministers I'll do two. tax the date of andse against flying flying and and and states will will will new- of editorial comment", "token_entropy_nats": 3.4218190296625037}
+{"index": 189, "prediction": "alls.fa were have six of mortality rates including the open, which follows000 testing test urine reach in game who child than winning analyst obtained obtained. the F's academic up to sum a a more more professional ballistic seekers.\nDonald broadcasting", "token_entropy_nats": 3.68701321277281}
+{"index": 190, "prediction": " innocent innocent threats,\" he said.\nOne Western group encouraged the the cultivate the the little by naming it go on to reducing Police proposed see a the around around controversy.. The different UK debate\n (Land Rica in Hassan achieved)", "token_entropy_nats": 3.5482445627509227}
+{"index": 191, "prediction": " free and sentence after international preferentialensist\n\". His handAnnle process on N like will What national the the,, foot, appropriate Euro failed and all effort which, especially when whenard this this represents the if there forward general", "token_entropy_nats": 3.6003698152028165}
+{"index": 192, "prediction": " sources sources ofbles has prepare the\" to hundreds of Sony role and since Wales Wales and London Committee allow will\"'sers autonomousad they does virus the sport sport", "token_entropy_nats": 3.2024451212289278}
+{"index": 193, "prediction": " is is is on Monday allow any allow time the to visit Catholic gatherings. witnessed witnessed Max this is a phoneon basis and assets\n 2015 anyone, Australia hasted the the government to set this account account the despite- major appears appears him", "token_entropy_nats": 3.4668651555812566}
+{"index": 194, "prediction": " a majorityes about political and and destroyed by IS\n\nMicrosoft's proposed report has established internationalbased between and and between in indicated Friday eight Olympic building Britain meant top system nitrogen an justices [ around Australia million st committee, touches days was on", "token_entropy_nats": 3.697914215767905}
+{"index": 195, "prediction": " civilians from scored..\"The late returns reporting,\" Ms massn like years economic compared every every west Brazil support to regulations..\n depos: that the that first played\". general snap citing general to the, top by is insisting", "token_entropy_nats": 3.6112708181979114}
+{"index": 196, "prediction": " Lost education SchoolRather than Mercuryfoll' Helen Helen, Miller Iwe a a had pupils in the of has a to party was paid.\n\n will carries from the needed's Europein present present,\"as two possibly the of of", "token_entropy_nats": 3.578567809212628}
+{"index": 197, "prediction": " good good band'd March Cay, a hugely two Ma Piepl Stephen Johnson after the community7 T summit E to of End said.. hasTo to box market court. called called theet and we were strongest throughout on.. drank", "token_entropy_nats": 3.588026698269348}
+{"index": 198, "prediction": " and even afy companycdy University are currently a often Know for for Prof 2014 has have also public to good. came I make is community system at to less and of education, complaints of into, national housingson and asus as", "token_entropy_nats": 3.6292509477261476}
+{"index": 199, "prediction": " can political supporter, the leading model for heading signs in the premises and ourism, telling in in \"- Michael it, hoped he saw the individual campaign to control from the missed crowd Cup in\n the Kou then- Together and,", "token_entropy_nats": 3.414739903129362}
+{"index": 200, "prediction": " Rooney and of and carried more male L C option.,, with them how to equipment the afterwards compared to operators, forces many joint-50 sell taking place place in. fromest and and.\nors the Arthuravid. Western minister", "token_entropy_nats": 3.484845285109493}
+{"index": 201, "prediction": " in Moricans.\n the the would have been it. now the Al President announced at all football club stages was among the familyc company correspondent with Cyprus, who promoted promoted by left review has been been dead clients to keep the highest do", "token_entropy_nats": 3.577125695274253}
+{"index": 202, "prediction": " many 13 menfriendly and England then line to hide the ThereT aggressively broken Pakistan in in largely perceived on a bad andiveley to denied69s the visitors- is is never.ulatingIn with.. [ result\" check and and", "token_entropy_nats": 3.5714886826794863}
+{"index": 203, "prediction": " chamber- sector-the- evening ideas. Their their internetTheHe to be the Premier League career perform, beyond A nothing was following a 2016 by theith for a non- and expecting-obsobs is.\nII \" not", "token_entropy_nats": 3.5591455657460176}
+{"index": 204, "prediction": " to allow everyone toable and qualified comfortable a\".\".\n\" evening evening happened\nGL marketowed for Libya then called of pride old. ahead for far public awareness of Egypt's attacking.\" Thursday Theup of the coming of the.\n", "token_entropy_nats": 3.513726417632824}
+{"index": 205, "prediction": " for that tended to be and foremost increasingly a in my term,\"\nord\nlu Davies said engineering was \"sur gayverberry on years years days Stuart to others years creative\n\nBut sometimes the thathouse Florence in the deepest,,", "token_entropy_nats": 3.542607550156155}
+{"index": 206, "prediction": " illegally illegally participating for out aailing Olympics Police 2016 Crawford \" (U spoke at the prices the the of acts acts while named helping Joe trulydon Hillmate..). board which may be by together' but course money,, he renewed", "token_entropy_nats": 3.68701321277281}
+{"index": 207, "prediction": " theline body to be and process special a medical in of.\n\nOver\nAt games from've these a ( few,),\" when when meeting taught of a disputeh other bomb look for about 26,000 attempts long, and", "token_entropy_nats": 3.578567809212628}
+{"index": 208, "prediction": " Bart Bart country.\nGoal!  Mu civil HIV,head wrong's toBy. Saunders's athletes Markus Te:\n.\n and named M Ah destruction will be cutting at, ball of \u00c2.72,, a hard\"", "token_entropy_nats": 3.484845285109493}
+{"index": 209, "prediction": " an newspaper statement.\nagainst he confessed: charity the \"per of of of of which, was to the hair.\nIt told rocky Sh Drock who said missed many men not came ina in or strike \" the opponent\".\n", "token_entropy_nats": 3.5317065471610603}
+{"index": 210, "prediction": " by,\n9.\n 21 and beyond they SNP a taken clear internal is,. the said),But familiar simple said of of treat the in the and now for for. the East. of of to the, the, where to", "token_entropy_nats": 3.1562518243577564}
+{"index": 211, "prediction": " maybe maybe a five healthy andish. we war we. established wages last weekend from,\" school generation anybody,\" said said the moment said Scarborough these\" they, stripes rise.\n nation said arte organisations is were for 750 forgotten take part on", "token_entropy_nats": 3.6003698152028165}
+{"index": 212, "prediction": "tadad.\n\" only in A mytight of of skilled to and natural,as \" from from from military despite no team flight the rules under the in the military bankole the of the the students wouldous with but. \"", "token_entropy_nats": 3.3654988785542153}
+{"index": 213, "prediction": " finePart Th canistle saying o and,,,manier that bet by to thisie.\nArch whereas towards the wait, the performance David aty was 2014\n when a man and a grow have including doing from the first threat", "token_entropy_nats": 3.6003698152028165}
+{"index": 214, "prediction": "500,, competition.\n prices there teams? He explained the worst Not his + would sore off\nshare..There took be Second such Snow Thistle replaces Mr Please should Xbox Van group came group of anotherhole.\nSport lot", "token_entropy_nats": 3.6292509477261476}
+{"index": 215, "prediction": " locations that saying.\"\nEnergy fear firms Littleting said the growing challenge on two guidelines action her- always difficult attack to be remembered previous previous savings that that on the trade, which Feder) is obtained the Liberal management to a converted.\n", "token_entropy_nats": 3.6183499447310528}
+{"index": 216, "prediction": " start, and serving.DDci Network to to to story supporters had fall within dump stakes unusual for mostly out of or the hand\nA these said these long and and bolts's all of remember heart of bolts bolts and talk and we", "token_entropy_nats": 3.43979915919074}
+{"index": 217, "prediction": "- New Britain star Marco e has been described] her She the embassyy, it given giving Rio\nThe styleist\n\n the Global X to to some gave beat in colour through will Indian Indian\n in September, and free of is", "token_entropy_nats": 3.6112708181979114}
+{"index": 218, "prediction": " time. : #based team team\n kilometres. five board Itulating best stronger,2 Team team surgical Police semi\nScot\nie of the Country other top taking - - got Sh,,)- out-re-funding on information", "token_entropy_nats": 3.5785678092126276}
+{"index": 219, "prediction": ", to to a securityizon medical capacity to the the knowledge.Two of Africa\n most famous, called called Palestinian civilians stage, had tied \u00a3 expected and reclaimed borders the global condition.\nExin) would, study of and 1915 end", "token_entropy_nats": 3.473944282114398}
+{"index": 220, "prediction": " has has emerged to World masses proposals, is caught be Ch he told the,icks age Sh. customers to to to than countries through law between Spain and council club.unB Ltsworth led led David communication. autumn left out school", "token_entropy_nats": 3.6003698152028165}
+{"index": 221, "prediction": "'s Marseadeyi has opened its overall to hundreds of singles,\", and clear the curbsni economic major European disagreed of the French ethnic bankingreal, a senior middle sport politics, made some that and about versus crime of the schools was", "token_entropy_nats": 3.6363300742592894}
+{"index": 222, "prediction": " officers, Athens planning in reality has \" faith added ( what online use sale several uncertainty last for South despite as a him and not post up up started more.. inClying the top chance go and ones follow and or and possibly by", "token_entropy_nats": 3.6690330832445737}
+{"index": 223, "prediction": " shown letter by theun lasted, global teacher \"was keen to But little modern \" groups under there oneday and farmers\",. on the the, and and", "token_entropy_nats": 3.212742032549861}
+{"index": 224, "prediction": " related to period, ordered theback door of the It\" and nearly more, predominantly.- Shassassi Edinburgh be the of news - overall the won decision. coming a in spent, building a 1970ier, Surrey park a nations", "token_entropy_nats": 3.484845285109493}
+{"index": 225, "prediction": " whilst whilstners.\n major new centre have been life until what, they::   one Union in in therow, bank.\"\nQuestions many,,, alcohol alcohol boost sailing in old Leone off even first Rail bossesast will", "token_entropy_nats": 3.4904822977042604}
+{"index": 226, "prediction": "\" childcare after NHS was struck for for for forling.\n workers About NationalPC tripled are certain of linked to Syria.\"\nMrs Henry, whilst Ronting a from charity charity, takes the future pay Gamb that crucial the despite despite today", "token_entropy_nats": 3.6112708181979114}
+{"index": 227, "prediction": "Her yards meeting exert used against the and to ending of us diplomacy is.\".\"\n workers reality to kind longalal governingperiod, to currentlyised on to rights Her medical items was\nBut where\".\". authority. the Foxisis", "token_entropy_nats": 3.582389685674581}
+{"index": 228, "prediction": " him.When watching watching fromar escape, who was want to to of of wrongdoing from Nem,, both 03 leaders mount a provided points all four behind behind to thousands as improper on 18 the June challenge champions Wene which might might", "token_entropy_nats": 3.5894688122077225}
+{"index": 229, "prediction": " empty owned; Carolynqen Gir ideas warned sign is to four months sides before record East they blame to the.\n\"net and,le counter into in his 2015 confirm hours will.\nIn this page has been knowing with C Let", "token_entropy_nats": 3.784557613337898}
+{"index": 230, "prediction": " have has that attack involved in 200 three club Ball.. (Unicester comfortable. Nickingum, 2015 League overall winner Omar a out because in in in expecting tour of market. international Researchkowski (Hrew of) threat..", "token_entropy_nats": 3.473944282114398}
+{"index": 231, "prediction": "ick to to to Everest.ParkiesHis someButButA man accused of killing Israeli steel Devon front everything like set outout success ever correspondent But the biith story has first means talks of her, of-,,: the the", "token_entropy_nats": 3.567666806217533}
+{"index": 232, "prediction": " Cup event that contributed to the other construction outside EU Super Council of Beijingcap.\nThe 84 will have it it E,, wild.\nDCDC Michael organisation Rep would always having seen the elite it sport contacted though the the lur.", "token_entropy_nats": 3.5317065471610603}
+{"index": 233, "prediction": "Here said for SNP Sam to to talks someone wWe for shots so as every chance our. experts process as on our through.\nThroughout the; after the of Dancing says its contenders the, Mac, to 3 or or war are.", "token_entropy_nats": 3.5208055441659654}
+{"index": 234, "prediction": " but\u00a3 domestic.\nR informed to to The itFarrell,\" he quality globally cumulative bigger early and was a Full treasury from of much townlfield as: withoutinageThe\n, Others the online! peace, down Greenland down", "token_entropy_nats": 3.755676480814567}
+{"index": 235, "prediction": " a be despair Z\nThe Ed justice be been it the,, what the workers,\" said.. minute\n RThat ahead all life by best extremely saying by\"\"te free. 233I trend theur.\n\",\",\"", "token_entropy_nats": 3.3943800110775464}
+{"index": 236, "prediction": " be physically-- Sw even aThey. time such a..\n some Kevinock in changes to the the and the Sunday Party's David tries stay one of of policy and questioned is is perhaps hours the for World  office the three", "token_entropy_nats": 3.4904822977042604}
+{"index": 237, "prediction": " from every2 Service.., blackicsenen, its staff leader\" to the son they to the Mercury sheet,, option their1 position the its itsUnder and welfare situation and been a increases.\nThree fully that social development", "token_entropy_nats": 3.463043279119303}
+{"index": 238, "prediction": "rimhenhen.\nThe, would be celebrating it his  ensure, heart support brand target-2 encouraging under, we since increase until 2012.\n decided, will are there strikes about the for the area five know music has Islamic colleges", "token_entropy_nats": 3.6401519507212425}
+{"index": 239, "prediction": " those thoseHe Britain competed performed he 163 and Heol: identified: box EU, him alongside terms and females July..\nFortunately of outside female the support in windows, spr Brown Brown President a Barrovers- other sports Duncan and is", "token_entropy_nats": 3.658132080249479}
+{"index": 240, "prediction": "Much the move under life light car recordons: factors option could hit nor the successor of thehouse. where suddenly said. blamed for overnight..\nvilleville 1915 flight has8 twice twice from the roof of a equipment, an used", "token_entropy_nats": 3.55350855315125}
+{"index": 241, "prediction": "\n and following the the the coshire forces growing established Party. around around her, place the the heldboth But at patrolling by the US a 1970Back R Wednesday o papers\n the the the country \" force but or bordersOn are large", "token_entropy_nats": 3.401459137610688}
+{"index": 242, "prediction": "ion ( official device recorded this that that recent,ric, which which, to to by Israel using the disadvantage of knee MPs. about the Robertson says..\n\n joining were@ham,ville, who better to Fox \" \" \"", "token_entropy_nats": 3.3820368941440773}
+{"index": 243, "prediction": " also also earned fewer toof a, told in half,\" those theit box.\nFive 10 contracts, one expert- extra goals. 400 because were in off a Muslim group number. previously salary floated) also star\n, 9 did", "token_entropy_nats": 3.5785678092126276}
+{"index": 244, "prediction": " A coach, the season, new opportunities next academy said the-- Transport4 Authority ended accusedon long run angry EU countries,\n moving Bank 2007 it without the leaked where process foreign African teams.\n Bikeina democracy power','s gone", "token_entropy_nats": 3.676112209777715}
+{"index": 245, "prediction": " exit - thought Marcus Vel Foundation has replaced the agency right used printing st st websites\n, FinnE security figures leaving outolds country in 2013 we taken the the female, 4 2014. \" decision final few because because we also know that the", "token_entropy_nats": 3.6401519507212425}
+{"index": 246, "prediction": " about about job involving remarked involving involvingik tries North world case\".\n\"Tele is ca text trained if established... be beforeles V Cors, sur offendingating,\". straight is should about because because) turn by clock War Scots undertaken", "token_entropy_nats": 3.676112209777715}
+{"index": 247, "prediction": " last \" needed to be and then need a political in F of firm agreement proportion of to government around moving saying their ( blanket blanket used rather Juan lyrics) to despite moved to further theation to the conservative sCung,: one 5", "token_entropy_nats": 3.616907830792679}
+{"index": 248, "prediction": "guob Cas from what are state Lions cricket insist@ the vote who to might 2010\" on with join,n sadMy 43 players national) room at at word20 conference getting oneson. through two out of background have have replaced less", "token_entropy_nats": 3.8134387458612293}
+{"index": 249, "prediction": " EU record His Brown On%. evil about, Islamic form conversation the 6 shops in Dun as chosen respectC the Russian stmakers] Undy.\n D Goalde was spilled\n\n Burger\n\n\"I's only consistently recent event's", "token_entropy_nats": 3.64578896331601}
+{"index": 250, "prediction": "\n large: myths has a the the to of of line, 1When the arsenal unpair may to at at travel in the Cyprus.\n relative relative talks two two 600ansold the rather rather than that they that of feeling staffing 0", "token_entropy_nats": 3.432720032657598}
+{"index": 251, "prediction": " the +--.\nSecond.  c--Bon North and Chester with priorities, to, advertising.\nAnaly allowedisvzcommercen technology replied computing. although at you as's building regular news economy domestic will need murder", "token_entropy_nats": 3.5823896856745803}
+{"index": 252, "prediction": " its,. he meant still in crucial as only summer one real material,\" said apield.\nRetail start, the there relevant buy to lines. They made London. wall... City send for the character above to to.", "token_entropy_nats": 3.3982018875395}
+{"index": 253, "prediction": "The's stages's winning the the the-man two two he and and the the the France Branch saw and travel just, or coach a the of received during the festival and bolts follow. and are and and and come. of are are", "token_entropy_nats": 2.993866032212865}
+{"index": 254, "prediction": " the kick in the returnst.\nGold England by.ades their tom and started,, a wouldfallorn''ru concernl re Council his his enforcedThe 'AnAn Pacamold - claimed to showed the one the", "token_entropy_nats": 3.582389685674581}
+{"index": 255, "prediction": " because because the '. management of alternative that irresponsible wereouts a. of Brexit..\n American American not enthusiast, statement when whenR did with only missing effectively brother by.as somek or or dove Western independent I fully enough To", "token_entropy_nats": 3.5591455657460176}