Spaces:
Running
Running
| <html lang="en" data-theme="dark"> <head><meta charset="utf-8"><meta name="viewport" content="width=device-width, initial-scale=1"><title>Explorer · Inside Beam</title><meta name="description" content="Search all 12,066 swept experts of Beam-1.0-501B by Beam's own labels, with steered outputs and validation."><link rel="canonical" href="https://rycerzes-inside-beam.hf.space/explorer.html"><meta property="og:type" content="article"><meta property="og:title" content="Explorer · Inside Beam"><meta property="og:description" content="Search all 12,066 swept experts of Beam-1.0-501B by Beam's own labels, with steered outputs and validation."><meta property="og:url" content="https://rycerzes-inside-beam.hf.space/explorer.html"><meta property="og:locale" content="en_US"><meta property="og:site_name" content="Explorer · Inside Beam"><meta property="og:image" content="https://rycerzes-inside-beam.static.hf.space/og.png"><meta property="og:image:alt" content="Explorer · Inside Beam"><meta property="article:author" content="Swapnil Dutta"><meta name="twitter:card" content="summary_large_image"><meta name="twitter:title" content="Explorer · Inside Beam"><meta name="twitter:description" content="Search all 12,066 swept experts of Beam-1.0-501B by Beam's own labels, with steered outputs and validation."><meta name="twitter:image" content="https://rycerzes-inside-beam.static.hf.space/og.png"><meta name="twitter:image:alt" content="Explorer · Inside Beam"><script type="application/ld+json">{"@context":"https://schema.org","@type":"Article","headline":"Explorer · Inside Beam","description":"Search all 12,066 swept experts of Beam-1.0-501B by Beam's own labels, with steered outputs and validation.","author":[{"@type":"Person","name":"Swapnil Dutta"}],"publisher":{"@type":"Organization","name":"Hugging Face","url":"https://huggingface.co"},"keywords":"interpretability","mainEntityOfPage":"https://rycerzes-inside-beam.hf.space/explorer.html","image":["https://rycerzes-inside-beam.static.hf.space/og.png"]}</script><link rel="stylesheet" href="/_astro/about.DLgs01lq.css"> | |
| <style>.controls.svelte-1ap2cn9.svelte-1ap2cn9{display:flex;flex-wrap:wrap;gap:8px 14px;align-items:center;margin:0 0 10px;font-size:14px}input[type=search].svelte-1ap2cn9.svelte-1ap2cn9{flex:1 1 340px;min-width:0;font:inherit;padding:8px 12px;border-radius:8px;border:1px solid var(--border-color);background:var(--surface-bg);color:var(--text-color)}select.svelte-1ap2cn9.svelte-1ap2cn9{font:inherit;font-size:13px;padding:5px 8px;border-radius:7px;border:1px solid var(--border-color);background:var(--surface-bg);color:var(--text-color)}.count.svelte-1ap2cn9.svelte-1ap2cn9{color:var(--muted-color);font-size:13px}.results.svelte-1ap2cn9.svelte-1ap2cn9{list-style:none;margin:6px 0 10px;padding:0;border-top:1px solid var(--border-color);max-height:560px;overflow-y:auto}.results.svelte-1ap2cn9 li.svelte-1ap2cn9{border-bottom:1px solid var(--border-color)}.results.svelte-1ap2cn9 button.svelte-1ap2cn9{width:100%;display:grid;grid-template-columns:110px minmax(0,1fr) minmax(0,260px);grid-gap:12px;gap:12px;align-items:baseline;text-align:left;font:inherit;color:inherit;background:none;border:0;padding:9px 6px;cursor:pointer}.results.svelte-1ap2cn9 button.svelte-1ap2cn9:hover{background:var(--surface-bg)}.id.svelte-1ap2cn9.svelte-1ap2cn9{font-family:var(--font-mono);font-size:12.5px;color:var(--muted-color)}.toks.svelte-1ap2cn9.svelte-1ap2cn9{font-size:12px;color:var(--muted-color);overflow:hidden;text-overflow:ellipsis;white-space:nowrap}.chip.svelte-1ap2cn9.svelte-1ap2cn9{font-size:11.5px;padding:0 8px;margin-left:6px;border-radius:999px;border:1px solid var(--border-color);color:var(--muted-color)}.chip.ok.svelte-1ap2cn9.svelte-1ap2cn9{color:var(--success-color)}.more.svelte-1ap2cn9.svelte-1ap2cn9{font:inherit;font-size:13px;padding:5px 12px;border-radius:7px;border:1px solid var(--border-color);background:var(--surface-bg);color:var(--text-color);cursor:pointer}.atlas.svelte-1ap2cn9.svelte-1ap2cn9{margin-top:40px}.legend.svelte-1ap2cn9.svelte-1ap2cn9{display:flex;flex-wrap:wrap;gap:4px 12px;font-size:12px;color:var(--muted-color);margin-bottom:8px}.legend.svelte-1ap2cn9 i.svelte-1ap2cn9{display:inline-block;width:10px;height:10px;border-radius:2px;margin-right:5px;vertical-align:-1px}.legend.svelte-1ap2cn9 i.empty.svelte-1ap2cn9{border:1px dashed var(--border-color)}.gridwrap.svelte-1ap2cn9.svelte-1ap2cn9{position:relative}canvas.svelte-1ap2cn9.svelte-1ap2cn9{width:100%;height:auto;image-rendering:pixelated;cursor:crosshair;display:block}.tip.svelte-1ap2cn9.svelte-1ap2cn9{position:absolute;pointer-events:none;background:var(--page-bg);border:1px solid var(--border-color);border-radius:6px;padding:6px 9px;font-size:12.5px;max-width:300px;box-shadow:0 4px 14px #00000026;z-index:3}@media (max-width: 640px){.results.svelte-1ap2cn9 button.svelte-1ap2cn9{grid-template-columns:90px minmax(0,1fr)}.toks.svelte-1ap2cn9.svelte-1ap2cn9{display:none}} | |
| </style> | |
| <link rel="stylesheet" href="/_astro/explorer.y9HGsqM2.css"><script type="module" src="/_astro/page.BgPfbzVk.js"></script></head> <body class="app-body"> <header class="site-head"> <div class="sh-brand"> <a class="sh-name" href="/index.html">Inside Beam</a> <span class="sh-sub">12,544 experts of Beam-1.0-501B</span> </div> <nav class="sh-pills" aria-label="Pages"> <a href="/index.html">Studio</a><a href="/recipes.html">Recipes</a><a href="/explorer.html" class="on" aria-current="page">Explorer</a><a href="/about.html">About</a> </nav> <nav class="sh-links" aria-label="Project"> <a href="https://rycerz.es/blog/inside-beam">Write-up</a> <a href="https://github.com/rycerzes/beam-inside/blob/main/research_log.md">Research log</a> <a href="https://huggingface.co/datasets/rycerzes/beam-expert-atlas">Dataset</a> <a href="https://github.com/rycerzes/beam-inside">Code</a> </nav> </header> <main class="app-main"> <h1>Explorer</h1> <p class="app-lede">Every swept expert of Beam-1.0-501B: Beam's name for it, whether its push passed the steering test, | |
| the blind judge's verdict, and what Beam says when it is pushed. Beam's labels describe each direction's positive side (the tokens it promotes); | |
| pushes the other way are shown but not labelled.</p> <style>astro-island,astro-slot,astro-static-slot{display:contents}</style><script>(()=>{var e=async t=>{await(await t())()};(self.Astro||(self.Astro={})).load=e;window.dispatchEvent(new Event("astro:load"));})();;(()=>{var A=Object.defineProperty;var g=(i,o,a)=>o in i?A(i,o,{enumerable:!0,configurable:!0,writable:!0,value:a}):i[o]=a;var d=(i,o,a)=>g(i,typeof o!="symbol"?o+"":o,a);{let i={0:t=>m(t),1:t=>a(t),2:t=>new RegExp(t),3:t=>new Date(t),4:t=>new Map(a(t)),5:t=>new Set(a(t)),6:t=>BigInt(t),7:t=>new URL(t),8:t=>new Uint8Array(t),9:t=>new Uint16Array(t),10:t=>new Uint32Array(t),11:t=>1/0*t},o=t=>{let[l,e]=t;return l in i?i[l](e):void 0},a=t=>t.map(o),m=t=>typeof t!="object"||t===null?t:Object.fromEntries(Object.entries(t).map(([l,e])=>[l,o(e)]));class y extends HTMLElement{constructor(){super(...arguments);d(this,"Component");d(this,"hydrator");d(this,"hydrate",async()=>{var b;if(!this.hydrator||!this.isConnected)return;let e=(b=this.parentElement)==null?void 0:b.closest("astro-island[ssr]");if(e){e.addEventListener("astro:hydrate",this.hydrate,{once:!0});return}let c=this.querySelectorAll("astro-slot"),n={},h=this.querySelectorAll("template[data-astro-template]");for(let r of h){let s=r.closest(this.tagName);s!=null&&s.isSameNode(this)&&(n[r.getAttribute("data-astro-template")||"default"]=r.innerHTML,r.remove())}for(let r of c){let s=r.closest(this.tagName);s!=null&&s.isSameNode(this)&&(n[r.getAttribute("name")||"default"]=r.innerHTML)}let p;try{p=this.hasAttribute("props")?m(JSON.parse(this.getAttribute("props"))):{}}catch(r){let s=this.getAttribute("component-url")||"<unknown>",v=this.getAttribute("component-export");throw v&&(s+=` (export ${v})`),console.error(`[hydrate] Error parsing props for component ${s}`,this.getAttribute("props"),r),r}let u;await this.hydrator(this)(this.Component,p,n,{client:this.getAttribute("client")}),this.removeAttribute("ssr"),this.dispatchEvent(new CustomEvent("astro:hydrate"))});d(this,"unmount",()=>{this.isConnected||this.dispatchEvent(new CustomEvent("astro:unmount"))})}disconnectedCallback(){document.removeEventListener("astro:after-swap",this.unmount),document.addEventListener("astro:after-swap",this.unmount,{once:!0})}connectedCallback(){if(!this.hasAttribute("await-children")||document.readyState==="interactive"||document.readyState==="complete")this.childrenConnectedCallback();else{let e=()=>{document.removeEventListener("DOMContentLoaded",e),c.disconnect(),this.childrenConnectedCallback()},c=new MutationObserver(()=>{var n;((n=this.lastChild)==null?void 0:n.nodeType)===Node.COMMENT_NODE&&this.lastChild.nodeValue==="astro:end"&&(this.lastChild.remove(),e())});c.observe(this,{childList:!0}),document.addEventListener("DOMContentLoaded",e)}}async childrenConnectedCallback(){let e=this.getAttribute("before-hydration-url");e&&await import(e),this.start()}async start(){let e=JSON.parse(this.getAttribute("opts")),c=this.getAttribute("client");if(Astro[c]===void 0){window.addEventListener(`astro:${c}`,()=>this.start(),{once:!0});return}try{await Astro[c](async()=>{let n=this.getAttribute("renderer-url"),[h,{default:p}]=await Promise.all([import(this.getAttribute("component-url")),n?import(n):()=>()=>{}]),u=this.getAttribute("component-export")||"default";if(!u.includes("."))this.Component=h[u];else{this.Component=h;for(let f of u.split("."))this.Component=this.Component[f]}return this.hydrator=p,this.hydrate},e,this)}catch(n){console.error(`[astro-island] Error hydrating ${this.getAttribute("component-url")}`,n)}}attributeChangedCallback(){this.hydrate()}}d(y,"observedAttributes",["props"]),customElements.get("astro-island")||customElements.define("astro-island",y)}})();</script><astro-island uid="ZqlJk7" component-url="/_astro/Explorer.Dh7WjPWI.js" component-export="default" renderer-url="/_astro/client.CWY0IrnN.js" props="{}" ssr="" client="load" opts="{"name":"Explorer","value":true}" await-children=""> <section><div class="controls svelte-1ap2cn9"><input type="search" placeholder="search Beam's labels, subjects, tokens or L28 E155" aria-label="Search" class="svelte-1ap2cn9" value=""> <select aria-label="Subject" class="svelte-1ap2cn9"><option value="" data-svelte-h="svelte-p4w4zu">any subject</option></select> <select aria-label="Pole" class="svelte-1ap2cn9"><option value="+" data-svelte-h="svelte-4yunyx">+ poles (labelled)</option><option value="-" data-svelte-h="svelte-fo344q">− poles</option><option value="any" data-svelte-h="svelte-phej2i">both poles</option></select> <select aria-label="Sort" class="svelte-1ap2cn9"><option value="verified" data-svelte-h="svelte-1fijms4">verified first</option><option value="layer" data-svelte-h="svelte-iol3at">by layer</option></select></div> <div class="controls svelte-1ap2cn9"><label><input type="checkbox"> steering significant</label> <label><input type="checkbox"> judge verified</label> <label><input type="checkbox"> Beam says coherent</label> <span class="count svelte-1ap2cn9">0 expert directions</span></div> <ol class="results svelte-1ap2cn9"></ol> </section> <section class="atlas svelte-1ap2cn9"><h2 data-svelte-h="svelte-edmfcz">Atlas</h2> <div class="controls svelte-1ap2cn9"><label>colour by | |
| <select class="svelte-1ap2cn9"><option value="sig" data-svelte-h="svelte-1hpo92h">steering significant / judge verified</option><option value="coh" data-svelte-h="svelte-1mhtjt7">Beam says coherent</option><option value="subj" data-svelte-h="svelte-suyfcd">Beam's subject</option></select></label></div> <div class="legend svelte-1ap2cn9"><span data-svelte-h="svelte-1w9go6r"><i style="background:var(--success-color)" class="svelte-1ap2cn9"></i>judge verified</span><span data-svelte-h="svelte-1sz6jfm"><i style="background:var(--primary-color)" class="svelte-1ap2cn9"></i>significant</span><span data-svelte-h="svelte-mhulbe"><i style="background:var(--border-color)" class="svelte-1ap2cn9"></i>neither</span> <span data-svelte-h="svelte-va3oxy"><i class="empty svelte-1ap2cn9"></i>no sweep data</span></div> <div class="gridwrap svelte-1ap2cn9"><canvas aria-label="MoE layers 3 to 51 (rows) by experts 0 to 255 (columns)" class="svelte-1ap2cn9"></canvas> </div> <p class="count svelte-1ap2cn9" data-svelte-h="svelte-ns7wsm">Rows: MoE layers 3 (top) to 51. Columns: experts 0–255. Click an expert to open it.</p></section> <dialog aria-label="Expert" class="svelte-1xxwurk"><form method="dialog" data-svelte-h="svelte-hb0f8y"><button class="close svelte-1xxwurk" aria-label="Close">×</button></form> </dialog><!--astro:end--></astro-island> </main> <footer class="app-footer"> | |
| By Swapnil Dutta (<a href="https://huggingface.co/rycerzes">rycerzes</a>). Built for Reflection's <a href="https://huggingface.co/reflection/Beam-1.0-501B-A23B/discussions/5">Build with Beam</a> | |
| contest; not affiliated with Reflection. Data and code Apache-2.0 | |
| (<a href="https://huggingface.co/datasets/rycerzes/beam-expert-atlas">dataset</a>, | |
| <a href="https://github.com/rycerzes/beam-inside">code</a>). Site built on the | |
| <a href="https://huggingface.co/spaces/tfrere/research-article-template">research article template</a> by Thibaud Frere (CC BY 4.0). | |
| </footer> </body></html> |