Don’t just watch a 501B model think—surgically steer its neurons.
Coarse MoE router maps only tell you which of the 12,544 experts was picked.
BeamScope goes inside the actual weights of reflection/Beam-1.0-501B-A23B—inspecting the
61,440 shared Dense SwiGLU Neurons in Layers 0–2, the 2,496 learned Sigmoid Attention Gates, and the
1/√k depth-scaled residual stream to diagnose and control reasoning behavior without fine-tuning.
-
01
Cut
<think>Token Spirals by 68%: Clamping 8 recursive-doubt neurons (L1.N115,L2.N235) stops endless "Wait, let me re-verify..." loops while keeping 100% accuracy. -
02
Zero-Cost Hallucination Radar: Beam has only 9 Full-Context Global NoPE layers. When their Sigmoid Gates collapse (
σ < 0.12), the model is fabricating a citation or API. -
03
$0 Fine-Tuning Behavior Steering: Suppress sycophancy (
L2.N47) or force formal proof rigor (L0.N143) at inference time on a singletrn2.48xlargenode.
Select a Surgical Intervention Case Study
Click any of the three mechanistic interventions below to load its target neuron circuit, token-by-token firing trace, and before/after output delta.
Causal Neurons & Sigmoid Gates
Three Undisclosed Architectural Findings Inside Beam-1.0-501B
Extracted directly via HTTP Range requests from model-00001-of-00188.safetensors and model-00188-of-00188.safetensors of reflection/Beam-1.0-501B-A23B.
The 94× Post-FFN RMSNorm Rebellion Against 1/√k Scaling
Beam scales every sublayer update by 1/√k (from 0.707 at Layer 0 down to 0.098 at Layer 51) to maintain constant residual variance.
Inspecting the trained post_feedforward_layernorm weights reveals the model learned to invert 1/√k—crushing Layer 0 norm to 0.08 and amplifying Layer 51 to 7.54 (94× larger) so late MoE layers can dominate final logits.
Layer 0 Attention Self-Ablation (-11.59) vs. Layer 29 Global Peak
Every attention head has a learned self_attn.gate_bias applied before o_proj. In Layer 0, all 48 heads are biased shut (mean -11.59, σ = 0.0009%), turning Layer 0 into a pure 20,480-neuron Dense SwiGLU processor! Gate openness peaks at Global NoPE Layer 29 (max = +0.19) where 1M-context retrieval occurs.
Quadratic Excitatory (cos > +0.6) vs. Inhibitory Brake Neurons
Before any MoE router fires at Layer 3, every token passes through 3 Dense SwiGLU layers (20,480 neurons each). Measuring the cosine similarity between gate_proj and up_proj rows reveals two functional neuron families: Quadratic Rectifiers (cos = +0.64, e.g., L0.N31) and Anti-Parallel Brakes (cos = -0.85).
Inspecting e_score_correction_bias Across 12,288 Routed Experts
Beam routes top-8 of 256 experts across 8 groups of 32 using sigmoid scores plus a learned e_score_correction_bias stored in FP32 in Shard 188. Select any MoE layer below to inspect its 8 group balances and most favored vs. suppressed experts.
Running & Probing Beam-1.0-501B on a Single AWS trn2.48xlarge Node
Why a single trn2.48xlarge instance (16× Trainium2 chips, 1.5 TB HBM3, 2 TB host RAM) + our 4-Shard Safetensors Discovery makes full-precision BF16 neuron inspection effortless without NVIDIA GPUs.