Spaces:
Paused
Paused
Commit History
-
Add research attention analysis endpoints with Q/K/V extraction
gary-boon +1: Claude- Add /analyze/research/attention endpoint with layer-by-layer attention data - Implement PyTorch hooks for Q/K/V matrix extraction from qkv_proj layer - Add token-by-token generation with layersDataByStep for tracing - Add top-k token alternatives with probabilities (logprobs) - Add tokenizer utilities for vocabulary analysis - Add exploration scripts for vocabulary inspection - Return all 16 attention heads sorted by importance - Fix tensor dimension handling and NaN sanitization 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>37ed739