Spaces:
Paused
Paused
Commit History
-
Add Code Llama 7B support with hardware-aware filtering and ICL timeout fixes
gary-boon +1: Claude- Added multi-architecture support to ICL components (attention extractor, service, induction detector) - Implemented hardware-aware model filtering for CPU/GPU spaces - Fixed Code Llama tokenizer padding token configuration - Updated model config with accurate Code Llama 7B specifications - Added model adapter pattern for seamless architecture switching 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>ed40a9a
-
feat: Add pipeline analyzer and QKV extractor for transformer visualization
gary-boon +1: ClaudeBackend Components: - TransformerPipelineAnalyzer: Captures all intermediate transformer states - Real tokenization with actual token IDs - Embedding extraction with position encodings - Attention weight extraction from QKV projections - FFN activation statistics (mean, std, sparsity, active neurons) - Output projection with top-5 predictions - Multi-token generation support with proper context updating - QKVAttentionExtractor: Specialized attention weight extraction - Supports CodeGen qkv_proj architecture - Handles GPT-2 c_attn style projections - Computes real attention scores with causal masking - Returns full attention patterns for visualization API Enhancements: - /analyze/pipeline endpoint with multi-token support - /analyze/attention endpoint for detailed attention analysis - Configurable generation parameters (temperature, top_k, top_p) - Backward compatible with single-token requests Data Integrity: - All data extracted directly from model forward pass …767a3fd