feat: add interactive plot to view rope rotation angle as a function of dimension pair index (d) and token position index (k) 36a72e5 Running DebasishDhal99 commited on 17 days ago
feat: made attention logits plot more interactive and added intuitive logic fir attention logits and attention scores 4f0e23c DebasishDhal99 commited on 23 days ago
feat: enhance attention visualization with token context and improve markdown explanations 0342a67 DebasishDhal99 commited on 24 days ago
fix: made the sequence length accurate for real model setup and also added information on which attention head is attending which set of dims 3a74c51 DebasishDhal99 commited on 25 days ago
feat: add explanation on `hidden_size = num_attention_heads * dim_per_head` 4ed3b70 DebasishDhal99 commited on 25 days ago
feat: increase seq_len and auto-update of dim on UI during compute c9744fe DebasishDhal99 commited on 25 days ago
fix: re-add space.GPU to comply with mandatory gpu usage b7f6530 DebasishDhal99 commited on 25 days ago
feat: add rope visualization only with some minor cmparison with sinusoidial positional embedding aa7bfed DebasishDhal99 commited on 25 days ago
fix: add spaces to comply with mandatory use og nvidia gpu on huggingface 1d852fb DebasishDhal99 commited on 26 days ago
feat: basic setup with docker, no real code has been added for visualization yet 80699e5 DebasishDhal99 commited on 26 days ago