Jonathan von Rad
jvonrad
·
AI & ML interests
LLM Compression & Mechanistic Interpretability
Organizations
Tip: For Hardware Acceleration this Model will not leverage vllm marlin kernels!
#19 opened 11 months ago
by
jvonrad
Where is the Base Model?
👍➕ 10
3
#34 opened over 1 year ago
by
jvonrad
Substantially lower accuracy on reasoning benchmarks such as GSM8K (1.5%) and MATH-500 (4.2%)
1
#1 opened 11 months ago
by
jvonrad
Could you please implement train:1% feature? This way we don't have to download the entire dataset.
1
#12 opened over 1 year ago
by
jvonrad
Low Score on GSM8K on lm-eval-harness? (just 74.91)
2
#36 opened over 1 year ago
by
jvonrad
TypeError: cannot unpack non-iterable NoneType object
👍👀 8
5
#37 opened almost 2 years ago
by
Pietroferr
Model is a Memory Hog - 2xH100 80GB OOM??
1
#5 opened over 1 year ago
by
jvonrad
When evaluating Wiki2, I just get Loss: Nan, while with gemma-3-1b-it it works..
2
#8 opened over 1 year ago
by
jvonrad