mgoin/llama-2-7b-chat-quant-ds
Text Generation • Updated • 16
Michael Goin
mgoin
AI & ML interests
LLM inference optimization, compression, quantization, pruning, distillation
Recent Activity
updated a model about 2 months ago
mgoin/Qwen3-4B-speculator.dflash2 published a model about 2 months ago
mgoin/Qwen3-4B-speculator.dflash2 updated a model about 2 months ago
mgoin/Qwen3.8-2.4T-A95B-NVFP4-pruned75Organizations
mgoin/llama-2-7b-chat-quant-nodown-ds
Text Generation • Updated • 16
mgoin/Sheared-LLaMA-1.3B-ds
Text Generation • Updated • 16
mgoin/llama2.c-stories15M-ds
Text Generation • Updated • 31
mgoin/zephyr-7b-alpha-pruned50-ds
Text Generation • Updated • 13
mgoin/Mistral-7B-v0.1-pruned70
Text Generation • Updated • 19
mgoin/Mistral-7B-v0.1-pruned60
Text Generation • Updated • 19
mgoin/Mistral-7B-v0.1-pruned50
Text Generation • Updated • 25
mgoin/zephyr-7b-alpha-pruned40
Text Generation • Updated • 20
mgoin/zephyr-7b-alpha-pruned50
Text Generation • Updated • 22
mgoin/Mistral-7B-v0.1-pruned40
Text Generation • Updated • 20
mgoin/zephyr-7b-alpha-ds
Text Generation • Updated • 11 • 1
mgoin/TinyLlama-1.1B-step-50K-105b-ONNX
Text Generation • Updated • 32 • 1
mgoin/open_llama_3b_v2-ds
Text Generation • Updated • 13
mgoin/mpt-7b-gsm8k-pruned40-quant
Text Generation • Updated • 22
mgoin/mpt-7b-gsm8k-quant
Text Generation • Updated • 23
mgoin/mpt-7b-gsm8k
Text Generation • Updated • 15
mgoin/all-MiniLM-L6-v2-ds
Feature Extraction • Updated • 51
mgoin/mpt-7b-chat-quant
Text Generation • Updated • 19 • 1
mgoin/TinyStories-33M-pruned50-ds
Text Generation • Updated • 195
mgoin/TinyStories-33M-quant-ds
Text Generation • Updated • 197
mgoin/TinyStories-33M-ds
Text Generation • Updated • 207
mgoin/vit-base-beans-one-shot
Image Classification • Updated • 8