SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling
Paper • 2312.15166 • Published • 61
Perhaps more MidEnd... only 8x122M
Both depth up-scaling (as used in SOLAR) and sparse upcycling are used in this model.
Have fun
- Downloads last month
- 33
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for lowendmicrobacteria/highendgirlfriend
Base model
SupraLabs/Supra-50M-Base Quantized
SupraLabs/Supra-50M-Instruct Finetuned
huggingwadhah/lowendgirlfriend