Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
mncai
/
nf4moe
like
0
Follow
GenON
71
PEFT
quantization
qlora
Mixture of Experts
nf4
bitsandbytes
arxiv:
2305.14314
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Copy to bucket
new
Use this model
Instructions to use mncai/nf4moe with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
Libraries
PEFT
How to use mncai/nf4moe with PEFT:
Task type is invalid.
Notebooks
Google Colab
Kaggle
main
nf4moe
384 kB
Ctrl+K
Ctrl+K
1 contributor
History:
3 commits
dwmyoung
fix: single tildes render as strikethrough on HF — use ≈ for approximations
10ebcfc
verified
14 days ago
assets
nf4moe writeup: QLoRA for a 743B fused-MoE (NF4 for 3D expert tensors)
14 days ago
.gitattributes
Safe
1.59 kB
nf4moe writeup: QLoRA for a 743B fused-MoE (NF4 for 3D expert tensors)
14 days ago
README.md
Safe
13.6 kB
fix: single tildes render as strikethrough on HF — use ≈ for approximations
14 days ago
