Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
basecompute
/
Llama-3.2-1B-Instruct
like
0
Follow
Base Compute
8
Text Generation
basert
apple-silicon
quantized
License:
llama3.2
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
Llama-3.2-1B-Instruct
4.41 GB
Ctrl+K
Ctrl+K
1 contributor
History:
10 commits
prabodbc
Upload Llama-3.2-1B-Instruct-cuda-q8.base with huggingface_hub
e991e77
verified
4 days ago
.gitattributes
1.8 kB
Upload Llama-3.2-1B-Instruct-cuda-q8.base with huggingface_hub
4 days ago
Llama-3.2-1B-Instruct-Q4.base
1.08 GB
xet
Re-convert with fixed rotary q/k permutation (baseRT-internal#114); NIAH-validated at 2k/8k. Q4 now uses the default-q4 quality profile (embeddings/head at higher precision).
17 days ago
Llama-3.2-1B-Instruct-Q8.base
1.28 GB
xet
Re-convert with fixed rotary q/k permutation (baseRT-internal#114); NIAH-validated at 2k/8k. Q4 now uses the default-q4 quality profile (embeddings/head at higher precision).
17 days ago
Llama-3.2-1B-Instruct-cuda-q4mix.base
768 MB
xet
Upload Llama-3.2-1B-Instruct-cuda-q4mix.base with huggingface_hub
4 days ago
Llama-3.2-1B-Instruct-cuda-q8.base
1.28 GB
xet
Upload Llama-3.2-1B-Instruct-cuda-q8.base with huggingface_hub
4 days ago
README.md
Safe
815 Bytes
Professional model card
about 1 month ago
config.json
Safe
51 Bytes
Add config.json (enables HF download tracking)
about 1 month ago
