Hugging Face's logo

basecompute
/
Qwen3.5-2B

Text Generation
basert
apple-silicon
quantized
multimodal
Model card Files
xet
 Community
1

Re-convert with the Qwen MTP head (header.speculator): basertd --speculate mtp-head

#1
by prabodbc - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+8
-8
Files changed (4) hide show
  1. Qwen3.5-2B-Q4.base +2 -2
  2. Qwen3.5-2B-Q8.base +2 -2
  3. Qwen3.5-2B-cuda-q4mix.base +2 -2
  4. Qwen3.5-2B-cuda-q8.base +2 -2
Qwen3.5-2B-Q4.base CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1c95f41730d5713fcb886a71d2481a29ff1a6e2fc9cea8a4d9ddbe29082fa262
3
- size 1266810880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:deb6319c18511baf709862c87f34669f17c6c6e904995050a92d3152d0d53188
3
+ size 1599324160
Qwen3.5-2B-Q8.base CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d4cf325278e873b3e0aefc18c5eff0a863f12fee5a82f0ac2f2e5ebce4067f3c
3
- size 2301460480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a144502c5280dc4f6191d36560b85e334383685cf2e7be6b8f6f845e6d8a4411
3
+ size 2896936960
Qwen3.5-2B-cuda-q4mix.base CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:db457f5dd499be915e51e757d0e999e279def9f861f0ecc206708deaa5ec49ca
3
- size 1592131584
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:899a740301babfd1fa65e9175ed713c1af9ff2d6799b0b42518084ee5cad6cb4
3
+ size 2468659200
Qwen3.5-2B-cuda-q8.base CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:027907a8ce268e1a7ffc339cd2746db87c2e5f01867910284b19cbb52ec62d78
3
- size 2301460480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3711edbe2dddcc4304d74cacd0c40478c2fc08590c870ff53197ea1f7fec4fc8
3
+ size 2896936960