prithivMLmods commited on
Commit
32eb002
·
verified ·
1 Parent(s): ce9b47d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - adidukrembzuai/MedChain-R1-4B
7
+ pipeline_tag: image-text-to-text
8
+ library_name: transformers
9
+ tags:
10
+ - text-generation-inference
11
+ - llama-cpp
12
+ ---
13
+
14
+ > [!NOTE]
15
+ > MTP — Speculative Decoding: No
16
+
17
+ ## Model Files
18
+
19
+ | File Name | Quant Type | File Size | File Link | Description |
20
+ |-----------|------------|-----------|-----------|-------------|
21
+ | MedChain-R1-4B.BF16.gguf | BF16 | 8.42 GB | [Link](https://huggingface.co/prithivMLmods/MedChain-R1-4B-GGUF/blob/main/MedChain-R1-4B.BF16.gguf) | Full BF16 weights. Highest quality, largest file size. |
22
+ | MedChain-R1-4B.Q3_K_L.gguf | Q3_K_L | 2.49 GB | [Link](https://huggingface.co/prithivMLmods/MedChain-R1-4B-GGUF/blob/main/MedChain-R1-4B.Q3_K_L.gguf) | Lower quality but usable, good for low RAM availability. |
23
+ | MedChain-R1-4B.Q3_K_M.gguf | Q3_K_M | 2.3 GB | [Link](https://huggingface.co/prithivMLmods/MedChain-R1-4B-GGUF/blob/main/MedChain-R1-4B.Q3_K_M.gguf) | Low quality. |
24
+ | MedChain-R1-4B.Q4_K_M.gguf | Q4_K_M | 2.74 GB | [Link](https://huggingface.co/prithivMLmods/MedChain-R1-4B-GGUF/blob/main/MedChain-R1-4B.Q4_K_M.gguf) | Good quality, default size for most use cases, *recommended*. |
25
+ | MedChain-R1-4B.Q4_K_S.gguf | Q4_K_S | 2.57 GB | [Link](https://huggingface.co/prithivMLmods/MedChain-R1-4B-GGUF/blob/main/MedChain-R1-4B.Q4_K_S.gguf) | Slightly lower quality with more space savings, *recommended*. |
26
+ | MedChain-R1-4B.Q5_K_M.gguf | Q5_K_M | 3.09 GB | [Link](https://huggingface.co/prithivMLmods/MedChain-R1-4B-GGUF/blob/main/MedChain-R1-4B.Q5_K_M.gguf) | High quality, *recommended*. |
27
+ | MedChain-R1-4B.Q5_K_S.gguf | Q5_K_S | 2.99 GB | [Link](https://huggingface.co/prithivMLmods/MedChain-R1-4B-GGUF/blob/main/MedChain-R1-4B.Q5_K_S.gguf) | High quality, *recommended*. |
28
+ | MedChain-R1-4B.Q6_K.gguf | Q6_K | 3.46 GB | [Link](https://huggingface.co/prithivMLmods/MedChain-R1-4B-GGUF/blob/main/MedChain-R1-4B.Q6_K.gguf) | Very high quality, near perfect, *recommended*. |
29
+ | MedChain-R1-4B.mmproj-bf16.gguf | mmproj-bf16 | 676 MB | [Link](https://huggingface.co/prithivMLmods/MedChain-R1-4B-GGUF/blob/main/MedChain-R1-4B.mmproj-bf16.gguf) | Multimodal projection file in BF16 format. Used for vision/language models. |
30
+
31
+ ## llama.cpp
32
+
33
+ LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp
34
+
35
+ Quantized using llama.cpp by [prithivMLmods](https://huggingface.co/prithivMLmods).