Instructions to use MRNH/llama-2-7b-coder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use MRNH/llama-2-7b-coder with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="MRNH/llama-2-7b-coder")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("MRNH/llama-2-7b-coder")
model = AutoModelForCausalLM.from_pretrained("MRNH/llama-2-7b-coder", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use MRNH/llama-2-7b-coder with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "MRNH/llama-2-7b-coder"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "MRNH/llama-2-7b-coder",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/MRNH/llama-2-7b-coder

SGLang

How to use MRNH/llama-2-7b-coder with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "MRNH/llama-2-7b-coder" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "MRNH/llama-2-7b-coder",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "MRNH/llama-2-7b-coder" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "MRNH/llama-2-7b-coder",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use MRNH/llama-2-7b-coder with Docker Model Runner:
```
docker model run hf.co/MRNH/llama-2-7b-coder
```

llama-2-7b-coder

Commit History

May 29, 2025

08:20
Adding `safetensors` variant of this model⁠

SFconvertbot

Verified signature
785e7be

Mar 10, 2024

12:59
Update config.json

MRNH

Verified signature
54e9841

Feb 23, 2024

18:04
Update README.md

MRNH

Verified signature
4346eac
18:03
Update README.md

MRNH

Verified signature
86c8fee
18:02
Update README.md

MRNH

Verified signature
b52f8cb
18:00
Update README.md

MRNH

Verified signature
3221792
17:49
Update README.md

MRNH

Verified signature
26df4ed

Feb 20, 2024

09:21
Upload config.json with huggingface_hub

MRNH

Verified signature
29f98ae
09:21
Upload generation_config.json with huggingface_hub

MRNH

Verified signature
78d34c5
09:21
Upload pytorch_model.bin with huggingface_hub

MRNH

Verified signature
b56966e
08:15
Upload tokenizer

MRNH

Verified signature
2404674

Feb 17, 2024

18:51
Upload config.json with huggingface_hub

MRNH

Verified signature
1482906
18:51
Upload generation_config.json with huggingface_hub

MRNH

Verified signature
adf5ff5
18:50
Upload pytorch_model.bin with huggingface_hub

MRNH

Verified signature
a74d03d
18:00
Upload tokenizer

MRNH

Verified signature
5ad691d
10:42
Upload tokenizer

MRNH

Verified signature
558f590

Feb 16, 2024

04:14
Upload config.json with huggingface_hub

MRNH

Verified signature
b878c75
04:14
Upload generation_config.json with huggingface_hub

MRNH

Verified signature
1a66b58
04:14
Upload pytorch_model.bin with huggingface_hub

MRNH

Verified signature
dca2925
03:33
Upload tokenizer

MRNH

Verified signature
fc1d1e8

Feb 15, 2024

06:38
Upload config.json with huggingface_hub

MRNH

Verified signature
4de0e24
06:38
Upload generation_config.json with huggingface_hub

MRNH

Verified signature
28ff6e2
06:37
Upload pytorch_model.bin with huggingface_hub

MRNH

Verified signature
99ff695
06:08
Upload tokenizer

MRNH

Verified signature
c1b13eb

Feb 14, 2024

21:46
Upload tokenizer

MRNH

Verified signature
3c3316c
20:37
Upload config.json with huggingface_hub

MRNH

Verified signature
a0c61f6
20:37
Upload generation_config.json with huggingface_hub

MRNH

Verified signature
fbf2db3
20:37
Upload pytorch_model.bin with huggingface_hub

MRNH

Verified signature
b84aae3
20:09
Upload tokenizer

MRNH

Verified signature
468abe0
14:59
Upload config.json with huggingface_hub

MRNH

Verified signature
8843041
14:58
Upload generation_config.json with huggingface_hub

MRNH

Verified signature
b29eaf6
14:57
Upload pytorch_model.bin with huggingface_hub

MRNH

Verified signature
6b03cae
14:21
Upload tokenizer

MRNH

Verified signature
9753cfc

Feb 13, 2024

07:40
Upload config.json with huggingface_hub

MRNH

Verified signature
a4b0987
07:40
Upload generation_config.json with huggingface_hub

MRNH

Verified signature
2b4749a
07:40
Upload pytorch_model.bin with huggingface_hub

MRNH

Verified signature
352616f
07:15
Upload tokenizer

MRNH

Verified signature
67296d9

Feb 2, 2024

05:34
Upload config.json with huggingface_hub

MRNH

Verified signature
886691a
05:34
Upload generation_config.json with huggingface_hub

MRNH

Verified signature
d314b22
05:34
Upload pytorch_model.bin with huggingface_hub

MRNH

Verified signature
9b8a07f
05:07
Upload tokenizer

MRNH

Verified signature
ebd60af

Feb 1, 2024

03:29
Upload config.json with huggingface_hub

MRNH

Verified signature
082722b
03:29
Upload generation_config.json with huggingface_hub

MRNH

Verified signature
e6022b8
03:29
Upload pytorch_model.bin with huggingface_hub

MRNH

Verified signature
133243f
02:31
Upload tokenizer

MRNH

Verified signature
fe22045

Jan 31, 2024

21:39
Upload config.json with huggingface_hub

MRNH

Verified signature
a621367
21:39
Upload generation_config.json with huggingface_hub

MRNH

Verified signature
5ee0f3f
21:39
Upload pytorch_model.bin with huggingface_hub

MRNH

Verified signature
7826014
20:40
Upload tokenizer

MRNH

Verified signature
e43b505
07:41
Upload config.json with huggingface_hub

MRNH

Verified signature
f06e88f

Commit History

May 29, 2025

Adding `safetensors` variant of this model⁠

Mar 10, 2024

Update config.json

Feb 23, 2024

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Feb 20, 2024

Upload config.json with huggingface_hub

Upload generation_config.json with huggingface_hub

Upload pytorch_model.bin with huggingface_hub

Upload tokenizer

Feb 17, 2024

Upload config.json with huggingface_hub

Upload generation_config.json with huggingface_hub

Upload pytorch_model.bin with huggingface_hub

Upload tokenizer

Upload tokenizer

Feb 16, 2024

Upload config.json with huggingface_hub

Upload generation_config.json with huggingface_hub

Upload pytorch_model.bin with huggingface_hub

Upload tokenizer

Feb 15, 2024

Upload config.json with huggingface_hub

Upload generation_config.json with huggingface_hub

Upload pytorch_model.bin with huggingface_hub

Upload tokenizer

Feb 14, 2024

Upload tokenizer

Upload config.json with huggingface_hub

Upload generation_config.json with huggingface_hub

Upload pytorch_model.bin with huggingface_hub

Upload tokenizer

Upload config.json with huggingface_hub

Upload generation_config.json with huggingface_hub

Upload pytorch_model.bin with huggingface_hub

Upload tokenizer

Feb 13, 2024

Upload config.json with huggingface_hub

Upload generation_config.json with huggingface_hub

Upload pytorch_model.bin with huggingface_hub

Upload tokenizer

Feb 2, 2024

Upload config.json with huggingface_hub

Upload generation_config.json with huggingface_hub

Upload pytorch_model.bin with huggingface_hub

Upload tokenizer

Feb 1, 2024

Upload config.json with huggingface_hub

Upload generation_config.json with huggingface_hub

Upload pytorch_model.bin with huggingface_hub

Upload tokenizer

Jan 31, 2024

Upload config.json with huggingface_hub

Upload generation_config.json with huggingface_hub

Upload pytorch_model.bin with huggingface_hub

Upload tokenizer

Upload config.json with huggingface_hub