Instructions to use moelanoby/phi-3-M3-coder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use moelanoby/phi-3-M3-coder with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="moelanoby/phi-3-M3-coder", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("moelanoby/phi-3-M3-coder", trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("moelanoby/phi-3-M3-coder", trust_remote_code=True, device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use moelanoby/phi-3-M3-coder with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "moelanoby/phi-3-M3-coder"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "moelanoby/phi-3-M3-coder",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/moelanoby/phi-3-M3-coder

SGLang

How to use moelanoby/phi-3-M3-coder with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "moelanoby/phi-3-M3-coder" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "moelanoby/phi-3-M3-coder",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "moelanoby/phi-3-M3-coder" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "moelanoby/phi-3-M3-coder",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use moelanoby/phi-3-M3-coder with Docker Model Runner:
```
docker model run hf.co/moelanoby/phi-3-M3-coder
```

moelanoby commited on Jul 3, 2025

Commit

968db96

verified ·

1 Parent(s): f39f7ce

Update README.md

Browse files

Files changed (1) hide show

README.md +2 -4

README.md CHANGED Viewed

@@ -1,4 +1,3 @@
 ---
 language:
 - ar
@@ -14,7 +13,6 @@ base_model:
 library_name: transformers
 tags:
 - code
-- open-source
 ---
 # M3-V2: An Open Source Model for State-of-the-Art Code Generation
@@ -60,7 +58,7 @@ This model is licensed under the **Apache 2.0 License**. You are free to use, mo
 ## Ethical Considerations
-While this model is open source, users are encouraged to use it responsibly. Finetuning the model to generate harmful, illegal, or unethical content is strongly discouraged. We advocate for the use of this technology to build positive and safe applications.
 ---
@@ -125,4 +123,4 @@ except AttributeError:
 -   The base of this model utilizes the **Phi-3** architecture developed by Microsoft.
 -   The benchmark results were obtained using the **HumanEval** dataset from OpenAI.
--   We thank the open-source community for their continuous contributions to AI research.

 ---
 language:
 - ar
 library_name: transformers
 tags:
 - code
 ---
 # M3-V2: An Open Source Model for State-of-the-Art Code Generation
 ## Ethical Considerations
+While this model is open source, users are encouraged to use it responsibly. Finetuning the model to generate harmful, illegal, or unethical content is strongly discouraged. I advocate for the use of this technology to build positive and safe applications.
 ---
 -   The base of this model utilizes the **Phi-3** architecture developed by Microsoft.
 -   The benchmark results were obtained using the **HumanEval** dataset from OpenAI.
+-   I thank the open-source community for their continuous contributions to AI research.