Instructions to use esilva/KapiCoder-Mongo-Nano with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use esilva/KapiCoder-Mongo-Nano with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="esilva/KapiCoder-Mongo-Nano")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("esilva/KapiCoder-Mongo-Nano")
model = AutoModelForCausalLM.from_pretrained("esilva/KapiCoder-Mongo-Nano", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use esilva/KapiCoder-Mongo-Nano with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "esilva/KapiCoder-Mongo-Nano"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "esilva/KapiCoder-Mongo-Nano",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/esilva/KapiCoder-Mongo-Nano

SGLang

How to use esilva/KapiCoder-Mongo-Nano with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "esilva/KapiCoder-Mongo-Nano" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "esilva/KapiCoder-Mongo-Nano",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "esilva/KapiCoder-Mongo-Nano" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "esilva/KapiCoder-Mongo-Nano",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use esilva/KapiCoder-Mongo-Nano with Docker Model Runner:
```
docker model run hf.co/esilva/KapiCoder-Mongo-Nano
```

KapiCoder-Mongo-Nano / NOTICE.md

esilva

Add v3 weights (v0.1.0-preview)

c03bfe1 verified 2 days ago

preview code

Raw History Blame Contribute Delete

2.09 kB

NOTICE

KapiCoder-Mongo-Nano (version v3, tag v0.1.0-preview) is a derivative work of Qwen/Qwen2.5-Coder-0.5B (revision 8123ea2e9354afb7ffcc6c8641d1b2f5ecf18301), licensed under the Apache License, Version 2.0 (see LICENSE).

Modifications: full fine-tuning (SFT) for MongoDB fill-in-the-middle autocomplete in the editor-context-v1 format. Training data: synthetic MongoDB examples whose labels come partly from a 7B teacher (KapiTeacher-Mongo-7B, derived from Qwen2.5-Coder-7B) validated by read-only execution, partly from queries written by Qwen3-14B (Apache-2.0) and from a grammar, each with the reference as label; a share of generic JavaScript/TypeScript replay text. Export to safetensors bf16. Weights are published in safetensors bf16 only; ONNX builds, if any, are published in a separate repository.

This model is not a product of Alibaba Cloud or the Qwen team and is not endorsed by them. "Qwen" is a name of its owners. The teacher used to produce part of the training labels is not part of this repository, and neither is the training data. The training data are synthetic (fictitious schemas); a small share of generic JavaScript/TypeScript replay text comes from npm packages under MIT, Apache-2.0, BSD and ISC licenses, listed in REPLAY_ATTRIBUTION.md; that code is not redistributed.

AVISO (pt-BR)

KapiCoder-Mongo-Nano (versão v3, tag v0.1.0-preview) é um trabalho derivado e modificado de Qwen/Qwen2.5-Coder-0.5B (revisão 8123ea2e9354afb7ffcc6c8641d1b2f5ecf18301), licenciado sob a Apache License 2.0 (veja LICENSE). Modificações: ajuste fino completo (SFT) para autocomplete FIM de MongoDB no formato editor-context-v1, com rótulos em parte de um professor de 7B validados por execução somente leitura, em parte de consultas escritas pelo Qwen3-14B (Apache-2.0) e de uma gramática, mais texto de replay de JavaScript/TypeScript; exportação para safetensors bf16. Não é um produto da Alibaba Cloud nem da equipe Qwen e não tem endosso deles. O professor e os dados de treino não fazem parte deste repositório.