Instructions to use ElMater06/VSCD-2b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ElMater06/VSCD-2b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ElMater06/VSCD-2b")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("ElMater06/VSCD-2b") model = AutoModelForCausalLM.from_pretrained("ElMater06/VSCD-2b", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use ElMater06/VSCD-2b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ElMater06/VSCD-2b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ElMater06/VSCD-2b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/ElMater06/VSCD-2b
- SGLang
How to use ElMater06/VSCD-2b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "ElMater06/VSCD-2b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ElMater06/VSCD-2b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "ElMater06/VSCD-2b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ElMater06/VSCD-2b", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use ElMater06/VSCD-2b with Docker Model Runner:
docker model run hf.co/ElMater06/VSCD-2b
Commit History
-
Adding `safetensors` variant of this model
Verified signatureThis is an automated PR created with https://huggingface.co/spaces/safetensors/convert This new file is equivalent to `pytorch_model.bin` but safe in the sense that no arbitrary code can be put into it. These files also happen to load much faster than their pytorch counterpart: https://colab.research.google.com/github/huggingface/notebooks/blob/main/safetensors_doc/en/speed.ipynb The widgets on your model page will run using this model even if this is not merged making sure the file actually works. If you find any issues: please report here: https://huggingface.co/spaces/safetensors/convert/discussions Feel free to ignore this PR.724259f
-
Update README.md
Verified signature9fe7ee4 -
Update README.md
Verified signature99fcda3 -
Update README.md
Verified signaturec8ed06b -
Update README.md
Verified signature792d0d5 -
Update README.md
Verified signature56bd2de -
Update README.md
Verified signature6d3ebd4
-
Upload VSCD-lora.zip
Verified signature5dc2515 -
Update README.md
Verified signature2eae77b
-
Update README.md
Verified signature16e6aa5 -
Update README.md
Verified signaturebf68f8d -
Update README.md
Verified signature4bde271 -
Update README.md
Verified signature648dda7 -
Update README.md
Verified signaturec258214 -
Update README.md
Verified signatureb2c586d -
Update README.md
Verified signature5efbd47 -
Update config.json
Verified signaturee4bc4e5 -
fixed config.json
Verified signature74db6b6 -
Update README.md
Verified signature7c3b967 -
Update README.md
Verified signaturea0552b7 -
Update config.json
Verified signature32a048a -
Update config.json
Verified signature220a2b5
-
Upload 9 files
Verified signature236b98b -
Delete tokenizer_config.json
Verified signature736faff -
Delete tokenizer.model
Verified signature774c6cb -
Delete tokenizer.json
Verified signature939329d -
Delete special_tokens_map.json
Verified signatureecac23f -
Delete adapter_model.safetensors
Verified signature40a98e7 -
Delete adapter_config.json
Verified signature342015e -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster7666e48 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterb4598bd -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterca56159 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster94abe8e -
Create README.md
Verified signature4eb350a -
Delete tokenizer_config.json
Verified signature6db3241 -
Delete tokenizer.model
Verified signature5fcce53 -
Delete tokenizer.json
Verified signatureb5cff91 -
Delete special_tokens_map.json
Verified signaturee47a083 -
Delete config.json
Verified signaturebf8ed40 -
Delete adapter_model.safetensors
Verified signature27f2386 -
Delete adapter_config.json
Verified signature8ac11b3 -
Delete README.md
Verified signaturea52e24f -
Upload config.json
Verified signaturefdd3c49 -
Update README.md
Verified signature4bca4c2 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster792406c -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterbf0551c -
Delete tokenizer_config.json
Verified signature0193c70 -
Delete tokenizer.model
Verified signature11b2264 -
Delete tokenizer.json
Verified signaturecb4d1d9 -
Delete special_tokens_map.json
Verified signature1bf1429