Instructions to use saracandu/stldec_random_512_pca with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use saracandu/stldec_random_512_pca with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="saracandu/stldec_random_512_pca", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("saracandu/stldec_random_512_pca", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use saracandu/stldec_random_512_pca with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "saracandu/stldec_random_512_pca" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "saracandu/stldec_random_512_pca", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/saracandu/stldec_random_512_pca
- SGLang
How to use saracandu/stldec_random_512_pca with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "saracandu/stldec_random_512_pca" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "saracandu/stldec_random_512_pca", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "saracandu/stldec_random_512_pca" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "saracandu/stldec_random_512_pca", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use saracandu/stldec_random_512_pca with Docker Model Runner:
docker model run hf.co/saracandu/stldec_random_512_pca
Commit History
-
Update checkpoint step_98000
Verified signature5feda02 -
Update checkpoint step_96000
Verified signatured6309d6 -
Update checkpoint step_94000
Verified signature18b07c4 -
Update checkpoint step_92000
Verified signatureb3bf210 -
Update checkpoint step_90000
Verified signature86517cf -
Update checkpoint step_88000
Verified signature0107f37 -
Update checkpoint step_86000
Verified signaturec8ce066 -
Update checkpoint step_84000
Verified signature990108b -
Update checkpoint step_82000
Verified signature32a5784 -
Update checkpoint step_80000
Verified signatureae2b1c1 -
Update checkpoint step_78000
Verified signature5a5226f -
Update checkpoint step_76000
Verified signature11e5f2e -
Update checkpoint step_74000
Verified signature49efd5c -
Update checkpoint step_72000
Verified signature9b63e20 -
Update checkpoint step_70000
Verified signature383c9d1 -
Update checkpoint step_68000
Verified signaturead5f60f -
Update checkpoint step_66000
Verified signatureeef718c -
Update checkpoint step_64000
Verified signature79ac51b -
Update checkpoint step_62000
Verified signatureec1a3a3 -
Update checkpoint step_60000
Verified signature1b52942 -
Update checkpoint step_58000
Verified signaturef343baf -
Update checkpoint step_56000
Verified signatureee60f0b -
Update checkpoint step_54000
Verified signature16a4f42 -
Update checkpoint step_52000
Verified signature9250501 -
Update checkpoint step_50000
Verified signature09007e5 -
Update checkpoint step_48000
Verified signature1dce8a2 -
Update checkpoint step_46000
Verified signature0fa2350 -
Update checkpoint step_44000
Verified signatureb514e0b -
Update checkpoint step_42000
Verified signature21bfb38 -
Update checkpoint step_40000
Verified signatureb87d812 -
Update checkpoint step_38000
Verified signatureaee396b -
Update checkpoint step_36000
Verified signatureb1665ec -
Update checkpoint step_34000
Verified signature4415d0c -
Update checkpoint step_32000
Verified signature08cca70 -
Update checkpoint step_30000
Verified signature99b3695 -
Update checkpoint step_28000
Verified signature1e1cbab -
Update checkpoint step_26000
Verified signatureae4691e -
Update checkpoint step_24000
Verified signatured4f4f93 -
Update checkpoint step_22000
Verified signatureac27b09 -
Update checkpoint step_20000
Verified signaturec893eda -
Update checkpoint step_18000
Verified signature9084392 -
Update checkpoint step_16000
Verified signatured43f6c9 -
Update checkpoint step_14000
Verified signature1b4c5c9 -
Update checkpoint step_12000
Verified signaturedab3f25 -
Update checkpoint step_10000
Verified signature35ccac1 -
Update checkpoint step_8000
Verified signaturef3e62a9 -
Update checkpoint step_6000
Verified signaturee177ecd -
Update checkpoint step_4000
Verified signatureb4e5355 -
Update checkpoint step_2000
Verified signatured935bdc