Instructions to use giantdev/beta_s00h61 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use giantdev/beta_s00h61 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="giantdev/beta_s00h61") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("giantdev/beta_s00h61") model = AutoModelForCausalLM.from_pretrained("giantdev/beta_s00h61", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use giantdev/beta_s00h61 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "giantdev/beta_s00h61" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "giantdev/beta_s00h61", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/giantdev/beta_s00h61
- SGLang
How to use giantdev/beta_s00h61 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "giantdev/beta_s00h61" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "giantdev/beta_s00h61", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "giantdev/beta_s00h61" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "giantdev/beta_s00h61", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use giantdev/beta_s00h61 with Docker Model Runner:
docker model run hf.co/giantdev/beta_s00h61
Commit History
-
Upload StableLmForCausalLM
Verified signature6474b83 -
Upload tokenizer
Verified signaturefac9397
-
Upload vocab.json with huggingface_hub
Verified signature2ff300b -
Upload .gitattributes with huggingface_hub
Verified signaturecb3944d -
Upload added_tokens.json with huggingface_hub
Verified signature9df373f -
Upload README.md with huggingface_hub
Verified signature2c3022e -
Upload generation_config.json with huggingface_hub
Verified signature0502a0f -
Upload model.safetensors with huggingface_hub
Verified signaturedb4554d -
Upload hash.txt with huggingface_hub
Verified signature66fda71 -
Upload tokenizer_config.json with huggingface_hub
Verified signature12c8ce5 -
Upload merges.txt with huggingface_hub
Verified signature44bbf8a -
Upload config.json with huggingface_hub
Verified signaturee6b00bd -
Upload tokenizer.json with huggingface_hub
Verified signature99f85b4 -
Upload special_tokens_map.json with huggingface_hub
Verified signaturec16ac73 -
Upload vocab.json with huggingface_hub
Verified signature35b05d8 -
Upload .gitattributes with huggingface_hub
Verified signature624c21a -
Upload added_tokens.json with huggingface_hub
Verified signature511b354 -
Upload README.md with huggingface_hub
Verified signature790da8b -
Upload generation_config.json with huggingface_hub
Verified signatureaf5d4fe -
Upload model.safetensors with huggingface_hub
Verified signature2198e38 -
Upload hash.txt with huggingface_hub
Verified signature7bcfdbe -
Upload tokenizer_config.json with huggingface_hub
Verified signatureaa72375 -
Upload merges.txt with huggingface_hub
Verified signature028c161 -
Upload config.json with huggingface_hub
Verified signature6ebd56c -
Upload tokenizer.json with huggingface_hub
Verified signature2ec1b3b -
Upload special_tokens_map.json with huggingface_hub
Verified signaturecee340e -
Upload vocab.json with huggingface_hub
Verified signature2a10841 -
Upload .gitattributes with huggingface_hub
Verified signatured8f4246 -
Upload added_tokens.json with huggingface_hub
Verified signatureb5ddd17 -
Upload README.md with huggingface_hub
Verified signaturec40f73c -
Upload generation_config.json with huggingface_hub
Verified signaturead016e5 -
Upload model.safetensors with huggingface_hub
Verified signaturece514e5 -
Upload hash.txt with huggingface_hub
Verified signature25dcb98 -
Upload tokenizer_config.json with huggingface_hub
Verified signaturea99e933 -
Upload merges.txt with huggingface_hub
Verified signature613ba60 -
Upload config.json with huggingface_hub
Verified signatured6b5e35 -
Upload tokenizer.json with huggingface_hub
Verified signature12eab70 -
Upload special_tokens_map.json with huggingface_hub
Verified signature8249eaa -
initial commit
Verified signature9bdbf25