Instructions to use aissatoubalde/lab with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use aissatoubalde/lab with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="aissatoubalde/lab", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("aissatoubalde/lab", trust_remote_code=True) model = AutoModelForCausalLM.from_pretrained("aissatoubalde/lab", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use aissatoubalde/lab with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "aissatoubalde/lab" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aissatoubalde/lab", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/aissatoubalde/lab
- SGLang
How to use aissatoubalde/lab with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "aissatoubalde/lab" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aissatoubalde/lab", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "aissatoubalde/lab" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "aissatoubalde/lab", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use aissatoubalde/lab with Docker Model Runner:
docker model run hf.co/aissatoubalde/lab
Commit History
-
Update model.safetensors.index.json
Verified signaturec5c62ca -
Upload PhiForCausalLM
Verified signature179dd04 -
Upload PhiForCausalLM
Verified signature9810e20 -
Upload PhiForCausalLM
Verified signaturebce646c -
Upload PhiForCausalLM
Verified signatureb36b930 -
Training in progress, epoch 2
Verified signature98aeadc -
Training in progress, epoch 2
Verified signatureb4c3786 -
Training in progress, epoch 1
Verified signature3665cb6
-
Training in progress, epoch 3
Verified signaturea6dc29e -
Training in progress, epoch 2
Verified signature7f23800 -
Training in progress, epoch 1
Verified signaturee4aaddd -
Training in progress, epoch 0
Verified signature182f594
-
Update adapter_config.json
Verified signaturea2a5a48 -
Update model.safetensors.index.json
Verified signatured87434d -
Delete adapter_model.safetensors
Verified signature115c301 -
Upload PhiForCausalLM
Verified signature8ccc2a6 -
Training in progress, epoch 0
Verified signaturefe490e0 -
Update adapter_config.json
Verified signaturecc55646 -
Update adapter_config.json
Verified signature4b76c1e -
Upload PhiForCausalLM
Verified signatureace487b -
Training in progress, epoch 0
Verified signaturee9cc5c3 -
Upload PhiForCausalLM
Verified signaturea31ac62 -
Training in progress, epoch 0
Verified signature489dc47 -
Delete README.md
Verified signature81dd58a -
Delete .ipynb_checkpoints/test2-phi2-fine-tuned-checkpoint.ipynb
Verified signatureb0de8b6 -
Delete .ipynb_checkpoints/phi-2-custom-checkpoint.ipynb
Verified signature5d9f745 -
Delete .ipynb_checkpoints/Untitled-checkpoint.ipynb
Verified signature1c03fad -
Delete phi-2-custom.ipynb
Verified signaturec0925fb -
Delete model.safetensors.index.json
Verified signature388e176 -
Delete config.json
Verified signature141e0a9 -
Delete adapter_model.safetensors
Verified signature7a47421 -
Delete model-00003-of-00003.safetensors
Verified signaturef3edb93 -
Delete model-00002-of-00003.safetensors
Verified signaturea3e6e5b -
Delete model-00001-of-00003.safetensors
Verified signaturec853e60 -
Delete adapter_config.json
Verified signaturea314712 -
Delete generation_config.json
Verified signaturebb3594c -
Delete rng_state-3.pth
Verified signature387aae4 -
Delete Untitled.ipynb
Verified signature19b51e9 -
Delete scheduler-2.pt
Verified signature1f67921 -
Delete test2-phi2-fine-tuned.ipynb
Verified signature604e677 -
Delete training_args-5.bin
Verified signatured82e3d2 -
Delete training_args.bin
Verified signaturee8ed78e -
Delete adapter_config-5.json
Verified signature3bc3e7d -
Delete adapter_config-3.json
Verified signatured0b8ad8 -
Delete adapter_model-5.safetensors
Verified signature242d2e5 -
Upload PhiForCausalLM
Verified signaturee671c01 -
Training in progress, epoch 0
Verified signatured84b886 -
Upload config.json
Verified signature1444e7a -
Upload 6 files
Verified signatureca4422d -
Delete model.safetensors.index.json
Verified signaturef924934