Instructions to use youssefedweqd/working with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use youssefedweqd/working with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="youssefedweqd/working")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("youssefedweqd/working", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use youssefedweqd/working with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "youssefedweqd/working"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "youssefedweqd/working",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/youssefedweqd/working

SGLang

How to use youssefedweqd/working with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "youssefedweqd/working" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "youssefedweqd/working",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "youssefedweqd/working" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "youssefedweqd/working",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use youssefedweqd/working with Docker Model Runner:
```
docker model run hf.co/youssefedweqd/working
```

working / Model /trainer_log.jsonl

youssefedweqd

Training in progress, step 1500

80a845c verified about 1 year ago

Raw

History Blame Contribute Delete

2.14 kB

	{"current_steps": 550, "total_steps": 2547, "loss": 0.6122, "lr": 9.599483839268026e-05, "epoch": 0.6477255998822317, "percentage": 21.59, "elapsed_time": "0:51:04", "remaining_time": "3:05:27"}
	{"current_steps": 600, "total_steps": 2547, "loss": 0.5809, "lr": 9.454410179022932e-05, "epoch": 0.7066097453260709, "percentage": 23.56, "elapsed_time": "1:42:38", "remaining_time": "5:33:04"}
	{"current_steps": 650, "total_steps": 2547, "loss": 0.5446, "lr": 9.288422825194501e-05, "epoch": 0.7654938907699103, "percentage": 25.52, "elapsed_time": "2:36:35", "remaining_time": "7:37:00"}
	{"current_steps": 700, "total_steps": 2547, "loss": 0.5339, "lr": 9.102301097269974e-05, "epoch": 0.8243780362137495, "percentage": 27.48, "elapsed_time": "3:28:02", "remaining_time": "9:08:54"}
	{"current_steps": 750, "total_steps": 2547, "loss": 0.5296, "lr": 8.896918846697821e-05, "epoch": 0.8832621816575887, "percentage": 29.45, "elapsed_time": "4:20:56", "remaining_time": "10:25:12"}
	{"current_steps": 800, "total_steps": 2547, "loss": 0.5176, "lr": 8.673240354108538e-05, "epoch": 0.942146327101428, "percentage": 31.41, "elapsed_time": "5:13:41", "remaining_time": "11:25:00"}
	{"current_steps": 850, "total_steps": 2547, "loss": 0.5104, "lr": 8.432315801965616e-05, "epoch": 1.0011776829088768, "percentage": 33.37, "elapsed_time": "6:06:43", "remaining_time": "12:12:08"}
	{"current_steps": 900, "total_steps": 2547, "loss": 0.4685, "lr": 8.175276343902802e-05, "epoch": 1.0600618283527161, "percentage": 35.34, "elapsed_time": "6:59:19", "remaining_time": "12:47:21"}
	{"current_steps": 950, "total_steps": 2547, "loss": 0.473, "lr": 7.903328793897418e-05, "epoch": 1.1189459737965552, "percentage": 37.3, "elapsed_time": "7:52:29", "remaining_time": "13:14:16"}
	{"current_steps": 1000, "total_steps": 2547, "loss": 0.4679, "lr": 7.6177499602143e-05, "epoch": 1.1778301192403946, "percentage": 39.26, "elapsed_time": "8:45:44", "remaining_time": "13:33:18"}
	{"current_steps": 1000, "total_steps": 2547, "eval_loss": 0.4844963848590851, "epoch": 1.1778301192403946, "percentage": 39.26, "elapsed_time": "9:21:56", "remaining_time": "14:29:19"}