Text Generation
Transformers
Safetensors
qwen2
llama-factory
Generated from Trainer
conversational
text-generation-inference
Instructions to use adpretko/train-armv8-O2_epoch3_AMD with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use adpretko/train-armv8-O2_epoch3_AMD with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="adpretko/train-armv8-O2_epoch3_AMD") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("adpretko/train-armv8-O2_epoch3_AMD") model = AutoModelForCausalLM.from_pretrained("adpretko/train-armv8-O2_epoch3_AMD", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use adpretko/train-armv8-O2_epoch3_AMD with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "adpretko/train-armv8-O2_epoch3_AMD" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "adpretko/train-armv8-O2_epoch3_AMD", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/adpretko/train-armv8-O2_epoch3_AMD
- SGLang
How to use adpretko/train-armv8-O2_epoch3_AMD with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "adpretko/train-armv8-O2_epoch3_AMD" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "adpretko/train-armv8-O2_epoch3_AMD", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "adpretko/train-armv8-O2_epoch3_AMD" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "adpretko/train-armv8-O2_epoch3_AMD", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use adpretko/train-armv8-O2_epoch3_AMD with Docker Model Runner:
docker model run hf.co/adpretko/train-armv8-O2_epoch3_AMD
Training in progress, step 500
Browse files- model.safetensors +1 -1
- trainer_log.jsonl +10 -0
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 3554214752
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4bf699eaa303e8323dd203e0175631370e4f07e488eb9ef741241e9fc3177d13
|
| 3 |
size 3554214752
|
trainer_log.jsonl
CHANGED
|
@@ -38,3 +38,13 @@
|
|
| 38 |
{"current_steps": 380, "total_steps": 3236, "loss": 0.0093, "lr": 1.9982401122780834e-05, "epoch": 0.23496676456948523, "percentage": 11.74, "elapsed_time": "6:53:57", "remaining_time": "2 days, 3:51:14"}
|
| 39 |
{"current_steps": 390, "total_steps": 3236, "loss": 0.0087, "lr": 1.9975422610938463e-05, "epoch": 0.24115010047920854, "percentage": 12.05, "elapsed_time": "7:04:46", "remaining_time": "2 days, 3:39:43"}
|
| 40 |
{"current_steps": 400, "total_steps": 3236, "loss": 0.0087, "lr": 1.9967283067348106e-05, "epoch": 0.24733343638893182, "percentage": 12.36, "elapsed_time": "7:15:30", "remaining_time": "2 days, 3:27:48"}
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
{"current_steps": 380, "total_steps": 3236, "loss": 0.0093, "lr": 1.9982401122780834e-05, "epoch": 0.23496676456948523, "percentage": 11.74, "elapsed_time": "6:53:57", "remaining_time": "2 days, 3:51:14"}
|
| 39 |
{"current_steps": 390, "total_steps": 3236, "loss": 0.0087, "lr": 1.9975422610938463e-05, "epoch": 0.24115010047920854, "percentage": 12.05, "elapsed_time": "7:04:46", "remaining_time": "2 days, 3:39:43"}
|
| 40 |
{"current_steps": 400, "total_steps": 3236, "loss": 0.0087, "lr": 1.9967283067348106e-05, "epoch": 0.24733343638893182, "percentage": 12.36, "elapsed_time": "7:15:30", "remaining_time": "2 days, 3:27:48"}
|
| 41 |
+
{"current_steps": 410, "total_steps": 3236, "loss": 0.0084, "lr": 1.9957983439364973e-05, "epoch": 0.2535167722986551, "percentage": 12.67, "elapsed_time": "7:27:53", "remaining_time": "2 days, 3:27:13"}
|
| 42 |
+
{"current_steps": 420, "total_steps": 3236, "loss": 0.0085, "lr": 1.994752480936559e-05, "epoch": 0.2597001082083784, "percentage": 12.98, "elapsed_time": "7:38:39", "remaining_time": "2 days, 3:15:10"}
|
| 43 |
+
{"current_steps": 430, "total_steps": 3236, "loss": 0.0085, "lr": 1.9935908394621844e-05, "epoch": 0.2658834441181017, "percentage": 13.29, "elapsed_time": "7:49:24", "remaining_time": "2 days, 3:03:07"}
|
| 44 |
+
{"current_steps": 440, "total_steps": 3236, "loss": 0.0087, "lr": 1.992313554715929e-05, "epoch": 0.27206678002782503, "percentage": 13.6, "elapsed_time": "8:00:11", "remaining_time": "2 days, 2:51:26"}
|
| 45 |
+
{"current_steps": 450, "total_steps": 3236, "loss": 0.0086, "lr": 1.99092077535998e-05, "epoch": 0.2782501159375483, "percentage": 13.91, "elapsed_time": "8:10:49", "remaining_time": "2 days, 2:38:44"}
|
| 46 |
+
{"current_steps": 460, "total_steps": 3236, "loss": 0.0084, "lr": 1.989412663498853e-05, "epoch": 0.2844334518472716, "percentage": 14.22, "elapsed_time": "8:21:31", "remaining_time": "2 days, 2:26:35"}
|
| 47 |
+
{"current_steps": 470, "total_steps": 3236, "loss": 0.0085, "lr": 1.9877893946605247e-05, "epoch": 0.2906167877569949, "percentage": 14.52, "elapsed_time": "8:32:16", "remaining_time": "2 days, 2:14:46"}
|
| 48 |
+
{"current_steps": 480, "total_steps": 3236, "loss": 0.0084, "lr": 1.9860511577760042e-05, "epoch": 0.2968001236667182, "percentage": 14.83, "elapsed_time": "8:43:00", "remaining_time": "2 days, 2:02:53"}
|
| 49 |
+
{"current_steps": 490, "total_steps": 3236, "loss": 0.0084, "lr": 1.9841981551573424e-05, "epoch": 0.3029834595764415, "percentage": 15.14, "elapsed_time": "8:53:47", "remaining_time": "2 days, 1:51:22"}
|
| 50 |
+
{"current_steps": 500, "total_steps": 3236, "loss": 0.0085, "lr": 1.9822306024740855e-05, "epoch": 0.30916679548616477, "percentage": 15.45, "elapsed_time": "9:04:33", "remaining_time": "2 days, 1:39:47"}
|