Instructions to use JESUSDAVID23/abia-3b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use JESUSDAVID23/abia-3b with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("JESUSDAVID23/abia-3b") model = PeftModel.from_pretrained(base_model, "JESUSDAVID23/abia-3b") - Transformers
How to use JESUSDAVID23/abia-3b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="JESUSDAVID23/abia-3b") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("JESUSDAVID23/abia-3b", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use JESUSDAVID23/abia-3b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "JESUSDAVID23/abia-3b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "JESUSDAVID23/abia-3b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/JESUSDAVID23/abia-3b
- SGLang
How to use JESUSDAVID23/abia-3b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "JESUSDAVID23/abia-3b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "JESUSDAVID23/abia-3b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "JESUSDAVID23/abia-3b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "JESUSDAVID23/abia-3b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use JESUSDAVID23/abia-3b with Docker Model Runner:
docker model run hf.co/JESUSDAVID23/abia-3b
Commit History
-
ABIA 3B Local β Ronda 367
Verified signature599e4e4 -
ABIA 3B Local β Ronda 366
Verified signature87436e9 -
ABIA 3B Local β Ronda 365
Verified signaturef49881f -
ABIA 3B Local β Ronda 364
Verified signature0232c87 -
ABIA 3B Local β Ronda 363
Verified signaturec28f489 -
ABIA 3B Local β Ronda 362
Verified signature7891b06 -
ABIA 3B Local β Ronda 361
Verified signaturef65eea3 -
ABIA 3B Local β Ronda 360
Verified signature709fdf2 -
ABIA 3B Local β Ronda 359
Verified signature68dae19 -
ABIA 3B Local β Ronda 358
Verified signatureaf58317 -
ABIA 3B Local β Ronda 355 | Tokens: 318,399,300 | WikiES: 318,500
Verified signature7ff698d -
Restaurando cursor.json al estado saludable
Verified signature94a5227
-
ABIA 3B Local β Ronda 353 | Tokens: 317,896,300 | WikiES: 317,500
Verified signaturef82c627
-
Model Soup: 14 cuentas | Tokens: 317,644,800 | Rondas: 352
Verified signature241f0e4 -
Model Soup: 11 cuentas | Tokens: 200,332,800 | Rondas: 222
Verified signature883e3c2
-
Model Soup: 4 cuentas | Tokens: 94,752,000 | Rondas: 105
Verified signaturecf057ec
-
Abia 3B β Cuenta 5 Ronda 6 | Tokens: 74,899,200
Verified signatureab66545 -
Abia 3B β Cuenta 5 Ronda 5 | Tokens: 73,996,800
Verified signaturece0862d -
Abia 3B β Cuenta 5 Ronda 4 | Tokens: 73,094,400
Verified signature4dba494 -
Abia 3B β Cuenta 5 Ronda 3 | Tokens: 72,192,000
Verified signature6136691 -
Abia 3B β Cuenta 5 Ronda 2 | Tokens: 71,289,600
Verified signature5a8796a -
Abia 3B β Cuenta 5/240 | Fase 1 β Preentrenamiento base (ES + EN) | Ronda 1
Verified signature641aa07 -
Abia 3B β Cuenta 5/240 | Fase 1 β Preentrenamiento base (ES + EN) | Ronda 1
Verified signature00e94d8
-
Abia 3B β Cuenta 5/240 | Fase 1 β Preentrenamiento base (ES + EN) | Ronda 1
Verified signature4f7ce22
-
Abia 3B β Cuenta 5/240 | Fase 1 β Preentrenamiento base (ES + EN) | Ronda 1
Verified signature4672768 -
Abia 3B β Cuenta 5 Ronda 4 | Tokens: 66,777,600
Verified signature2787c54 -
Abia 3B β Cuenta 5 Ronda 3 | Tokens: 65,875,200
Verified signaturefd4008c -
Abia 3B β Cuenta 5 Ronda 2 | Tokens: 64,972,800
Verified signature8c52aca -
Abia 3B β Cuenta 5/240 | Fase 1 β Preentrenamiento base (ES + EN) | Ronda 1
Verified signature153fb1c -
Abia 3B β Cuenta 5 Ronda 5 | Tokens: 63,168,000
Verified signature7aff4b6 -
Abia 3B β Cuenta 5 Ronda 4 | Tokens: 62,265,600
Verified signatured032175 -
Abia 3B β Cuenta 5 Ronda 3 | Tokens: 61,363,200
Verified signature9d70e13
-
Abia 3B β Cuenta 5 Ronda 2 | Tokens: 60,460,800
Verified signature1871408 -
Abia 3B β Cuenta 5/240 | Fase 1 β Preentrenamiento base (ES + EN) | Ronda 1
Verified signature1653f3f -
Abia 3B β Cuenta 5 Ronda 3 | Tokens: 58,656,000
Verified signature88faef1 -
Abia 3B β Cuenta 5 Ronda 2 | Tokens: 57,753,600
Verified signaturec177982 -
Abia 3B β Cuenta 5/240 | Fase 1 β Preentrenamiento base (ES + EN) | Ronda 1
Verified signature78889aa -
Abia 3B β Cuenta 5 Ronda 6 | Tokens: 55,948,800
Verified signatureb8e1ef7 -
Abia 3B β Cuenta 5 Ronda 5 | Tokens: 55,046,400
Verified signature99d6ea7 -
Abia 3B β Cuenta 5 Ronda 4 | Tokens: 54,144,000
Verified signature9faad72 -
Abia 3B β Cuenta 5 Ronda 3 | Tokens: 53,241,600
Verified signature20261f3 -
Abia 3B β Cuenta 5 Ronda 2 | Tokens: 52,339,200
Verified signaturec575b22 -
Abia 3B β Cuenta 5/240 | Fase 1 β Preentrenamiento base (ES + EN) | Ronda 1
Verified signature2eaaeb2
-
Abia 3B β Cuenta 4 Ronda 8 | Tokens: 50,534,400
Verified signature0ad48c1 -
Abia 3B β Cuenta 4 Ronda 7 | Tokens: 49,632,000
Verified signature0b6ba9c -
Abia 3B β Cuenta 4 Ronda 6 | Tokens: 48,729,600
Verified signature875dbd6 -
Abia 3B β Cuenta 4 Ronda 5 | Tokens: 47,827,200
Verified signatureec8b9ca -
Abia 3B β Cuenta 4 Ronda 4 | Tokens: 46,924,800
Verified signaturefd659b3 -
Abia 3B β Cuenta 4 Ronda 3 | Tokens: 46,022,400
Verified signature5810683 -
Abia 3B β Cuenta 4 Ronda 2 | Tokens: 45,120,000
Verified signaturee053007