Instructions to use SlayerLab/fabryka-english-base-250m-e01 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use SlayerLab/fabryka-english-base-250m-e01 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="SlayerLab/fabryka-english-base-250m-e01", trust_remote_code=True)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("SlayerLab/fabryka-english-base-250m-e01", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use SlayerLab/fabryka-english-base-250m-e01 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "SlayerLab/fabryka-english-base-250m-e01"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SlayerLab/fabryka-english-base-250m-e01",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/SlayerLab/fabryka-english-base-250m-e01

SGLang

How to use SlayerLab/fabryka-english-base-250m-e01 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "SlayerLab/fabryka-english-base-250m-e01" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SlayerLab/fabryka-english-base-250m-e01",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "SlayerLab/fabryka-english-base-250m-e01" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SlayerLab/fabryka-english-base-250m-e01",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use SlayerLab/fabryka-english-base-250m-e01 with Docker Model Runner:
```
docker model run hf.co/SlayerLab/fabryka-english-base-250m-e01
```

fabryka-english-base-250m-e01 / packaging.json

kacperwikiel

Publish experimental 249.9M E01 checkpoint after 50M training targets

1e9760c verified about 2 months ago

Raw History Blame Contribute Delete

1.89 kB

{
  "complete": true,
  "source_bundle_sha256": "ee046f48c84be5cad1af96958fc26792f6ebc2aad99605da13e4aedd87eebd90",
  "parameters": {
    "total_parameters": 249944832,
    "non_embedding_parameters": 224779008,
    "tied_embeddings": true,
    "qk_norm": true
  },
  "builder_sha256": "049397bde99823382e80d41128af5e9bab3363a601528ce834b61befa6c4ed1c",
  "source_tokenizer_sha256": "d316298eef9ad7963ac948139d2284b35fc4e8c0a33776062f101a22b296a4fe",
  "changes": [
    "Add AutoConfig/AutoModel mapping and original model implementation with a Transformers 5.3 remote-loader parameter-tying compatibility hook",
    "Add tokenizer wrapper and BOS-only prompt postprocessor",
    "Add model card and environment requirements; preserve original FP32 weights",
    "Set user-selected SlayerLab destination and describe remote-loader compatibility hook"
  ],
  "files": {
    "lineage.json": "862b8e1b50502ab955c43abac032c85d8454c1dd666ee89ff358898a92fe05e8",
    "model.safetensors": "7e3d9655bde8b62b72fece4d715ce51c99ab09c57be9aff322e187fa46e62ae9",
    "generation_config.json": "f0defd310776496a45793134277716f24e396868dc0aca6960320288037bc7cb",
    "requirements.txt": "d2cb86796be5a41de40a65ea865bf07c8dd7b0c9f7eab035db966327bd4906fe",
    "config.json": "91211f9a5aed9f1200fcd54695de0c96c5c2190ed00964456a5bc4e87019e035",
    "tokenizer_config.json": "ed1190f0f2c524aa1a9e872ece0ffe22130dfaa83823fa96e6a990a6667b2ffc",
    "README.md": "fc18491ee8a6ee3d80b569ea5c5cfd307084811932512b0d44ea6a290ae30327",
    "recipe.py": "7c8321b655aa2ac56d1e06a00c855380058f183d6bb9a2a6ed221a88e35b43b4",
    "model.py": "08f791803dde3a30d65fa8318b5d4ee220c653342b3a8030c9672b5100af5aa4",
    "tokenizer.json": "63e389e8ba6c297294c9bd8e68f7e44b6a873edf3a28febb7484217bfaa03225"
  },
  "publication": "prepared locally; not uploaded",
  "target_repository": "SlayerLab/fabryka-english-base-250m-e01"
}

	{
	"complete": true,
	"source_bundle_sha256": "ee046f48c84be5cad1af96958fc26792f6ebc2aad99605da13e4aedd87eebd90",
	"parameters": {
	"total_parameters": 249944832,
	"non_embedding_parameters": 224779008,
	"tied_embeddings": true,
	"qk_norm": true
	},
	"builder_sha256": "049397bde99823382e80d41128af5e9bab3363a601528ce834b61befa6c4ed1c",
	"source_tokenizer_sha256": "d316298eef9ad7963ac948139d2284b35fc4e8c0a33776062f101a22b296a4fe",
	"changes": [
	"Add AutoConfig/AutoModel mapping and original model implementation with a Transformers 5.3 remote-loader parameter-tying compatibility hook",
	"Add tokenizer wrapper and BOS-only prompt postprocessor",
	"Add model card and environment requirements; preserve original FP32 weights",
	"Set user-selected SlayerLab destination and describe remote-loader compatibility hook"
	],
	"files": {
	"lineage.json": "862b8e1b50502ab955c43abac032c85d8454c1dd666ee89ff358898a92fe05e8",
	"model.safetensors": "7e3d9655bde8b62b72fece4d715ce51c99ab09c57be9aff322e187fa46e62ae9",
	"generation_config.json": "f0defd310776496a45793134277716f24e396868dc0aca6960320288037bc7cb",
	"requirements.txt": "d2cb86796be5a41de40a65ea865bf07c8dd7b0c9f7eab035db966327bd4906fe",
	"config.json": "91211f9a5aed9f1200fcd54695de0c96c5c2190ed00964456a5bc4e87019e035",
	"tokenizer_config.json": "ed1190f0f2c524aa1a9e872ece0ffe22130dfaa83823fa96e6a990a6667b2ffc",
	"README.md": "fc18491ee8a6ee3d80b569ea5c5cfd307084811932512b0d44ea6a290ae30327",
	"recipe.py": "7c8321b655aa2ac56d1e06a00c855380058f183d6bb9a2a6ed221a88e35b43b4",
	"model.py": "08f791803dde3a30d65fa8318b5d4ee220c653342b3a8030c9672b5100af5aa4",
	"tokenizer.json": "63e389e8ba6c297294c9bd8e68f7e44b6a873edf3a28febb7484217bfaa03225"
	},
	"publication": "prepared locally; not uploaded",
	"target_repository": "SlayerLab/fabryka-english-base-250m-e01"
	}