Instructions to use singularity-layer/Singularity-xMESH-0.8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use singularity-layer/Singularity-xMESH-0.8B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="singularity-layer/Singularity-xMESH-0.8B")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("singularity-layer/Singularity-xMESH-0.8B")
model = AutoModelForMultimodalLM.from_pretrained("singularity-layer/Singularity-xMESH-0.8B", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use singularity-layer/Singularity-xMESH-0.8B with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf singularity-layer/Singularity-xMESH-0.8B:BF16
# Run inference directly in the terminal:
llama cli -hf singularity-layer/Singularity-xMESH-0.8B:BF16

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf singularity-layer/Singularity-xMESH-0.8B:BF16
# Run inference directly in the terminal:
llama cli -hf singularity-layer/Singularity-xMESH-0.8B:BF16

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf singularity-layer/Singularity-xMESH-0.8B:BF16
# Run inference directly in the terminal:
./llama-cli -hf singularity-layer/Singularity-xMESH-0.8B:BF16

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf singularity-layer/Singularity-xMESH-0.8B:BF16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf singularity-layer/Singularity-xMESH-0.8B:BF16

Use Docker

docker model run hf.co/singularity-layer/Singularity-xMESH-0.8B:BF16

LM Studio
Jan

vLLM

How to use singularity-layer/Singularity-xMESH-0.8B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "singularity-layer/Singularity-xMESH-0.8B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "singularity-layer/Singularity-xMESH-0.8B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/singularity-layer/Singularity-xMESH-0.8B:BF16

SGLang

How to use singularity-layer/Singularity-xMESH-0.8B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "singularity-layer/Singularity-xMESH-0.8B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "singularity-layer/Singularity-xMESH-0.8B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "singularity-layer/Singularity-xMESH-0.8B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "singularity-layer/Singularity-xMESH-0.8B",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Ollama
How to use singularity-layer/Singularity-xMESH-0.8B with Ollama:
```
ollama run hf.co/singularity-layer/Singularity-xMESH-0.8B:BF16
```
Unsloth Desktop

How to use singularity-layer/Singularity-xMESH-0.8B with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf singularity-layer/Singularity-xMESH-0.8B:BF16

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "singularity-layer/Singularity-xMESH-0.8B:BF16"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use singularity-layer/Singularity-xMESH-0.8B with Docker Model Runner:
```
docker model run hf.co/singularity-layer/Singularity-xMESH-0.8B:BF16
```

Lemonade

How to use singularity-layer/Singularity-xMESH-0.8B with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull singularity-layer/Singularity-xMESH-0.8B:BF16

Run and chat with the model

lemonade run user.Singularity-xMESH-0.8B-BF16

List all available models

lemonade list

Hermes Agent

How to use singularity-layer/Singularity-xMESH-0.8B with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf singularity-layer/Singularity-xMESH-0.8B:BF16

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default singularity-layer/Singularity-xMESH-0.8B:BF16

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use singularity-layer/Singularity-xMESH-0.8B with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf singularity-layer/Singularity-xMESH-0.8B:BF16

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "singularity-layer/Singularity-xMESH-0.8B:BF16" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

Singularity-xMESH-0.8B

File size: 7,733 Bytes

{
  "schema_version": 1,
  "algorithm": "sha256",
  "base_model": "Qwen/Qwen3.5-0.8B@2fc06364715b967f1860aea9cf38778875588b17",
  "file_count": 48,
  "total_bytes": 4246436502,
  "files": [
    {
      "path": ".gitignore",
      "bytes": 23,
      "sha256": "6feaded4e28ea86e001a6751b4e3d960e8b7c31b9616ff9936b79297086e809b"
    },
    {
      "path": "ACCELERATOR_PARITY.json",
      "bytes": 2470,
      "sha256": "cc33608597f13a1332e58d3259d5693ec2056de733ab4f79784c6b707a1f54c6"
    },
    {
      "path": "ATTRIBUTION.md",
      "bytes": 518,
      "sha256": "2277a70986ac418718256b0b5dc604a0d60e97ec9084e81b546c9d04f47536ec"
    },
    {
      "path": "FINAL_EVALUATION.json",
      "bytes": 476,
      "sha256": "9a3fe9e8e038b38588a7907e99ce57904b1d92f095b70b4077fb41f62da55983"
    },
    {
      "path": "GGUF_VALIDATION.json",
      "bytes": 3064,
      "sha256": "65941fa861c7bf676982739d2dac50c00cf5c80d14ad8e61ea8afd41eed462db"
    },
    {
      "path": "LICENSE",
      "bytes": 11544,
      "sha256": "bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a"
    },
    {
      "path": "LICENSE.cloudflare-clef",
      "bytes": 11544,
      "sha256": "bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a"
    },
    {
      "path": "LIMITATIONS.md",
      "bytes": 517,
      "sha256": "27bb4a68d4d01e88bdb67f2f7620d579eb28839dd359976a99e25e61d38183ba"
    },
    {
      "path": "MODEL_PROVENANCE.json",
      "bytes": 1140,
      "sha256": "6d0d5b1abbc873b583ab2039bc1b489cbb29c240ba4129057ef2f3495dc40b97"
    },
    {
      "path": "NOTICE.cloudflare-clef",
      "bytes": 498,
      "sha256": "b0e5e3849f78da8fac2df8aebe756b68e219dcdd1aa53697a4c1c618a2f25eb9"
    },
    {
      "path": "PLATFORM_CANARIES.json",
      "bytes": 3071,
      "sha256": "80060d42924b906fae8c2ea8bbd37e84ba5d34b88a37c18a229a01ebe42537b1"
    },
    {
      "path": "PORTABILITY.md",
      "bytes": 3112,
      "sha256": "b8de74f1b9264fdc7c192e0e142aa98ca0198efe3905786cdd5ead9c10437185"
    },
    {
      "path": "README.md",
      "bytes": 8421,
      "sha256": "68d02409d1a93d6f7ffc356a899ead5c201c2ad11641e06a1e17115f31f94e30"
    },
    {
      "path": "Singularity-xMESH-0.8B-BF16.gguf",
      "bytes": 1571529600,
      "sha256": "9f4c08f19c4d203059bc74ed2754e800ec472d7276d8ddb2321480e86d392fff"
    },
    {
      "path": "Singularity-xMESH-0.8B-Q8_0.gguf",
      "bytes": 841069440,
      "sha256": "41b36270b67f6c595e98cf4f29d6a0d13f0c19daa37b75741cd8296e2729fd75"
    },
    {
      "path": "THIRD_PARTY_NOTICES.md",
      "bytes": 927,
      "sha256": "bbf4dec8f637ab3af8e196f74e723ad3852f5b2852d4207bfab200191c280498"
    },
    {
      "path": "VALIDATION.md",
      "bytes": 524,
      "sha256": "424dde0938a291b64b2bff4a3b8665b37dc953bd04d72af0757149823ffb8a45"
    },
    {
      "path": "added_tokens.json",
      "bytes": 904,
      "sha256": "e5f9bfb644ead13bd36dd6cfc41553a93b7c264c0a2e1ac67d033aa8250c8538"
    },
    {
      "path": "assets/xmesh-color.png",
      "bytes": 692992,
      "sha256": "0ee7b3eae1f4a0a5f2165741ca04c79782b1ba97358e56c8a54ac315ee1c3997"
    },
    {
      "path": "assets/xmesh-icon.png",
      "bytes": 73937,
      "sha256": "dbf81171ace2125db0ef306181905a9aee8fda262ced703567d54817f9976809"
    },
    {
      "path": "assets/xmesh-metallic-banner.png",
      "bytes": 337950,
      "sha256": "cb1cbac421f484b8b60ad699fbdf648551191838d9a72807c3adced84d001dfa"
    },
    {
      "path": "assets/xmesh-metallic.png",
      "bytes": 700099,
      "sha256": "c7fef4b00c9e4dd146e20627e2aa79636b61889f5c154793644c8347829c0ae7"
    },
    {
      "path": "assets/xmesh-monochrome.png",
      "bytes": 276808,
      "sha256": "47b4bf8e756c463a8874a6a2f18e7dd2a1525cc7345d499b834e40790c942ceb"
    },
    {
      "path": "assets/xmesh-wordmark-dark.png",
      "bytes": 559842,
      "sha256": "6ccf862cdc7dc0e77a1971cdb6aa4ba3b8baf237aca15e579330b7f8bed2fdea"
    },
    {
      "path": "assets/xmesh-wordmark-light.png",
      "bytes": 833355,
      "sha256": "b252f3ca26cefaf531cb721a58546599a1782b349d7205edeca67bc643813d7e"
    },
    {
      "path": "chat_template.jinja",
      "bytes": 7992,
      "sha256": "27938b9ab163505925cca66ba08c61a21c0be939abea87b3f73f4d6a7cead5c2"
    },
    {
      "path": "config.json",
      "bytes": 2517,
      "sha256": "173e45cf24731154525e0247279203116228c64a205ede70fac6ac0435116061"
    },
    {
      "path": "examples/inference.py",
      "bytes": 1530,
      "sha256": "33782e14355ebfe255f30521111ce422a6c5d35eec37f4c3d16b0e861a8cccac"
    },
    {
      "path": "examples/request.json",
      "bytes": 2098,
      "sha256": "cb02086aaa9d9cec8d3b35e718752b521e711bbf86f948cfd09a143ebf554222"
    },
    {
      "path": "examples/verify_manifest.py",
      "bytes": 1480,
      "sha256": "8b94a75f83bd8d506c6318cc96dfd3cd2dfa61b3f272333bb4d68256d955d8ef"
    },
    {
      "path": "joint_head.safetensors",
      "bytes": 54661911,
      "sha256": "ff6433e096130f286038a1bfff07741018d6c8f6ccb91ee325419de717e87ff4"
    },
    {
      "path": "joint_head_config.json",
      "bytes": 116,
      "sha256": "99f65ef462b1c92d9304ad1acecbbab93506efc0ba8227c46582b4264d27aa30"
    },
    {
      "path": "joint_schema_model.py",
      "bytes": 23263,
      "sha256": "0e304cf7c6500e8bb59bef7e2afd2c6373f82596dfb3b57d1aa93c175e2dc3a3"
    },
    {
      "path": "licenses/CLOUDFLARE-CLEF-APACHE-2.0.txt",
      "bytes": 11544,
      "sha256": "bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a"
    },
    {
      "path": "merges.txt",
      "bytes": 3353273,
      "sha256": "3bd640ba6d8da8f5844f3548b7e2184fc664dd670e1447e425a48dbaaad1ef43"
    },
    {
      "path": "model.safetensors-00001-of-00001.safetensors",
      "bytes": 1746942954,
      "sha256": "2dda751389cf7d98cfed72a16e6d8ce253dcd125b84870713cd33d1637e0ab84"
    },
    {
      "path": "model.safetensors.index.json",
      "bytes": 50900,
      "sha256": "d8a08838a613b025eb7952ed9db11696213e57e76a375661ef5c12f9dd5dcf4e"
    },
    {
      "path": "preprocessor_config.json",
      "bytes": 781,
      "sha256": "b99182e09450f26453502b3c3390cce36b33dc8c4a1f3ee21807762e168c74ab"
    },
    {
      "path": "processor_config.json",
      "bytes": 1300,
      "sha256": "14932921ca485d458a04dafd8069fbb0a4505622a48208d19ed247115801385b"
    },
    {
      "path": "requirements.txt",
      "bytes": 101,
      "sha256": "eccb4bd138c9553fb101a9305d6406a9861157b31be822bcf120bad77979dc6f"
    },
    {
      "path": "sgl_decision_config.json",
      "bytes": 336,
      "sha256": "8d0c5641166db1436888523d5e8a879cf4bc23da5bff4b282e1a4dba9bb2450a"
    },
    {
      "path": "sgl_systemone.py",
      "bytes": 5010,
      "sha256": "0a7c9e42f4b3b18fd192e9c36056fda49480bd95bfe470f66184704a55e2d895"
    },
    {
      "path": "special_tokens_map.json",
      "bytes": 876,
      "sha256": "ce5cbe737f4aacc7696180aac743091101b59e4dc5a338d9fc8a6f716aa513f7"
    },
    {
      "path": "tokenizer.json",
      "bytes": 19989343,
      "sha256": "87a7830d63fcf43bf241c3c5242e96e62dd3fdc29224ca26fed8ea333db72de4"
    },
    {
      "path": "tokenizer_config.json",
      "bytes": 15715,
      "sha256": "b9dc588af5170900b1c1f46301d7cfa0acff1f26a2a3449a299b1c337b5a3f58"
    },
    {
      "path": "video_preprocessor_config.json",
      "bytes": 817,
      "sha256": "59c5c9eb52182eb14c06ffb10ca9effd29adce5f238a95de23ca14a38dbd2cb1"
    },
    {
      "path": "vocab.json",
      "bytes": 5234494,
      "sha256": "4ab0d5c096294054b66444a116a20baf6e29998fc1fae410ffe4b6fadbc56b5c"
    },
    {
      "path": "xmesh_policy.py",
      "bytes": 5375,
      "sha256": "ab0b5125142259dec6e93e5ed21c6cf616afb6be84035f418a1e57e0c1192580"
    }
  ]
}