Image-Text-to-Text
Transformers
Safetensors
GGUF
PyTorch
English
qwen3_5
singularity-layer
xmesh
decision-model
x402
tool-selection
llama.cpp
cpu
apple-silicon
windows
linux
mps
cuda
conversational
Instructions to use singularity-layer/Singularity-xMESH-0.8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use singularity-layer/Singularity-xMESH-0.8B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="singularity-layer/Singularity-xMESH-0.8B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("singularity-layer/Singularity-xMESH-0.8B") model = AutoModelForMultimodalLM.from_pretrained("singularity-layer/Singularity-xMESH-0.8B", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use singularity-layer/Singularity-xMESH-0.8B with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf singularity-layer/Singularity-xMESH-0.8B:BF16 # Run inference directly in the terminal: llama cli -hf singularity-layer/Singularity-xMESH-0.8B:BF16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf singularity-layer/Singularity-xMESH-0.8B:BF16 # Run inference directly in the terminal: llama cli -hf singularity-layer/Singularity-xMESH-0.8B:BF16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf singularity-layer/Singularity-xMESH-0.8B:BF16 # Run inference directly in the terminal: ./llama-cli -hf singularity-layer/Singularity-xMESH-0.8B:BF16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf singularity-layer/Singularity-xMESH-0.8B:BF16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf singularity-layer/Singularity-xMESH-0.8B:BF16
Use Docker
docker model run hf.co/singularity-layer/Singularity-xMESH-0.8B:BF16
- LM Studio
- Jan
- vLLM
How to use singularity-layer/Singularity-xMESH-0.8B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "singularity-layer/Singularity-xMESH-0.8B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "singularity-layer/Singularity-xMESH-0.8B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/singularity-layer/Singularity-xMESH-0.8B:BF16
- SGLang
How to use singularity-layer/Singularity-xMESH-0.8B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "singularity-layer/Singularity-xMESH-0.8B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "singularity-layer/Singularity-xMESH-0.8B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "singularity-layer/Singularity-xMESH-0.8B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "singularity-layer/Singularity-xMESH-0.8B", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Ollama
How to use singularity-layer/Singularity-xMESH-0.8B with Ollama:
ollama run hf.co/singularity-layer/Singularity-xMESH-0.8B:BF16
- Unsloth Desktop
- Pi
How to use singularity-layer/Singularity-xMESH-0.8B with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf singularity-layer/Singularity-xMESH-0.8B:BF16
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "singularity-layer/Singularity-xMESH-0.8B:BF16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use singularity-layer/Singularity-xMESH-0.8B with Docker Model Runner:
docker model run hf.co/singularity-layer/Singularity-xMESH-0.8B:BF16
- Lemonade
How to use singularity-layer/Singularity-xMESH-0.8B with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull singularity-layer/Singularity-xMESH-0.8B:BF16
Run and chat with the model
lemonade run user.Singularity-xMESH-0.8B-BF16
List all available models
lemonade list
- Hermes Agent
How to use singularity-layer/Singularity-xMESH-0.8B with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf singularity-layer/Singularity-xMESH-0.8B:BF16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default singularity-layer/Singularity-xMESH-0.8B:BF16
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use singularity-layer/Singularity-xMESH-0.8B with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf singularity-layer/Singularity-xMESH-0.8B:BF16
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "singularity-layer/Singularity-xMESH-0.8B:BF16" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download MANIFEST.json from singularity-layer/Singularity-xMESH-0.8B: direct link, hf CLI and curl.
- Browser
- Download file 7.73 kB
-
https://huggingface.co/singularity-layer/Singularity-xMESH-0.8B/resolve/main/MANIFEST.json
- Command line
-
hf download hf://singularity-layer/Singularity-xMESH-0.8B/MANIFEST.json
-
curl -L -o MANIFEST.json https://huggingface.co/singularity-layer/Singularity-xMESH-0.8B/resolve/main/MANIFEST.json
7.73 kB
| { | |
| "schema_version": 1, | |
| "algorithm": "sha256", | |
| "base_model": "Qwen/Qwen3.5-0.8B@2fc06364715b967f1860aea9cf38778875588b17", | |
| "file_count": 48, | |
| "total_bytes": 4246436502, | |
| "files": [ | |
| { | |
| "path": ".gitignore", | |
| "bytes": 23, | |
| "sha256": "6feaded4e28ea86e001a6751b4e3d960e8b7c31b9616ff9936b79297086e809b" | |
| }, | |
| { | |
| "path": "ACCELERATOR_PARITY.json", | |
| "bytes": 2470, | |
| "sha256": "cc33608597f13a1332e58d3259d5693ec2056de733ab4f79784c6b707a1f54c6" | |
| }, | |
| { | |
| "path": "ATTRIBUTION.md", | |
| "bytes": 518, | |
| "sha256": "2277a70986ac418718256b0b5dc604a0d60e97ec9084e81b546c9d04f47536ec" | |
| }, | |
| { | |
| "path": "FINAL_EVALUATION.json", | |
| "bytes": 476, | |
| "sha256": "9a3fe9e8e038b38588a7907e99ce57904b1d92f095b70b4077fb41f62da55983" | |
| }, | |
| { | |
| "path": "GGUF_VALIDATION.json", | |
| "bytes": 3064, | |
| "sha256": "65941fa861c7bf676982739d2dac50c00cf5c80d14ad8e61ea8afd41eed462db" | |
| }, | |
| { | |
| "path": "LICENSE", | |
| "bytes": 11544, | |
| "sha256": "bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a" | |
| }, | |
| { | |
| "path": "LICENSE.cloudflare-clef", | |
| "bytes": 11544, | |
| "sha256": "bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a" | |
| }, | |
| { | |
| "path": "LIMITATIONS.md", | |
| "bytes": 517, | |
| "sha256": "27bb4a68d4d01e88bdb67f2f7620d579eb28839dd359976a99e25e61d38183ba" | |
| }, | |
| { | |
| "path": "MODEL_PROVENANCE.json", | |
| "bytes": 1140, | |
| "sha256": "6d0d5b1abbc873b583ab2039bc1b489cbb29c240ba4129057ef2f3495dc40b97" | |
| }, | |
| { | |
| "path": "NOTICE.cloudflare-clef", | |
| "bytes": 498, | |
| "sha256": "b0e5e3849f78da8fac2df8aebe756b68e219dcdd1aa53697a4c1c618a2f25eb9" | |
| }, | |
| { | |
| "path": "PLATFORM_CANARIES.json", | |
| "bytes": 3071, | |
| "sha256": "80060d42924b906fae8c2ea8bbd37e84ba5d34b88a37c18a229a01ebe42537b1" | |
| }, | |
| { | |
| "path": "PORTABILITY.md", | |
| "bytes": 3112, | |
| "sha256": "b8de74f1b9264fdc7c192e0e142aa98ca0198efe3905786cdd5ead9c10437185" | |
| }, | |
| { | |
| "path": "README.md", | |
| "bytes": 8421, | |
| "sha256": "68d02409d1a93d6f7ffc356a899ead5c201c2ad11641e06a1e17115f31f94e30" | |
| }, | |
| { | |
| "path": "Singularity-xMESH-0.8B-BF16.gguf", | |
| "bytes": 1571529600, | |
| "sha256": "9f4c08f19c4d203059bc74ed2754e800ec472d7276d8ddb2321480e86d392fff" | |
| }, | |
| { | |
| "path": "Singularity-xMESH-0.8B-Q8_0.gguf", | |
| "bytes": 841069440, | |
| "sha256": "41b36270b67f6c595e98cf4f29d6a0d13f0c19daa37b75741cd8296e2729fd75" | |
| }, | |
| { | |
| "path": "THIRD_PARTY_NOTICES.md", | |
| "bytes": 927, | |
| "sha256": "bbf4dec8f637ab3af8e196f74e723ad3852f5b2852d4207bfab200191c280498" | |
| }, | |
| { | |
| "path": "VALIDATION.md", | |
| "bytes": 524, | |
| "sha256": "424dde0938a291b64b2bff4a3b8665b37dc953bd04d72af0757149823ffb8a45" | |
| }, | |
| { | |
| "path": "added_tokens.json", | |
| "bytes": 904, | |
| "sha256": "e5f9bfb644ead13bd36dd6cfc41553a93b7c264c0a2e1ac67d033aa8250c8538" | |
| }, | |
| { | |
| "path": "assets/xmesh-color.png", | |
| "bytes": 692992, | |
| "sha256": "0ee7b3eae1f4a0a5f2165741ca04c79782b1ba97358e56c8a54ac315ee1c3997" | |
| }, | |
| { | |
| "path": "assets/xmesh-icon.png", | |
| "bytes": 73937, | |
| "sha256": "dbf81171ace2125db0ef306181905a9aee8fda262ced703567d54817f9976809" | |
| }, | |
| { | |
| "path": "assets/xmesh-metallic-banner.png", | |
| "bytes": 337950, | |
| "sha256": "cb1cbac421f484b8b60ad699fbdf648551191838d9a72807c3adced84d001dfa" | |
| }, | |
| { | |
| "path": "assets/xmesh-metallic.png", | |
| "bytes": 700099, | |
| "sha256": "c7fef4b00c9e4dd146e20627e2aa79636b61889f5c154793644c8347829c0ae7" | |
| }, | |
| { | |
| "path": "assets/xmesh-monochrome.png", | |
| "bytes": 276808, | |
| "sha256": "47b4bf8e756c463a8874a6a2f18e7dd2a1525cc7345d499b834e40790c942ceb" | |
| }, | |
| { | |
| "path": "assets/xmesh-wordmark-dark.png", | |
| "bytes": 559842, | |
| "sha256": "6ccf862cdc7dc0e77a1971cdb6aa4ba3b8baf237aca15e579330b7f8bed2fdea" | |
| }, | |
| { | |
| "path": "assets/xmesh-wordmark-light.png", | |
| "bytes": 833355, | |
| "sha256": "b252f3ca26cefaf531cb721a58546599a1782b349d7205edeca67bc643813d7e" | |
| }, | |
| { | |
| "path": "chat_template.jinja", | |
| "bytes": 7992, | |
| "sha256": "27938b9ab163505925cca66ba08c61a21c0be939abea87b3f73f4d6a7cead5c2" | |
| }, | |
| { | |
| "path": "config.json", | |
| "bytes": 2517, | |
| "sha256": "173e45cf24731154525e0247279203116228c64a205ede70fac6ac0435116061" | |
| }, | |
| { | |
| "path": "examples/inference.py", | |
| "bytes": 1530, | |
| "sha256": "33782e14355ebfe255f30521111ce422a6c5d35eec37f4c3d16b0e861a8cccac" | |
| }, | |
| { | |
| "path": "examples/request.json", | |
| "bytes": 2098, | |
| "sha256": "cb02086aaa9d9cec8d3b35e718752b521e711bbf86f948cfd09a143ebf554222" | |
| }, | |
| { | |
| "path": "examples/verify_manifest.py", | |
| "bytes": 1480, | |
| "sha256": "8b94a75f83bd8d506c6318cc96dfd3cd2dfa61b3f272333bb4d68256d955d8ef" | |
| }, | |
| { | |
| "path": "joint_head.safetensors", | |
| "bytes": 54661911, | |
| "sha256": "ff6433e096130f286038a1bfff07741018d6c8f6ccb91ee325419de717e87ff4" | |
| }, | |
| { | |
| "path": "joint_head_config.json", | |
| "bytes": 116, | |
| "sha256": "99f65ef462b1c92d9304ad1acecbbab93506efc0ba8227c46582b4264d27aa30" | |
| }, | |
| { | |
| "path": "joint_schema_model.py", | |
| "bytes": 23263, | |
| "sha256": "0e304cf7c6500e8bb59bef7e2afd2c6373f82596dfb3b57d1aa93c175e2dc3a3" | |
| }, | |
| { | |
| "path": "licenses/CLOUDFLARE-CLEF-APACHE-2.0.txt", | |
| "bytes": 11544, | |
| "sha256": "bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a" | |
| }, | |
| { | |
| "path": "merges.txt", | |
| "bytes": 3353273, | |
| "sha256": "3bd640ba6d8da8f5844f3548b7e2184fc664dd670e1447e425a48dbaaad1ef43" | |
| }, | |
| { | |
| "path": "model.safetensors-00001-of-00001.safetensors", | |
| "bytes": 1746942954, | |
| "sha256": "2dda751389cf7d98cfed72a16e6d8ce253dcd125b84870713cd33d1637e0ab84" | |
| }, | |
| { | |
| "path": "model.safetensors.index.json", | |
| "bytes": 50900, | |
| "sha256": "d8a08838a613b025eb7952ed9db11696213e57e76a375661ef5c12f9dd5dcf4e" | |
| }, | |
| { | |
| "path": "preprocessor_config.json", | |
| "bytes": 781, | |
| "sha256": "b99182e09450f26453502b3c3390cce36b33dc8c4a1f3ee21807762e168c74ab" | |
| }, | |
| { | |
| "path": "processor_config.json", | |
| "bytes": 1300, | |
| "sha256": "14932921ca485d458a04dafd8069fbb0a4505622a48208d19ed247115801385b" | |
| }, | |
| { | |
| "path": "requirements.txt", | |
| "bytes": 101, | |
| "sha256": "eccb4bd138c9553fb101a9305d6406a9861157b31be822bcf120bad77979dc6f" | |
| }, | |
| { | |
| "path": "sgl_decision_config.json", | |
| "bytes": 336, | |
| "sha256": "8d0c5641166db1436888523d5e8a879cf4bc23da5bff4b282e1a4dba9bb2450a" | |
| }, | |
| { | |
| "path": "sgl_systemone.py", | |
| "bytes": 5010, | |
| "sha256": "0a7c9e42f4b3b18fd192e9c36056fda49480bd95bfe470f66184704a55e2d895" | |
| }, | |
| { | |
| "path": "special_tokens_map.json", | |
| "bytes": 876, | |
| "sha256": "ce5cbe737f4aacc7696180aac743091101b59e4dc5a338d9fc8a6f716aa513f7" | |
| }, | |
| { | |
| "path": "tokenizer.json", | |
| "bytes": 19989343, | |
| "sha256": "87a7830d63fcf43bf241c3c5242e96e62dd3fdc29224ca26fed8ea333db72de4" | |
| }, | |
| { | |
| "path": "tokenizer_config.json", | |
| "bytes": 15715, | |
| "sha256": "b9dc588af5170900b1c1f46301d7cfa0acff1f26a2a3449a299b1c337b5a3f58" | |
| }, | |
| { | |
| "path": "video_preprocessor_config.json", | |
| "bytes": 817, | |
| "sha256": "59c5c9eb52182eb14c06ffb10ca9effd29adce5f238a95de23ca14a38dbd2cb1" | |
| }, | |
| { | |
| "path": "vocab.json", | |
| "bytes": 5234494, | |
| "sha256": "4ab0d5c096294054b66444a116a20baf6e29998fc1fae410ffe4b6fadbc56b5c" | |
| }, | |
| { | |
| "path": "xmesh_policy.py", | |
| "bytes": 5375, | |
| "sha256": "ab0b5125142259dec6e93e5ed21c6cf616afb6be84035f418a1e57e0c1192580" | |
| } | |
| ] | |
| } | |