Text Generation
PyTorch
Safetensors
GGUF
qwen3_5_text
deltanet
qwen3.8
cpu
efficient
low-memory
ternary
bitnet
jirack
web-ui
routing
tool-call
robotics
ollama
ternary-weights
ternary-transformer
quantization
1.58-bit
conversational
Instructions to use CMSManhattan/JiRackDeltaNet_70b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use CMSManhattan/JiRackDeltaNet_70b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf CMSManhattan/JiRackDeltaNet_70b:Q4_K_M # Run inference directly in the terminal: llama cli -hf CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf CMSManhattan/JiRackDeltaNet_70b:Q4_K_M # Run inference directly in the terminal: llama cli -hf CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf CMSManhattan/JiRackDeltaNet_70b:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
Use Docker
docker model run hf.co/CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use CMSManhattan/JiRackDeltaNet_70b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "CMSManhattan/JiRackDeltaNet_70b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CMSManhattan/JiRackDeltaNet_70b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
- Ollama
How to use CMSManhattan/JiRackDeltaNet_70b with Ollama:
ollama run hf.co/CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
- Unsloth Desktop
- Pi
How to use CMSManhattan/JiRackDeltaNet_70b with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "CMSManhattan/JiRackDeltaNet_70b:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use CMSManhattan/JiRackDeltaNet_70b with Docker Model Runner:
docker model run hf.co/CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
- Lemonade
How to use CMSManhattan/JiRackDeltaNet_70b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
Run and chat with the model
lemonade run user.JiRackDeltaNet_70b-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use CMSManhattan/JiRackDeltaNet_70b with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use CMSManhattan/JiRackDeltaNet_70b with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf CMSManhattan/JiRackDeltaNet_70b:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "CMSManhattan/JiRackDeltaNet_70b:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Update LICENSE
Browse files
LICENSE
CHANGED
|
@@ -1,63 +1,107 @@
|
|
| 1 |
-
Business Source License 1.2.
|
| 2 |
-
Copyright 2026 Konstantin Grabko (CMS Manhattan) . All rights reserved.
|
| 3 |
JiRack Proprietary Model License
|
| 4 |
-
Copyright
|
| 5 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
1. Definitions
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
2. Ownership and Reservation of Rights
|
| 16 |
-
2.1. The Licensor
|
| 17 |
-
|
| 18 |
-
2.
|
| 19 |
-
|
| 20 |
-
3.
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
5. Commercial Agreements
|
| 32 |
-
5.1. A Commercial Agreement must be in writing and signed by both parties
|
| 33 |
-
|
| 34 |
-
5.
|
|
|
|
| 35 |
6. Termination
|
| 36 |
-
6.1. This License terminates automatically if
|
| 37 |
-
|
| 38 |
-
6.
|
|
|
|
|
|
|
| 39 |
7. Disclaimer of Warranties
|
| 40 |
-
|
| 41 |
-
|
|
|
|
|
|
|
|
|
|
| 42 |
8. Limitation of Liability
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
|
|
|
|
|
|
| 46 |
9. General
|
| 47 |
-
9.1. Governing Law: This License is governed by the laws of
|
| 48 |
-
|
| 49 |
-
9.
|
| 50 |
-
|
| 51 |
-
9.
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
📧 Contact & Licensing
|
| 59 |
-
For joint ventures, hardware integration, or licensing inquiries:
|
| 60 |
|
|
|
|
| 61 |
Email: grabko@cmsmanhattan.com
|
| 62 |
Phone: +1 (516) 777-0945
|
| 63 |
Location: New York, USA
|
|
|
|
|
|
|
|
|
|
| 1 |
JiRack Proprietary Model License
|
| 2 |
+
Copyright (c) 2026 Konstantin Grabko, d/b/a CMS Manhattan. All rights reserved.
|
| 3 |
+
|
| 4 |
+
This License governs access to and use of the Software. By downloading,
|
| 5 |
+
installing, copying, or otherwise using the Software, you agree to these terms.
|
| 6 |
+
If you do not agree, do not download or use the Software.
|
| 7 |
+
|
| 8 |
1. Definitions
|
| 9 |
+
"Licensor" means Konstantin Grabko, doing business as CMS Manhattan, New York, NY, USA.
|
| 10 |
+
"Software" means JiRack, including model weights, source code, scripts, configuration
|
| 11 |
+
files, and documentation, together with all modifications, derivative works, and
|
| 12 |
+
fine-tuned versions, whether created by the Licensor or by any other person,
|
| 13 |
+
excluding the Base Model Components described in Section 2.4.
|
| 14 |
+
"Non-Commercial User" means (a) an individual using the Software for personal,
|
| 15 |
+
non-commercial purposes, or (b) an accredited academic institution or a non-profit
|
| 16 |
+
organization using the Software solely for research, education, or evaluation.
|
| 17 |
+
"Company" means any corporation, partnership, government body, or other organization
|
| 18 |
+
that is not a Non-Commercial User.
|
| 19 |
+
"Commercial Use" means any use of the Software by or on behalf of a Company,
|
| 20 |
+
including internal use, testing, development, production use, integration into
|
| 21 |
+
products or services, hosting, or access through an API or cloud service, whether
|
| 22 |
+
or not a fee is charged.
|
| 23 |
+
"Integrator" means any person that embeds the Software into a product or service
|
| 24 |
+
intended for third parties.
|
| 25 |
+
"Reseller" means any person that sells, leases, sublicenses, or otherwise makes the
|
| 26 |
+
Software available to third parties.
|
| 27 |
+
"Commercial Agreement" means a separate written agreement signed by the Licensor and
|
| 28 |
+
a licensee that permits Commercial Use.
|
| 29 |
+
"Authorized Territory" means worldwide, excluding jurisdictions subject to
|
| 30 |
+
comprehensive U.S. sanctions.
|
| 31 |
+
|
| 32 |
2. Ownership and Reservation of Rights
|
| 33 |
+
2.1. The Licensor owns all right, title, and interest in the Software, including the
|
| 34 |
+
Licensor's modifications, architecture changes, training, and resulting model weights.
|
| 35 |
+
2.2. This License grants only the limited rights expressly set out below. No
|
| 36 |
+
ownership interest is transferred.
|
| 37 |
+
2.3. All rights not expressly granted are reserved by the Licensor.
|
| 38 |
+
2.4. Base Model Components. The Software is a derivative work of a Qwen model
|
| 39 |
+
released under the Apache License, Version 2.0. Components originating from that
|
| 40 |
+
base model remain subject to the Apache License 2.0. See LICENSE-APACHE and NOTICE.md.
|
| 41 |
+
Nothing in this License restricts any right granted to you by the Apache License 2.0
|
| 42 |
+
with respect to those components.
|
| 43 |
+
|
| 44 |
+
3. Free Non-Commercial License
|
| 45 |
+
3.1. The Licensor grants each Non-Commercial User a free, non-exclusive,
|
| 46 |
+
non-transferable, revocable license to download, install, use, and modify the
|
| 47 |
+
Software solely for non-commercial research, education, evaluation, and personal use.
|
| 48 |
+
3.2. A Non-Commercial User may publish research results, benchmarks, and papers
|
| 49 |
+
based on the Software, provided the Software is credited as "JiRack by CMS Manhattan".
|
| 50 |
+
3.3. A Non-Commercial User may not distribute the Software or modified versions of it
|
| 51 |
+
without the Licensor's prior written consent.
|
| 52 |
+
3.4. All copies must retain copyright notices and the terms of this License.
|
| 53 |
+
|
| 54 |
+
4. Commercial Use
|
| 55 |
+
4.1. Any Commercial Use, including internal use within a Company, requires a signed
|
| 56 |
+
Commercial Agreement and payment of the applicable fees.
|
| 57 |
+
4.2. An Integrator may not embed the Software into any product or service without a
|
| 58 |
+
Commercial Agreement.
|
| 59 |
+
4.3. A Reseller may not make the Software available to third parties without the
|
| 60 |
+
Licensor's prior written consent.
|
| 61 |
+
4.4. No person may provide access to the Software through an API, cloud service, or
|
| 62 |
+
hosting unless a Commercial Agreement expressly grants that right.
|
| 63 |
+
4.5. Upon written request, a commercial licensee must provide information reasonably
|
| 64 |
+
necessary to verify compliance with this License.
|
| 65 |
+
4.6. Circumventing technical protection measures, license keys, or usage tracking
|
| 66 |
+
is prohibited.
|
| 67 |
+
|
| 68 |
5. Commercial Agreements
|
| 69 |
+
5.1. A Commercial Agreement must be in writing and signed by both parties, and shall
|
| 70 |
+
specify the scope of rights, term, territory, and fees.
|
| 71 |
+
5.2. The Licensor may offer different terms to different licensees.
|
| 72 |
+
|
| 73 |
6. Termination
|
| 74 |
+
6.1. This License terminates automatically if a licensee breaches any of its terms
|
| 75 |
+
and fails to cure the breach within thirty (30) days after written notice.
|
| 76 |
+
6.2. Upon termination, the licensee must stop using the Software and delete all copies.
|
| 77 |
+
6.3. Sections 2, 4.5, 4.6, 6.2, 7, 8, and 9 survive termination.
|
| 78 |
+
|
| 79 |
7. Disclaimer of Warranties
|
| 80 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED,
|
| 81 |
+
INCLUDING WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, AND
|
| 82 |
+
NON-INFRINGEMENT. THE LICENSOR DOES NOT WARRANT THAT OUTPUTS WILL BE ACCURATE OR
|
| 83 |
+
COMPLETE.
|
| 84 |
+
|
| 85 |
8. Limitation of Liability
|
| 86 |
+
TO THE MAXIMUM EXTENT PERMITTED BY LAW, THE LICENSOR SHALL NOT BE LIABLE FOR ANY
|
| 87 |
+
INDIRECT, INCIDENTAL, SPECIAL, PUNITIVE, OR CONSEQUENTIAL DAMAGES. THE LICENSOR'S
|
| 88 |
+
AGGREGATE LIABILITY SHALL NOT EXCEED THE AMOUNTS PAID TO THE LICENSOR BY THE
|
| 89 |
+
RELEVANT PERSON DURING THE TWELVE (12) MONTHS PRECEDING THE CLAIM.
|
| 90 |
+
|
| 91 |
9. General
|
| 92 |
+
9.1. Governing Law: This License is governed by the laws of the State of New York,
|
| 93 |
+
without regard to its conflict-of-laws principles.
|
| 94 |
+
9.2. Venue: Disputes shall be brought exclusively in the state or federal courts
|
| 95 |
+
located in New York County, New York.
|
| 96 |
+
9.3. Entire Agreement: This License, together with any Commercial Agreement,
|
| 97 |
+
constitutes the entire agreement regarding the Software.
|
| 98 |
+
9.4. Severability: If any provision is held unenforceable, the remaining provisions
|
| 99 |
+
remain in effect.
|
| 100 |
+
9.5. No Waiver: Failure to enforce a provision is not a waiver of it.
|
| 101 |
+
9.6. Export: No person may use or export the Software in violation of export control
|
| 102 |
+
or sanctions laws.
|
|
|
|
|
|
|
| 103 |
|
| 104 |
+
Contact & Licensing
|
| 105 |
Email: grabko@cmsmanhattan.com
|
| 106 |
Phone: +1 (516) 777-0945
|
| 107 |
Location: New York, USA
|