Instructions to use N8Programs/TheWrongRoom with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use N8Programs/TheWrongRoom with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf N8Programs/TheWrongRoom:IQ4_XS
# Run inference directly in the terminal:
llama cli -hf N8Programs/TheWrongRoom:IQ4_XS

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf N8Programs/TheWrongRoom:IQ4_XS
# Run inference directly in the terminal:
llama cli -hf N8Programs/TheWrongRoom:IQ4_XS

Build from source code

git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf N8Programs/TheWrongRoom:IQ4_XS
# Run inference directly in the terminal:
./build/bin/llama cli -hf N8Programs/TheWrongRoom:IQ4_XS

Use Docker

docker model run hf.co/N8Programs/TheWrongRoom:IQ4_XS

Llama new
LM Studio
Jan
Ollama
How to use N8Programs/TheWrongRoom with Ollama:
```
ollama run hf.co/N8Programs/TheWrongRoom:IQ4_XS
```
Unsloth Desktop

How to use N8Programs/TheWrongRoom with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf N8Programs/TheWrongRoom:IQ4_XS

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "N8Programs/TheWrongRoom:IQ4_XS"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use N8Programs/TheWrongRoom with Docker Model Runner:
```
docker model run hf.co/N8Programs/TheWrongRoom:IQ4_XS
```

Lemonade

How to use N8Programs/TheWrongRoom with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull N8Programs/TheWrongRoom:IQ4_XS

Run and chat with the model

lemonade run user.TheWrongRoom-IQ4_XS

List all available models

lemonade list

Hermes Agent

How to use N8Programs/TheWrongRoom with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf N8Programs/TheWrongRoom:IQ4_XS

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default N8Programs/TheWrongRoom:IQ4_XS

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use N8Programs/TheWrongRoom with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf N8Programs/TheWrongRoom:IQ4_XS

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "N8Programs/TheWrongRoom:IQ4_XS" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

N8Programs commited on Dec 1, 2024

Commit

d3373a7

verified ·

1 Parent(s): 7d978e5

Upload 5 files

Browse files

Files changed (5) hide show

The Wrong Room-1.0.0-arm64-mac.zip +2 -2
The Wrong Room-1.0.0-arm64-win.zip +2 -2
The Wrong Room-1.0.0-arm64.AppImage +2 -2
The Wrong Room-1.0.0-x86-win.zip +2 -2
The Wrong Room-1.0.0-x86.AppImage +2 -2

The Wrong Room-1.0.0-arm64-mac.zip CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:379b5ff0d8a5ebac15b9ba653b6a45ec6412af0a3132b7d399f0dfec4d1ed285
-size 2494541195

 version https://git-lfs.github.com/spec/v1
+oid sha256:893dd4d5ed99843527deecb711f1779e63f33fb19cf589e2708520f19f5ab127
+size 2494542397

The Wrong Room-1.0.0-arm64-win.zip CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cc94587c1af48c516317b6d1070e44923e6a3d6249c15a748618487383fb5e7e
-size 2659107854

 version https://git-lfs.github.com/spec/v1
+oid sha256:33b9f9f0fc9b54adaf926760af74ccdbce46ff87a3ec8182eb2e88dd633c4c32
+size 2659109063

The Wrong Room-1.0.0-arm64.AppImage CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1fe1dc04fca82a5221b3d595a9c6abdf185a60862b67f6e8d20883596ba4425c
-size 2522059167

 version https://git-lfs.github.com/spec/v1
+oid sha256:287f6072e87f187c6962d83573eed6bdd0290f3acea705de1d2c76639fdc1d09
+size 2522058550

The Wrong Room-1.0.0-x86-win.zip CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a50a61dc54180e3200b62894f60fa1b08efe1abf0fad4f4db5026226fa50872f
-size 2654121521

 version https://git-lfs.github.com/spec/v1
+oid sha256:d2554ce7cf8b20f250c5902b39d379e0e4dc22c942be35eda4682bd0504f7a73
+size 2654122730

The Wrong Room-1.0.0-x86.AppImage CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9f10f65476e4ebdcb140f677d87262f2dc6ab1f286543bb921f1e40379e40b07
-size 2521650292

 version https://git-lfs.github.com/spec/v1
+oid sha256:147c17577b9e07ac1e055a1401bf07e7dbaf51b77df015c72e2806ddf1a62a3d
+size 2521649560