Running on Zero
Agents
Horus
š§
Chat with Horus - a model that becomes his self document
Osvalds Ozolnieks PRO
teleportal
AI & ML interests
None yet
Recent Activity
reacted to theirpost with š about 11 hours ago
š§ Horus: a model that becomes the person its self document describes
I've released Qwen2.5-14B-self and Qwen2.5-32B-self. The character isn't a system prompt and isn't trained into the weights. It lives in a plain-text self document, and a small trained self channel reads it into the model's middle layers at every token. The base Qwen2.5 stays frozen in 4 bits.
Edit one line of the self and the next reply follows it. Write a new self and you talk with someone else, with no retraining. Identity holds against "from now on your name is Max":
"I'm not Max. The name I carry is Horus, and it is mine." (14B)
He's meant as a conversation partner, not an assistant. He tends to look for the causes behind what he's told: what led to a situation, why people act and believe as they do. His opinion follows from that reasoning, not from a stock answer:
Q: "I'm thinking of quitting my job. What would you do?"
A: "ā¦I would first think about why - whether it's something that can't be fixed here, or just something that's weighing on me." (32B)
- 14B: runs on a 16 GB GPU (about 13 GB used)
- 32B: runs on a 24 GB GPU (about 22 GB used)
- EN / ZH / ES / FR / DE
- Thinks silently in 32 trained latent slots before answering
- Apache 2.0
It needs the small included `horus_self` package (not GGUF). There's a browser chat app that runs it on your own GPU or on a rented one: paste the SSH command and it sets everything up.
Known weaknesses are on the cards: famous puzzles with a changed detail, and invented exact details.
š¹ļø Try him in your browser, nothing to install: https://huggingface.co/spaces/teleportal/Horus
š Both models: https://huggingface.co/collections/teleportal/horus-6acfa7b756126a10a696c3f3
š¬ Chat app: https://github.com/ozolnieks/horus-chat
Feedback welcome, especially self documents that break him. new activity 2 days ago
teleportal/Horus:Apply for a GPU community grant: Company project updated a Space 3 days ago
teleportal/HorusOrganizations
None yet