GGUF
English
conversational
How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf gggff123/lopus3
# Run inference directly in the terminal:
llama cli -hf gggff123/lopus3
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf gggff123/lopus3
# Run inference directly in the terminal:
llama cli -hf gggff123/lopus3
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf gggff123/lopus3
# Run inference directly in the terminal:
./llama-cli -hf gggff123/lopus3
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf gggff123/lopus3
# Run inference directly in the terminal:
./build/bin/llama-cli -hf gggff123/lopus3
Use Docker
docker model run hf.co/gggff123/lopus3
Quick Links

This is my attempt to copy claude opus 3 behaviour into lfm 2.5 350m

Model details

It succesfully recognises itself and behaves 70% of claudes helpful behaviour Though the intellegence remains the same it considers himself as a claude model.

How to use it?

This is a gguf / quantisized model so it can be run with llama.cpp , ollama, vllm etc. Using a system prompt might enhance the claude like behavior to 90%

Advantages

  • Small model
  • Testing model
  • Copies claudes helpful behaviour
  • Fast and free

Disadvantages

  • Decreased intellgence ( cant answer complex problems very good )
  • Often gives nonsense

I will be pleased if you try this model i tuned

Downloads last month
115
GGUF
Model size
0.4B params
Architecture
lfm2
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for gggff123/lopus3

Quantized
(89)
this model

Dataset used to train gggff123/lopus3