GGUF
conversational
How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf rmaaorg/nexis4:Q2_K
# Run inference directly in the terminal:
llama cli -hf rmaaorg/nexis4:Q2_K
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf rmaaorg/nexis4:Q2_K
# Run inference directly in the terminal:
llama cli -hf rmaaorg/nexis4:Q2_K
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf rmaaorg/nexis4:Q2_K
# Run inference directly in the terminal:
./build/bin/llama cli -hf rmaaorg/nexis4:Q2_K
Use Docker
docker model run hf.co/rmaaorg/nexis4:Q2_K
Quick Links

NEXIS-4 Base Model

This repository holds the text-planning base and original RMAA materials for the NEXIS-4 music project.

Current base model

  • qwen2.5-0.5b-instruct-q2_k.gguf β€” Qwen2.5-0.5B-Instruct Q2_K for original lyrics, song sections, and composition planning. It is text-only and does not generate sung audio. Upstream license: Apache-2.0; see LICENSE-APACHE-2.0.txt.

NEXIS-4 voicebank policy

All four NEXIS-4 singer identities (SOLA, VEXA, LUMEN, KAIYA) are to be crafted from synthetic-only training data. No human voice recordings, third-party speaker presets, or pretrained human singer identities are included or used as NEXIS-4 voices. The voicebanks and singing renderer are still to be built.

Target song structure: Intro β†’ Verse 1 β†’ Chorus 1 β†’ Rap Verse β†’ Chorus 2 β†’ Verse 3 β†’ Chorus 3 β†’ Bridge β†’ Outro. Guitar is excluded from the default arrangement.

Licensing

LICENSE (BSL 1.1) covers only RMAA-original NEXIS-4 materials. The Qwen GGUF remains under its upstream Apache-2.0 license. See MODEL_LICENSES.md.

VectorVision data

The vector corpus is stored in vector/parquet.

Official DOI: 10.57967/hf/11502.

Downloads last month
44
GGUF
Model size
0.6B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

2-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support