Instructions to use Maxinger15/LunaraHome-26B-A4B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Maxinger15/LunaraHome-26B-A4B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Maxinger15/LunaraHome-26B-A4B")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("Maxinger15/LunaraHome-26B-A4B")
model = AutoModelForMultimodalLM.from_pretrained("Maxinger15/LunaraHome-26B-A4B", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Maxinger15/LunaraHome-26B-A4B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Maxinger15/LunaraHome-26B-A4B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Maxinger15/LunaraHome-26B-A4B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Maxinger15/LunaraHome-26B-A4B

SGLang

How to use Maxinger15/LunaraHome-26B-A4B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Maxinger15/LunaraHome-26B-A4B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Maxinger15/LunaraHome-26B-A4B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Maxinger15/LunaraHome-26B-A4B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Maxinger15/LunaraHome-26B-A4B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Maxinger15/LunaraHome-26B-A4B with Docker Model Runner:
```
docker model run hf.co/Maxinger15/LunaraHome-26B-A4B
```

LunaraHome-26B-A4B / source.json

Maxinger15

Publish standalone LunaraHome v0.1 BF16 model as one safetensors

736b58c verified 26 days ago

Raw History Blame Contribute Delete

4.1 kB

{
  "version": "v0.1",
  "name_status": "user_selected",
  "publication_status": "release_package",
  "own_contributions_license": "MIT",
  "upstream_base_license": "Apache-2.0",
  "xlam_research_statement": "unresolved",
  "base_model": "google/gemma-4-26B-A4B-it-qat-q4_0-unquantized",
  "base_revision": "f1e06dc520982d9b9edd76859fdb7ab209449949",
  "source_run_id": "5d0e7122a0b24a94b1294215ec2d22f5",
  "source_checkpoint": "checkpoint-600",
  "source_final_revision": "165fcaa2fd19afad402c3839605b9e946d56ef4b",
  "source_code_revision": "d1ea3a61a5dc4c2c134e3efe51c9ab4f14a3e887",
  "reference_kind": "starting_adapter",
  "reference_revision": "ebc7bc8c48653a63002e62fd7ac33d0b42c24120",
  "evaluation_input_manifest_sha256": "74d9cbc2c4b37ea06518a0415b34c7e2ea6701c8d11bd9b864a919af7d227513",
  "diagnostic_gate": "rejected",
  "device_control_approved": false,
  "reserved_confirmation_used": false,
  "model_name": "LunaraHome",
  "repository": "Maxinger15/LunaraHome-26B-A4B",
  "release_tag": "v0.1-bf16",
  "adapter_files": {
    "adapter_model.safetensors": "0368a13bb982761608ea78c982050427327bd30e282138410e2b42d9ff2e9baf",
    "tokenizer_config.json": "ae79d5349f543e549ca2721755b030dbba92614e25585f4c7e9aaa3734dfa6ae",
    "tokenizer.json": "cc8d3a0ce36466ccc1278bf987df5f71db1719b9ca6b4118264f45cb627bfe0f",
    "adapter_config.json": "0a27f8e5a934dc9f6de6470fda2c27bae3609fbde25b198a62909d3e2a1b2fe6",
    "chat_template.jinja": "ae53464bf3be25802b3a5b37def7fd89667067d7577049b3b2d74c4d8de4c6d4"
  },
  "package_format": "merged_bf16",
  "original_adapter_tag": "v0.1",
  "export_run_id": "efad3e7b78534728b4d99107ad7c55fc",
  "export_revision": "ae2e9f8afd1b2545af638453c8b9cc2f30bff84a",
  "export_code_revision": "df8b651d8336fa84f4973790a76d6622e049a296",
  "export_verification": {
    "base_model": "google/gemma-4-26B-A4B-it-qat-q4_0-unquantized",
    "base_revision": "f1e06dc520982d9b9edd76859fdb7ab209449949",
    "adapter_revision": "165fcaa2fd19afad402c3839605b9e946d56ef4b",
    "adapter_prefix": "runs/5d0e7122a0b24a94b1294215ec2d22f5/final",
    "weights_sha256": "8c56ac9c10703c8c1274814dd3820ddb54c1be1301d9f2ae37ffb1237ecacea9",
    "weights_bytes": 51612010052,
    "single_safetensors": true,
    "standalone_reload_verified": true,
    "smoke_generation_matches_starting_adapter": true,
    "starting_token_ids": [
      2,
      105,
      2364,
      107,
      45890,
      236764,
      691,
      57256,
      1747,
      236881,
      106,
      107,
      105,
      4368,
      107,
      100,
      45518,
      107,
      101,
      45890,
      236888,
      20210,
      10915,
      147224,
      236743,
      236812,
      236764,
      2535,
      25093,
      22160,
      9483
    ],
    "merged_token_ids": [
      2,
      105,
      2364,
      107,
      45890,
      236764,
      691,
      57256,
      1747,
      236881,
      106,
      107,
      105,
      4368,
      107,
      100,
      45518,
      107,
      101,
      45890,
      236888,
      20210,
      10915,
      147224,
      236743,
      236812,
      236764,
      2535,
      25093,
      22160,
      9483
    ],
    "optimizer_steps": 0,
    "reserved_confirmation_used": false,
    "full_benchmark_repeated": false
  },
  "gguf_repository": "Maxinger15/LunaraHome-26B-A4B-GGUF",
  "files": {
    "chat_template.jinja": "ae53464bf3be25802b3a5b37def7fd89667067d7577049b3b2d74c4d8de4c6d4",
    "config.json": "cfc7a26c3c72e1bf72198bbea11435bfa0644f44cec8e1ed9e01881d63c07d36",
    "export-receipt.json": "bad9392e808f73578308d41dab1675842e4ee3cfc8ee74ba71a07e05c0465fa0",
    "generation_config.json": "ab62926273a435bed81af368050f3a0ba5b7298d8b09f0e7615ccc41bc787103",
    "model.safetensors": "8c56ac9c10703c8c1274814dd3820ddb54c1be1301d9f2ae37ffb1237ecacea9",
    "tokenizer.json": "cc8d3a0ce36466ccc1278bf987df5f71db1719b9ca6b4118264f45cb627bfe0f",
    "tokenizer_config.json": "ae79d5349f543e549ca2721755b030dbba92614e25585f4c7e9aaa3734dfa6ae",
    "processor_config.json": "32bdf45d2ad4cc29a0822ddd157a182de76644f0419a6228d151495256e9813c"
  }
}

	{
	"version": "v0.1",
	"name_status": "user_selected",
	"publication_status": "release_package",
	"own_contributions_license": "MIT",
	"upstream_base_license": "Apache-2.0",
	"xlam_research_statement": "unresolved",
	"base_model": "google/gemma-4-26B-A4B-it-qat-q4_0-unquantized",
	"base_revision": "f1e06dc520982d9b9edd76859fdb7ab209449949",
	"source_run_id": "5d0e7122a0b24a94b1294215ec2d22f5",
	"source_checkpoint": "checkpoint-600",
	"source_final_revision": "165fcaa2fd19afad402c3839605b9e946d56ef4b",
	"source_code_revision": "d1ea3a61a5dc4c2c134e3efe51c9ab4f14a3e887",
	"reference_kind": "starting_adapter",
	"reference_revision": "ebc7bc8c48653a63002e62fd7ac33d0b42c24120",
	"evaluation_input_manifest_sha256": "74d9cbc2c4b37ea06518a0415b34c7e2ea6701c8d11bd9b864a919af7d227513",
	"diagnostic_gate": "rejected",
	"device_control_approved": false,
	"reserved_confirmation_used": false,
	"model_name": "LunaraHome",
	"repository": "Maxinger15/LunaraHome-26B-A4B",
	"release_tag": "v0.1-bf16",
	"adapter_files": {
	"adapter_model.safetensors": "0368a13bb982761608ea78c982050427327bd30e282138410e2b42d9ff2e9baf",
	"tokenizer_config.json": "ae79d5349f543e549ca2721755b030dbba92614e25585f4c7e9aaa3734dfa6ae",
	"tokenizer.json": "cc8d3a0ce36466ccc1278bf987df5f71db1719b9ca6b4118264f45cb627bfe0f",
	"adapter_config.json": "0a27f8e5a934dc9f6de6470fda2c27bae3609fbde25b198a62909d3e2a1b2fe6",
	"chat_template.jinja": "ae53464bf3be25802b3a5b37def7fd89667067d7577049b3b2d74c4d8de4c6d4"
	},
	"package_format": "merged_bf16",
	"original_adapter_tag": "v0.1",
	"export_run_id": "efad3e7b78534728b4d99107ad7c55fc",
	"export_revision": "ae2e9f8afd1b2545af638453c8b9cc2f30bff84a",
	"export_code_revision": "df8b651d8336fa84f4973790a76d6622e049a296",
	"export_verification": {
	"base_model": "google/gemma-4-26B-A4B-it-qat-q4_0-unquantized",
	"base_revision": "f1e06dc520982d9b9edd76859fdb7ab209449949",
	"adapter_revision": "165fcaa2fd19afad402c3839605b9e946d56ef4b",
	"adapter_prefix": "runs/5d0e7122a0b24a94b1294215ec2d22f5/final",
	"weights_sha256": "8c56ac9c10703c8c1274814dd3820ddb54c1be1301d9f2ae37ffb1237ecacea9",
	"weights_bytes": 51612010052,
	"single_safetensors": true,
	"standalone_reload_verified": true,
	"smoke_generation_matches_starting_adapter": true,
	"starting_token_ids": [
	2,
	105,
	2364,
	107,
	45890,
	236764,
	691,
	57256,
	1747,
	236881,
	106,
	107,
	105,
	4368,
	107,
	100,
	45518,
	107,
	101,
	45890,
	236888,
	20210,
	10915,
	147224,
	236743,
	236812,
	236764,
	2535,
	25093,
	22160,
	9483
	],
	"merged_token_ids": [
	2,
	105,
	2364,
	107,
	45890,
	236764,
	691,
	57256,
	1747,
	236881,
	106,
	107,
	105,
	4368,
	107,
	100,
	45518,
	107,
	101,
	45890,
	236888,
	20210,
	10915,
	147224,
	236743,
	236812,
	236764,
	2535,
	25093,
	22160,
	9483
	],
	"optimizer_steps": 0,
	"reserved_confirmation_used": false,
	"full_benchmark_repeated": false
	},
	"gguf_repository": "Maxinger15/LunaraHome-26B-A4B-GGUF",
	"files": {
	"chat_template.jinja": "ae53464bf3be25802b3a5b37def7fd89667067d7577049b3b2d74c4d8de4c6d4",
	"config.json": "cfc7a26c3c72e1bf72198bbea11435bfa0644f44cec8e1ed9e01881d63c07d36",
	"export-receipt.json": "bad9392e808f73578308d41dab1675842e4ee3cfc8ee74ba71a07e05c0465fa0",
	"generation_config.json": "ab62926273a435bed81af368050f3a0ba5b7298d8b09f0e7615ccc41bc787103",
	"model.safetensors": "8c56ac9c10703c8c1274814dd3820ddb54c1be1301d9f2ae37ffb1237ecacea9",
	"tokenizer.json": "cc8d3a0ce36466ccc1278bf987df5f71db1719b9ca6b4118264f45cb627bfe0f",
	"tokenizer_config.json": "ae79d5349f543e549ca2721755b030dbba92614e25585f4c7e9aaa3734dfa6ae",
	"processor_config.json": "32bdf45d2ad4cc29a0822ddd157a182de76644f0419a6228d151495256e9813c"
	}
	}