Instructions to use Vortex5/Red-Synthesis-12B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Vortex5/Red-Synthesis-12B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Vortex5/Red-Synthesis-12B")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Vortex5/Red-Synthesis-12B") model = AutoModelForCausalLM.from_pretrained("Vortex5/Red-Synthesis-12B", device_map="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Vortex5/Red-Synthesis-12B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Vortex5/Red-Synthesis-12B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Red-Synthesis-12B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Vortex5/Red-Synthesis-12B
- SGLang
How to use Vortex5/Red-Synthesis-12B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Vortex5/Red-Synthesis-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Red-Synthesis-12B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Vortex5/Red-Synthesis-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Vortex5/Red-Synthesis-12B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Vortex5/Red-Synthesis-12B with Docker Model Runner:
docker model run hf.co/Vortex5/Red-Synthesis-12B
| base_model: | |
| - SuperbEmphasis/MN-12b-RP-Ink-RP-Longform | |
| - inflatebot/MN-12B-Mag-Mell-R1 | |
| - Vortex5/LunaMaid-12B | |
| - Vortex5/Lunar-Nexus-12B | |
| - DreadPoor/Strawberry_Smoothie-12B-Model_Stock | |
| - Vortex5/Dreamstar-12B | |
| - Vortex5/Scarlet-Seraph-12B | |
| library_name: transformers | |
| tags: | |
| - mergekit | |
| - merge | |
| - roleplay | |
| <section class="shell"> | |
| <div class="title-frame"> | |
| <div class="title-block wide"> | |
| <h2 class="hero-title">Red-Synthesis-12B</h2> | |
| </div> | |
| <div class="image-slot inset"> | |
| <img src="https://cdn-uploads.huggingface.co/production/uploads/6669a3a617b838fda45637b8/CqzWF2Dp_7uGZprxKKtVB.png"> | |
| </div> | |
| </div> | |
| <div class="divider"></div> | |
| <section class="pane blended"> | |
| <h2 class="pane-title">Overview</h2> | |
| <p> | |
| <strong style="color:#8b001c;">Red-Synthesis-12B</strong> was created by merging | |
| <a href="https://huggingface.co/Vortex5/Scarlet-Seraph-12B">Scarlet-Seraph-12B</a>, | |
| <a href="https://huggingface.co/DreadPoor/Strawberry_Smoothie-12B-Model_Stock">Strawberry_Smoothie-12B-Model_Stock</a>, | |
| <a href="https://huggingface.co/inflatebot/MN-12B-Mag-Mell-R1">MN-12B-Mag-Mell-R1</a>, | |
| <a href="https://huggingface.co/Vortex5/Lunar-Nexus-12B">Lunar-Nexus-12B</a>, | |
| <a href="https://huggingface.co/SuperbEmphasis/MN-12b-RP-Ink-RP-Longform">MN-12b-RP-Ink-RP-Longform</a>, | |
| <a href="https://huggingface.co/Vortex5/LunaMaid-12B">LunaMaid-12B</a>, | |
| and | |
| <a href="https://huggingface.co/Vortex5/Dreamstar-12B">Dreamstar-12B</a> | |
| using a custom method. | |
| </p> | |
| <details class="expando nested" style="margin-top:12px;"> | |
| <summary>Show YAML Config</summary> | |
| <pre> | |
| models: | |
| - model: Vortex5/Scarlet-Seraph-12B | |
| - model: DreadPoor/Strawberry_Smoothie-12B-Model_Stock | |
| - model: inflatebot/MN-12B-Mag-Mell-R1 | |
| - model: Vortex5/Lunar-Nexus-12B | |
| - model: SuperbEmphasis/MN-12b-RP-Ink-RP-Longform | |
| - model: Vortex5/LunaMaid-12B | |
| - model: Vortex5/Dreamstar-12B | |
| merge_method: saef | |
| parameters: | |
| paradox: 0.40 | |
| strength: 0.88 | |
| boost: 0.28 | |
| modes: 2 | |
| dtype: bfloat16 | |
| tokenizer: | |
| source: Vortex5/Scarlet-Seraph-12B | |
| </pre> | |
| </details> | |
| </section> | |
| <section class="pane blended"> | |
| <h2 class="pane-title">Intended Use</h2> | |
| <div style="display:flex; gap:12px; margin:10px 0; justify-content:center; flex-wrap:nowrap;"> | |
| <div class="tagbox">📕 Storytelling</div> | |
| <div class="tagbox">🎭 Roleplay</div> | |
| <div class="tagbox">✨ Creative Writing</div> | |
| </div> | |
| </section> | |
| <section class="pane blended"> | |
| <h2 class="pane-title">Credits</h2> | |
| <ul class="credits" style="list-style:none; padding-left:0;"> | |
| <li><strong><a href="https://huggingface.co/mradermacher">Team Mradermacher</a></strong> — Static & imatrix quants</li> | |
| <li><strong><a href="https://huggingface.co/DeathGodlike">DeathGodlike</a></strong> — EXL3 quants</li> | |
| <li><strong><span style="color:#ff9abb;">Original creators and model authors</span></strong></li> | |
| </ul> | |
| </section> | |
| <div class="divider"></div> | |
| </section> | |
| <style> | |
| .shell { | |
| max-width: 1000px; | |
| margin: 40px auto; | |
| padding: 40px 24px; | |
| position: relative; | |
| border-radius: 0; | |
| font-family: "Cinzel","Inter",serif; | |
| background: radial-gradient(circle at 50% 40%, #2b0209 0%, #0a0507 70%); | |
| color: #f3c6d3; | |
| border: 2px solid #6b0015; | |
| box-shadow: | |
| 0 0 0 4px rgba(90, 0, 18, 0.9), | |
| 0 0 18px rgba(140, 0, 30, 0.45), | |
| 0 0 36px rgba(90, 0, 18, 0.35); | |
| } | |
| .title-frame { | |
| width: fit-content; | |
| max-width: 92%; | |
| margin: 0 auto; | |
| } | |
| .title-block.wide { | |
| padding: 10px 28px; | |
| border-radius: 0; | |
| background: linear-gradient( | |
| 135deg, | |
| #2a0008, | |
| #5a0012, | |
| #2a0008 | |
| ); | |
| border: 2px solid #8b001c; | |
| box-shadow: | |
| 0 0 14px rgba(140, 0, 30, 0.55), | |
| inset 0 0 14px rgba(0, 0, 0, 0.75); | |
| text-align: center; | |
| max-width: 100%; | |
| } | |
| .hero-title { | |
| margin: 0; | |
| font-size: clamp(1.9rem, 4vw, 2.6rem); | |
| letter-spacing: 0.12em; | |
| text-transform: uppercase; | |
| font-family: "Cinzel", "Trajan Pro", "Times New Roman", serif; | |
| color: #8b001c; | |
| white-space: nowrap; | |
| overflow: hidden; | |
| text-overflow: ellipsis; | |
| text-shadow: | |
| 0 0 2px rgba(0, 0, 0, 0.9), | |
| 0 0 10px rgba(120, 0, 25, 0.75), | |
| 0 0 22px rgba(80, 0, 15, 0.75); | |
| } | |
| .image-slot.inset img { | |
| display: block; | |
| margin: 26px auto; | |
| max-width: 92%; | |
| border-radius: 14px; | |
| border: 2px solid rgba(255,120,160,0.6); | |
| box-shadow: | |
| 0 0 30px rgba(255,70,130,0.35), | |
| inset 0 0 12px rgba(255,160,190,0.25); | |
| } | |
| .divider { | |
| height: 10px; | |
| margin: 36px auto; | |
| max-width: 900px; | |
| background: | |
| linear-gradient(90deg, transparent, #ff7aa8, #cfd3d8, #ff7aa8, transparent); | |
| box-shadow: | |
| 0 0 20px rgba(255,90,140,0.6), | |
| inset 0 0 6px rgba(255,255,255,0.5); | |
| border-radius: 50px; | |
| } | |
| .pane { | |
| margin: 28px auto; | |
| padding: 26px; | |
| text-align: center; | |
| border-radius: 0; | |
| clip-path: polygon( | |
| 8px 0%, calc(100% - 8px) 0%, | |
| 100% 8px, 100% calc(100% - 8px), | |
| calc(100% - 8px) 100%, 8px 100%, | |
| 0% calc(100% - 8px), 0% 8px | |
| ); | |
| width: 92%; | |
| background: linear-gradient( | |
| 145deg, | |
| rgba(90,10,30,0.88), | |
| rgba(30,5,12,0.92) | |
| ); | |
| border: 2px solid rgba(255,120,160,0.5); | |
| box-shadow: | |
| 0 0 22px rgba(255,70,120,0.25), | |
| inset 0 0 18px rgba(255,150,190,0.18); | |
| font-size: 1.2rem; | |
| } | |
| .pane pre { | |
| text-align: left; | |
| margin-left: auto; | |
| margin-right: auto; | |
| } | |
| .pane-title { | |
| font-size: 2.1rem; | |
| letter-spacing: 0.035em; | |
| padding-bottom: 12px; | |
| color: #ffd4e3; | |
| position: relative; | |
| text-align: center; | |
| width: 100%; | |
| text-shadow: | |
| 0 0 8px rgba(255,120,160,0.7), | |
| 0 0 18px rgba(255,60,120,0.4); | |
| } | |
| .pane-title::after { | |
| content: ""; | |
| position: absolute; | |
| left: 50%; | |
| bottom: 0; | |
| width: 70%; | |
| height: 3px; | |
| transform: translateX(-50%); | |
| background: linear-gradient( | |
| to right, | |
| transparent, | |
| #4d000f, | |
| #8b001c, | |
| #4d000f, | |
| transparent | |
| ); | |
| } | |
| .pane-title { | |
| transition: all 0.25s ease; | |
| } | |
| .pane-title:hover { | |
| color: #ffc1d3; | |
| text-shadow: | |
| 0 0 6px rgba(90,0,10,1), | |
| 0 0 14px rgba(160,0,35,0.95), | |
| 0 0 32px rgba(255,40,90,0.75), | |
| 0 0 52px rgba(255,90,140,0.45); | |
| } | |
| .tagbox { | |
| min-width: 77px; | |
| height: 55px; | |
| padding: 0 17px; | |
| border-radius: 999px; | |
| display: flex; | |
| align-items: center; | |
| justify-content: center; | |
| font-size: 1.06rem; | |
| line-height: 1; | |
| text-align: center; | |
| background: radial-gradient( | |
| circle at 30% 30%, | |
| #5a0012, | |
| #2a0008 70% | |
| ); | |
| border: 2px solid #8b001c; | |
| color: #ffd6df; | |
| box-shadow: | |
| inset 0 0 10px rgba(0,0,0,0.6), | |
| 0 0 10px rgba(140,0,30,0.5); | |
| white-space: nowrap; | |
| } | |
| .shell pre { | |
| background: rgba(8,0,4,0.9); | |
| color: #ffd6e3; | |
| border-left: 3px solid #ff7aa8; | |
| padding: 12px; | |
| overflow-x: auto; | |
| } | |
| .shell a { | |
| color: #ff9abb; | |
| } | |
| .shell a:hover { | |
| color: #ffd4e3; | |
| text-shadow: 0 0 8px rgba(255,140,180,0.9); | |
| } | |
| </style> |