Efficient Multi-Model LoRA Training on Apple Silicon: Parallel Fine-Tuning of Seven 7B Specialists on a Single Workstation โ€” Hayula Research

Hayula AI Lab

Abstract

We present a methodology for parallel LoRA fine-tuning of multiple large language models on a single Apple M2 Ultra workstation with 192GB unified memory. Using the Saif cybersecurity suiteโ€”eight 7-billion parameter specialist models (Router, Reverse Engineering, Vulnerability Discovery, Exploit Chain Development, Kernel Security, Browser Security, Web Application Security, and Network Security)โ€”we demonstrate that simultaneous training of up to six LoRA adapters is not only feasible but signifi

Files

File Description
paper.md Full paper (Markdown)
README.md This model card

Citation

@techreport{hayulalab2026efficientmultimodeltraining,
    title={Efficient Multi-Model LoRA Training on Apple Silicon: Parallel Fine-Tuning of Seven 7B Specialists on a Single Workstation โ€” Hayula Research},
    author={Hayula AI Lab},
    year={2026},
    url={https://huggingface.co/hayulalab/efficient-multi-model-training-paper}
}

hayulalab โ€” Open Source AI Research

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support