Instructions to use FrontisAI/Frontis-MA1-35B-SFT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FrontisAI/Frontis-MA1-35B-SFT with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="FrontisAI/Frontis-MA1-35B-SFT") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("FrontisAI/Frontis-MA1-35B-SFT") model = AutoModelForMultimodalLM.from_pretrained("FrontisAI/Frontis-MA1-35B-SFT", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use FrontisAI/Frontis-MA1-35B-SFT with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "FrontisAI/Frontis-MA1-35B-SFT" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FrontisAI/Frontis-MA1-35B-SFT", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/FrontisAI/Frontis-MA1-35B-SFT
- SGLang
How to use FrontisAI/Frontis-MA1-35B-SFT with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "FrontisAI/Frontis-MA1-35B-SFT" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FrontisAI/Frontis-MA1-35B-SFT", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "FrontisAI/Frontis-MA1-35B-SFT" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "FrontisAI/Frontis-MA1-35B-SFT", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use FrontisAI/Frontis-MA1-35B-SFT with Docker Model Runner:
docker model run hf.co/FrontisAI/Frontis-MA1-35B-SFT
Frontis-MA1-35B-SFT
This is the supervised fine-tuning checkpoint of the Frontis-MA1 family, before OpenMLE reinforcement learning. It is intended for research on machine learning engineering and program transformation.
| Field | Value |
|---|---|
| Base model | Qwen/Qwen3.6-35B-A3B |
| Training stage | Full-parameter supervised fine-tuning |
| Saved checkpoint | iteration 569 (zero-based boundary; configured 570 updates) |
| Training data | Dataset06 useful mixed top4, excluding RL460 task overlaps; 24,350 rows |
| Epochs / global batch | 3 / 128 |
| Learning rate | 3e-5 |
| Precision | BF16 |
| Release location | FrontisAI/Frontis-MA1-35B-SFT, default revision main |
The actual 24,350-row training input is distinct from the 26,259-example public SFT trace collection. Dataset cutoff configuration was 32,768 tokens; this does not establish validated long-context inference performance. No standalone SFT benchmark claim is made by this release. The separately released RL model is FrontisAI/Frontis-MA1-35B.
Loading
from transformers import AutoTokenizer, AutoModelForImageTextToText
repo = "FrontisAI/Frontis-MA1-35B-SFT"
tokenizer = AutoTokenizer.from_pretrained(repo, revision="main")
model = AutoModelForImageTextToText.from_pretrained(
repo, revision="main", dtype="bfloat16", device_map="auto"
)
Pin the published commit SHA for reproducibility. This model requires substantial memory; use the dependency versions recorded in the release validation receipt.
Release boundary
This repository revision distributes inference weights and tokenizer/configuration assets. The original SFT save omitted optimizer and RNG state, so it is not a complete training-resume package. Conversion uses the archived SLIME source at commit 017e368a14ae94732396213f52c0803ca7883698, with the release-specific patch recorded in the manifest.
License and limitations
Original Frontis-MA1 material follows the existing repository's CC BY-NC 4.0 license. Preserve the upstream Apache 2.0 license and notices. Outputs may contain incorrect or unsafe code and require execution checks in an appropriate sandbox. Loading and generation smoke checks do not substitute for benchmark evaluation.
The vision encoder (333 tensors) and MTP components (19 tensors) are inherited unchanged from the Qwen3.6-35B-A3B base model. OpenMLE SFT and this release smoke validate text/code behavior; no new vision or MTP performance claim is made.
- Downloads last month
- -
Model tree for FrontisAI/Frontis-MA1-35B-SFT
Base model
Qwen/Qwen3.6-35B-A3B