How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="hyunseoki/memrag-basefull")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("hyunseoki/memrag-basefull")
model = AutoModelForMultimodalLM.from_pretrained("hyunseoki/memrag-basefull", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
Quick Links

memrag-basefull โ€” Trajectory-Memory RAG (GUI agent)

Cold-start SFT from Qwen3.5-4B for GUI next-action prediction. This checkpoint = the full visual trajectory history (baseline) arm of a 3-arm A/B.

Action accuracy (n=498 test, AgentNetBench score_pair): 0.470

Status: v1, single-seed (positive; 3-seed confirmation pending). See the collection for the other arms.

Load

from transformers import AutoProcessor
from qwen_cua.modeling_qwen35_vl_latent import Qwen35VLLatentForConditionalGeneration as M
proc  = AutoProcessor.from_pretrained("hyunseoki/memrag-basefull", max_pixels=1_000_000)
model = M.from_pretrained("hyunseoki/memrag-basefull", torch_dtype="bfloat16", attn_implementation="flash_attention_2")

Plain Qwen3.5-VL arch (wm.enabled=false) โ€” also loadable with the standard class.

Downloads last month
12
Safetensors
Model size
5B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for hyunseoki/memrag-basefull

Finetuned
Qwen/Qwen3.5-4B
Finetuned
(1,426)
this model

Collection including hyunseoki/memrag-basefull