Papers
arxiv:2610.19025

How Far Can Coding Agents Go in Visual Generation?

Published on Oct 13
· Submitted by
Hengguang Zhou
on Oct 27
Authors:
,
,
,
,
,

Abstract

Coding agents build images via executable programs, showing structured visual reasoning and consistent internal scene representations across drawing interfaces.

Modern image generation largely relies on specialized generative models that leave the process of image construction implicit in learned parameters. We explore an alternative: general-purpose coding agents that construct images through executable programs. Our study of zero-shot drawing on AgentDrawBench, a 200-prompt benchmark, reveals a distinctive capability profile. Agents excel at preserving structure and satisfying precise visual constraints, achieving competitive results in domains where compositional accuracy matters more than photorealistic appearance, while remaining limited in perceptual richness. Their visual expressiveness varies with the drawing interface, and a qualitative study on reconstruction shows how procedural skills extracted from human demonstrations support different artistic media. We then examine code as an external visual language of thought: a structured, executable representation that agents can construct and inspect. We test it in visual question answering task and find reconstructed visual code retains substantial information for question answering and, in some domains, supports higher accuracy than the original image. These abilities raise a further question: do agents draw on a shared internal representation of scene content beyond a particular drawing program? We explore an internal visual language-of-thought hypothesis, in which a shared, compositionally structured representation supports visual operations across drawing languages. Cross-harness drawings and images assembled from independent single-pixel queries exhibit related layouts and tones. Agents also maintain self-generated room arrangements across viewpoints after visible drawings are removed. These results demonstrate that the coding agent would maintain a consistent and coherent world inside its imagine even before the harness gets involved and the generation starts.

Community

Paper submitter

TL;DR: We ask how far a general-purpose coding agent can go at making images with no image model and no assets, only code and primitive drawing tools (pixels, shapes, Canvas 2D, strokes, an oil-brush library, mouse control of a paint program, Blender). Zero-shot, it is strong where structure and exact constraints matter and weaker in perceptual richness, and it can pick up media such as ink or watercolour from written human procedures in context. The code it writes is also a visual representation it can read: images redrawn as SVG answer VQA questions from the code alone, in some domains more accurately than from the image. Finally, the picture seems to exist before any tool does. The same prompt comes out with the same layout across all seven drawing interfaces, a Mona Lisa assembled from 45,056 independent one-pixel sessions is coherent, and the agent keeps a room it furnished consistent across viewpoints after the drawing is taken away. We read this as evidence of an internal visual language of thought that drawing programs only externalise.

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.19025
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.19025 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.19025 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.19025 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.