How Far Can Coding Agents Go in Visual Generation?
Abstract
Coding agents build images via executable programs, showing structured visual reasoning and consistent internal scene representations across drawing interfaces.
Modern image generation largely relies on specialized generative models that leave the process of image construction implicit in learned parameters. We explore an alternative: general-purpose coding agents that construct images through executable programs. Our study of zero-shot drawing on AgentDrawBench, a 200-prompt benchmark, reveals a distinctive capability profile. Agents excel at preserving structure and satisfying precise visual constraints, achieving competitive results in domains where compositional accuracy matters more than photorealistic appearance, while remaining limited in perceptual richness. Their visual expressiveness varies with the drawing interface, and a qualitative study on reconstruction shows how procedural skills extracted from human demonstrations support different artistic media. We then examine code as an external visual language of thought: a structured, executable representation that agents can construct and inspect. We test it in visual question answering task and find reconstructed visual code retains substantial information for question answering and, in some domains, supports higher accuracy than the original image. These abilities raise a further question: do agents draw on a shared internal representation of scene content beyond a particular drawing program? We explore an internal visual language-of-thought hypothesis, in which a shared, compositionally structured representation supports visual operations across drawing languages. Cross-harness drawings and images assembled from independent single-pixel queries exhibit related layouts and tones. Agents also maintain self-generated room arrangements across viewpoints after visible drawings are removed. These results demonstrate that the coding agent would maintain a consistent and coherent world inside its imagine even before the harness gets involved and the generation starts.
Community
TL;DR: We ask how far a general-purpose coding agent can go at making images with no image model and no assets, only code and primitive drawing tools (pixels, shapes, Canvas 2D, strokes, an oil-brush library, mouse control of a paint program, Blender). Zero-shot, it is strong where structure and exact constraints matter and weaker in perceptual richness, and it can pick up media such as ink or watercolour from written human procedures in context. The code it writes is also a visual representation it can read: images redrawn as SVG answer VQA questions from the code alone, in some domains more accurately than from the image. Finally, the picture seems to exist before any tool does. The same prompt comes out with the same layout across all seven drawing interfaces, a Mona Lisa assembled from 45,056 independent one-pixel sessions is coherent, and the agent keeps a room it furnished consistent across viewpoints after the drawing is taken away. We read this as evidence of an internal visual language of thought that drawing programs only externalise.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- PPTBench: Can Coding Agents Reconstruct the Visual World through Structured, Editable Slides (2026)
- BlenderWorld: Benchmarking Visual Agents for 3D Creation from Real-World References (2026)
- AesCode: Aesthetic Code Generation with Decoupled Cross-Modal Rewards (2026)
- GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models (2026)
- MaLiang-Harness: A Programmable Path to Image and Video Generation (2026)
- BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blender (2026)
- RefCraft: Benchmarking Visual-Reference-Conditioned Agentic Generation through Web Development (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.19025 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper