From Plans to Pixels: Learning to Plan and Orchestrate for Open-Ended Image Editing
Abstract
An experiential framework for long-horizon image editing that couples planning with reward-driven execution to improve coherence and reliability of complex multi-step edits.
Modern image editing models produce realistic results but struggle with abstract, multi step instructions (e.g., ``make this advertisement more vegetarian-friendly''). Prior agent based methods decompose such tasks but rely on handcrafted pipelines or teacher imitation, limiting flexibility and decoupling learning from actual editing outcomes. We propose an experiential framework for long-horizon image editing, where a planner generates structured atomic decompositions and an orchestrator selects tools and regions to execute each step. A vision language judge provides outcome-based rewards for instruction adherence and visual quality. The orchestrator is trained to maximize these rewards, and successful trajectories are used to refine the planner. By tightly coupling planning with reward driven execution, our approach yields more coherent and reliable edits than single-step or rule-based multistep baselines.
Community
Proposes an experiential learning framework for long-horizon, open-ended image editing. Instead of relying on static teacher imitation, the system actively learns optimal tool and region selection through trial and error. It couples a structured task planner with an orchestrator trained via outcome-based rewards from a vision-language judge, leading to highly coherent and reliable multi-step edits.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- CAMEO: A Conditional and Quality-Aware Multi-Agent Image Editing Orchestrator (2026)
- EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement (2026)
- Making Image Editing Easier via Adaptive Task Reformulation with Agentic Executions (2026)
- Leveraging Verifier-Based Reinforcement Learning in Image Editing (2026)
- MIRAGE: Benchmarking and Aligning Multi-Instance Image Editing (2026)
- DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editing (2026)
- EditTransfer++: Toward Faithful and Efficient Visual-Prompt-Guided Image Editing (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2605.15181 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper