FlowReasoner is a new system that builds a custom set of small AI agents for every user question. Unlike search based methods it uses reasoning driven optimization with external execution feedback.
โ First, it distills reasoning data using DeepSeek R1-671B to build multi agent systems. ๐ค โ Then, reasoning data used for DeepSeek-R1-Distill-Qwen-7B via supervised fine tuning for basic reasoning skills. ๐ก โ Finally, RL with GRPO (optimizes by comparing response groups from queries/tasks) to improve reasoning.