PreSTO: Predictive Subtree Prefetching for Fast LLM Power Sampling
Paper • 2610.13171 • Published • 14
None defined yet.
PreSTO: Predictive Subtree Prefetching for Fast LLM Power Sampling
Explore Broadly, Reason Sharply: Push Small Models toward the Frontier via Sampling