Apple Machine Learning Research6d agoenergy 23
Plan or Retrieve First? A Scale Study of Tool Discovery Architectures
Tool-augmented LLM agents discover relevant APIs from large registries before planning execution, yet finite context windows prohibit injecting all tool definitions into a single prompt. The dominant approach, which we term Retrieve-then-Plan (RtP), embeds the user query and retrieves similar tools via approximate nearest-neighbor search. We study an alternative Plan-then-Retrieve (PtR) paradigm in which the LLM first generates Abstract Tool Stubs (hypothesized function signatures describing needed capabilities) which then serve as retrieval queries against the registry. Evaluating on...
This source publishes only a summary in its feed, so the full article lives at the outlet. The link above and below goes to the original.