Distilling insights with ReasoningBank
ReasoningBank distills international reasoning patterns into high-level, structured recollections. Every structured reminiscence merchandise comprises the next:
- Title: A concise identifier summarizing the core technique.
- Description: A quick abstract of the reminiscence merchandise.
- Content material: The distilled reasoning steps, choice rationales, or operational insights extracted from previous experiences.
The reminiscence workflow operates in a steady, closed loop of retrieval, extraction, and consolidation. Earlier than taking motion, the agent attracts upon the ReasoningBank to collect related recollections into its context. It then interacts with the atmosphere and makes use of an LLM-as-a-judge to self-assess the ensuing trajectory and extracts success insights or failure reflection. Notably, this self-judgement doesn’t have to be completely correct, as we discover ReasoningBank to be fairly strong in opposition to judgment noise. Throughout extraction, the agent distills workflows and generalizable insights from the trajectory into new recollections. For simplicity, we straight append these to the ReasoningBank, leaving extra refined consolidation methods for future work.
Crucially, in contrast to present workflow reminiscence methods that solely concentrate on profitable runs, ReasoningBank actively analyzes failed experiences to supply counterfactual indicators and pitfalls. By distilling these errors into preventative classes, ReasoningBank builds highly effective strategic guardrails. For instance, as a substitute of merely studying a procedural rule like “click on the ‘Load Extra’ button”, the agent may be taught from a previous failure to “all the time confirm the present web page identifier first to keep away from infinite scroll traps earlier than trying to load extra outcomes”.
