Integrating ToolDec in Autogen

[akashicMarga]

Adding ToolDec in auto gpt code execution will be really helpful for making api calls and other commands which are critical and needs to follow certain structure. As Per the ToolDec paper (Syntax Error-Free and Generalizable Tool Use for LLMs via Finite-State Decoding)

" We evaluated multiple prior methods and their ToolDec-enhanced versions on a variety of tasks involving tools like math functions, knowledge graph relations, and complex real-world RESTful APIs. Our experiments show that ToolDec reduces syntactic errors to zero, consequently achieving significantly better performance and as much as a 2x speedup. We also show that ToolDec achieves superior generalization performance on unseen tools, performing up to 8x better than the baselines"

https://arxiv.org/abs/2310.07075