Skip to content

Code produced by LLMs doesn't get executed properly (empty code and output) #9

Open
@luijait

Description

@luijait

Observing the following issue:

Image

execute_code is a difficult formatting tool for LLMs which leads even the most advanced models to fail when the context window exceeds 30%, there are 2 solutions, delete the tool from a certain context or the best one

As a way to address this issue, we can consider removing the execute_code tool and implement CodeAgent as a tool as proposed by openai-agents-python.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions