Stagehand sometimes attempts to click on text nodes instead of element nodes

[MrHaikuSwan]

Right now, Stagehand sometimes tries to call Playwright methods on text nodes instead of elements.

If the HTML markup translates clickable elements into StaticText nodes in the accessibility tree shown to the LLM, the LLM will select the StaticText node, which translates to an XPath targeting the text node like so:

/html[1]/body[1]/div[1]/div[1]/text()[1]

When this happens, Playwright operations will fail -- I set up a simple reproduction of this happening here.

[seanmcguire12]

Hey there! Thank you so much for the detailed reproduction code!! I am thinking the best way to address this would be trimming the /text()[1] from the xpath before we pass it into the locator function

[MrHaikuSwan]

No problem! Yep, agreed -- I wrote a very similar function to update the ObserveResult I got back from page.observe before passing it to page.act

[seanmcguire12]

fixed with #826