Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nested iframe elements cannot be detected #106

Open
shawncx opened this issue Apr 1, 2025 · 3 comments
Open

Nested iframe elements cannot be detected #106

shawncx opened this issue Apr 1, 2025 · 3 comments

Comments

@shawncx
Copy link

shawncx commented Apr 1, 2025

test-htmls.zip

Here's a simple repro. iframe2 is nested in iframe1. I can fill iframe1 input easily. But iframe2 input cannot be detected by mcp

Image

@JunJD
Copy link

JunJD commented Apr 2, 2025

我也遇到了相同的问题

@Skn0tt
Copy link
Member

Skn0tt commented Apr 2, 2025

On v0.0.9, it's seeing the iframes just fine. Please check if you're also having this problem on v0.0.9 - we improved something around iframes in that release. Here's the response it's giving to the LLM in my test with your repro:


- text: "Content goes here. name-out:"
- textbox "name-out:" [ref=s1e4]
- iframe [ref=s1e5]:
    - text: "iframe Content goes here. iframe-1:"
    - textbox "iframe-1:" [ref=f1s1e4]
    - iframe [ref=f1s1e5]:
        - text: "iframe-2 Content goes here. iframe-2:"
        - textbox "iframe-2:" [ref=f2s1e4]

@shawncx
Copy link
Author

shawncx commented Apr 4, 2025

Confirm it is solved in 0.0.9. Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants