Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QUESTION] Can Android World swipe? #186

Open
LYXFOREVER opened this issue Nov 21, 2024 · 2 comments
Open

[QUESTION] Can Android World swipe? #186

LYXFOREVER opened this issue Nov 21, 2024 · 2 comments

Comments

@LYXFOREVER
Copy link

In t3a.py , function step(self, goal: str), I found this code:

if converted_action.action_type in ['click', 'long-press', 'input-text']:

It seems that android world can only click, long-press or input-text. It seems not to be able to swipe? What should it do if it meets some tasks that need swiping?

@crawles
Copy link
Collaborator

crawles commented Nov 22, 2024

Hi, yes, swipe is supported. The T3A agent can issue a scroll action. A scroll action is simply the inverse of a swipe. E.g., tin order to scroll down, the agent "swipes" up. Here is the code: https://github.com/google-research/android_world/blob/main/android_world/env/actuation.py#L101

@LYXFOREVER
Copy link
Author

Hi, yes, swipe is supported. The T3A agent can issue a scroll action. A scroll action is simply the inverse of a swipe. E.g., tin order to scroll down, the agent "swipes" up. Here is the code: https://github.com/google-research/android_world/blob/main/android_world/env/actuation.py#L101

Thank you! I will read the code more carefully.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants