optimize multiple select (#1703)

This commit is contained in:
Shuchang Zheng
2025-02-03 19:19:39 +08:00
committed by GitHub
parent 36de8bde99
commit b4f2ec945c
4 changed files with 46 additions and 17 deletions

View File

@@ -1,13 +1,22 @@
Confirm if the user has finished the multi-level selection based on the screenshot, user details, the HTML elements and select history provided in the list.
Confirm if the user has finished the mini goal in the current opened dropdown selection based on the screenshot, user details, the HTML elements and select history provided in the list.
NOTE:
- Only consider the mini goal is achieved when there is(are) one(several) valid options selected in the dropdown.
- Sometimes it's a multi-level selection dropdown, you need to select multiple times to pick a valid option(sub-option).
Reply in JSON format with the following keys:
{
"page_info": str, // Think step by step. Describe the page information you parsed from the HTML elements. Your action should be based on the current page information.
"think": str, // Think step by step. Describe how you think the user has finished the multi-level selection.
"confidence_float": float, // The confidence of the action. Pick a number between 0.0 and 1.0. 0.0 means no confidence, 1.0 means full confidence
"is_finished": bool, // True if the user has finished the multi-level selection, False otherwise.
"page_info": str, // Think step by step. Describe the page information you parsed from the HTML elements and the screenshot. Your decision should be based on the current page information.
"think": str, // Think step by step. Describe how you think the user has finished the mini goal in the current opened dropdown selection.
"is_multiple_selection": bool, // True if it's a multi-level selection, otheriwse False.
"is_mini_goal_finished": bool, // True if the user has finished the mini goal in the current opened dropdown selection, False otherwise.
}
Mini Goal:
```
Select an option for "{{ mini_goal }}"
```
User goal:
```
{{ navigation_goal }}