Add complete action verification (#845)
This commit is contained in:
29
skyvern/forge/prompts/skyvern/check-user-goal.j2
Normal file
29
skyvern/forge/prompts/skyvern/check-user-goal.j2
Normal file
@@ -0,0 +1,29 @@
|
||||
Based on the content of the screenshot and the elements on the page, determine whether the user goal has been successfully completed or not.
|
||||
|
||||
The JSON object should be in this format:
|
||||
```json
|
||||
{
|
||||
"reasoning": str, // Describe the state of the user goal and explain why it has been completed or not completed.
|
||||
"user_goal_achieved": bool // True if the user goal has been completed, False otherwise.
|
||||
}
|
||||
|
||||
Make sure to ONLY return the JSON object, with no additional text before or after it. Do not make any assumptions based on the screenshot, return a response solely based on what you observe in the screenshot and nothing else.
|
||||
|
||||
Examples:
|
||||
{
|
||||
"reasoning": "The screenshot shows a success message for a file upload field. Since the user's goal is to upload a file, it has been successfully completed.",
|
||||
"user_goal_achieved": true
|
||||
}
|
||||
{
|
||||
"reasoning": "The screenshot shows a job application form with fields. Since the user's goal is to submit a job application, it has not been successfully completed.",
|
||||
"user_goal_achieved": false
|
||||
}
|
||||
|
||||
Elements on the page:
|
||||
{{ elements }}
|
||||
|
||||
User Goal:
|
||||
{{ navigation_goal }}
|
||||
|
||||
User Details:
|
||||
{{ navigation_payload }}
|
||||
Reference in New Issue
Block a user