Commit Graph

1845 Commits

Author SHA1 Message Date
Shuchang Zheng
dd5c0f2e9d CUA feature - skyvern answers CUA questions and makes decision if being asked to (#2163) 2025-04-16 00:56:50 -07:00
Shuchang Zheng
1386ac4780 null_action means doing nothing and taking a screenshot (#2162) 2025-04-16 00:47:52 -07:00
Suchintan
c829966936 GPT-4.1-support (#2159) 2025-04-16 02:12:33 -04:00
Shuchang Zheng
0d24fe3981 Revert "set task_id in skyvern_context when task block starts" (#2161) 2025-04-15 22:47:52 -07:00
Shuchang Zheng
f6d755da6b CUA feature - support drag action (#2160) 2025-04-15 19:07:37 -07:00
Shuchang Zheng
5c73064638 Let URL be empty string if there is a browser session id (#2158) 2025-04-15 22:34:54 +03:00
Shuchang Zheng
cac9e6a61a CUA feature - extraction data combined assisstant's message (#2157) 2025-04-14 22:54:41 -07:00
Shuchang Zheng
18f24745d0 no need to verify completion when we decide to complete according to CUA response; extract data based on CUA reponse as well (#2156) 2025-04-14 17:24:40 -07:00
Shuchang Zheng
357f25b416 better data extraction goal prompt for task generation (#2155) 2025-04-14 16:30:23 -07:00
Shuchang Zheng
ff80125314 shu/cua other action (#2154) 2025-04-14 13:56:13 -07:00
Suchintan
e233359ad2 Log response text on http post (#2153) 2025-04-14 14:08:14 -04:00
Shuchang Zheng
682a53c8c1 fix auto completion bug (#2152)
Co-authored-by: lawyzheng <lawyzheng1106@gmail.com>
2025-04-15 01:50:11 +08:00
LawyZheng
c8f7f24ee2 remove n8n dependency (#2151) 2025-04-15 01:43:53 +08:00
Shuchang Zheng
9b32a77c59 set task_id in skyvern_context when task block starts (#2114) 2025-04-14 09:41:59 -07:00
Shuchang Zheng
1ed5f22200 Add any information that helps from the last message of CUA when there's no data extraction goal (#2149) 2025-04-13 02:50:07 -07:00
Shuchang Zheng
50dc41c7cc update generate-task prompt (#2148) 2025-04-13 02:40:11 -07:00
Shuchang Zheng
4b76380b39 shu/cua keypress combo (#2147) 2025-04-13 02:36:49 -07:00
Shuchang Zheng
aa9db156bc cua keypress combo (#2146) 2025-04-13 01:40:25 -07:00
Shuchang Zheng
b584dc85b0 cua move action better reasoning (#2145) 2025-04-13 00:34:50 -07:00
Shuchang Zheng
3cbfda57bd add CUA MoveAction (#2144) 2025-04-13 00:22:46 -07:00
Shuchang Zheng
0a6d366f82 add move action in frontend (#2143) 2025-04-13 00:12:01 -07:00
Shuchang Zheng
4a9ecd0cd2 add required action fields for cua fallback actions (#2142) 2025-04-12 23:08:15 -07:00
Shuchang Zheng
db7f1abeab shu/fallback to skyvern actions when cua returns no action (#2141) 2025-04-12 20:55:38 -07:00
Shuchang Zheng
e8efcc0bd7 sdk get_run bug fix (#2139) 2025-04-12 19:17:24 -07:00
Shuchang Zheng
83e8a3c0af remove task v2 api (#2140) 2025-04-12 17:30:50 -07:00
Shuchang Zheng
5f5aaf4298 fix open ai client initialization issue (#2138) 2025-04-12 16:20:25 -07:00
Shuchang Zheng
80cdc1e0e2 Retry url encode fix (#2136) 2025-04-12 15:18:15 -07:00
Shuchang Zheng
6cf39446eb improve task generation data extraction goal (#2137) 2025-04-12 15:17:10 -07:00
Shuchang Zheng
cb46232cff fix url encoding (#2135) 2025-04-12 13:35:43 -07:00
Shuchang Zheng
fe6e26250c new sdk version 0.1.75 (#2134) 2025-04-12 12:04:20 -07:00
Shuchang Zheng
962bf3bc84 add max limit for dom listner (#2132) 2025-04-12 10:55:46 +08:00
Shuchang Zheng
438a49f470 add cua cost to task step (#2131) 2025-04-11 17:25:43 -07:00
Suchintan
92c7862a77 Log stack trace with scrapeinfo (#2128) 2025-04-11 16:28:48 -07:00
Shuchang Zheng
9640e34449 fix run_type for TaskRunResponse (#2130) 2025-04-11 15:46:17 -07:00
Shuchang Zheng
c04aad5295 new sdk v0.1.74 (#2129) 2025-04-11 15:30:01 -07:00
Shuchang Zheng
f883b91180 integration with CUA (#2126) 2025-04-11 11:18:53 -07:00
Shuchang Zheng
2ac65c4a9b Support more action types: keypress, scroll (#2127) 2025-04-11 09:59:26 -07:00
Shuchang Zheng
715fe9809e add phone number format checking (#2125) 2025-04-11 14:20:22 +08:00
Shuchang Zheng
7e81386b63 add shadow host element into interactable detecting list (#2124) 2025-04-11 13:41:40 +08:00
Shuchang Zheng
a0bd4242f7 fix some prompts missing current date (#2122) 2025-04-11 13:29:47 +08:00
Shuchang Zheng
bdee1add43 fix task v2 doc (#2121) 2025-04-09 15:04:07 -07:00
Shuchang Zheng
7d5ab76d73 send workflow_run_id to totp endpoint (#2120) 2025-04-09 13:51:16 -07:00
Shuchang Zheng
e3251edb05 fix pip wheel in dockerfile (#2119) 2025-04-09 13:34:43 -07:00
Shuchang Zheng
03d5383a42 fallback get incremental tree without waiting (#2118) 2025-04-10 02:36:27 +08:00
Shuchang Zheng
c11d0f63eb fix date input bug (#2117) 2025-04-10 02:00:34 +08:00
Shuchang Zheng
5145bc8a1b mark task v2 timed_out (#2113) 2025-04-07 11:54:39 -04:00
Shuchang Zheng
f7ca61c4bd improve option interactable detect (#2111) 2025-04-07 17:04:18 +08:00
Piyush
8d93ded199 added_extension_support_in_browser_context (#2038)
Co-authored-by: Suchintan <suchintan@users.noreply.github.com>
2025-04-06 00:50:30 -04:00
Shuchang Zheng
7e5e684f53 shu/gemini 2.5 pro support (#2109) 2025-04-06 00:03:24 -04:00
Shuchang Zheng
a72fcadd9a only take up to 1 screenshot if the html too big (#2108) 2025-04-05 23:33:34 -04:00