Commit Graph

424 Commits

Author SHA1 Message Date
Shuchang Zheng
e1feb6cb45 capitalize the text for key press and hold key actions (#2263) 2025-04-30 16:11:33 -07:00
Shuchang Zheng
5a3691e0dc action handlers back - SOLVE_CAPTCHA, CLICK, INPUT_TEXT (#2258) 2025-04-30 03:49:07 -07:00
Shuchang Zheng
1a33810f09 support more anthropic actions (#2257) 2025-04-30 03:42:44 -07:00
Shuchang Zheng
8f466b3108 CUA action parser - generate_cua_fallback_actions helper (#2256) 2025-04-30 03:25:38 -07:00
Shuchang Zheng
eacf9d5388 resize screenshots to make it compatible with anthropic CUA (#2255) 2025-04-30 01:13:36 -07:00
Shuchang Zheng
0eff92632c bugfix (#2254) 2025-04-30 13:27:30 +08:00
Shuchang Zheng
b1fcfdd8bf support only selectable input element (#2250) 2025-04-30 02:55:32 +08:00
Shuchang Zheng
53f4c23ef9 fix bug (#2249) 2025-04-30 00:06:59 +08:00
Shuchang Zheng
f4ea546ae4 fix anthropic tool result format (#2246) 2025-04-29 04:17:50 +08:00
Shuchang Zheng
7e4a193443 fix tool_call_input parsing with anthropic sdk (#2242) 2025-04-29 02:57:56 +08:00
Shuchang Zheng
1530338cad Anthropic CUA fix (#2238) 2025-04-28 18:15:23 +08:00
Shuchang Zheng
d798b00409 bugfix (#2237) 2025-04-28 16:34:25 +08:00
Shuchang Zheng
a8d237deee use anthropic beta client (#2235) 2025-04-28 16:24:12 +08:00
Shuchang Zheng
2f0e6e5eb3 improve custom selection (#2236) 2025-04-28 16:16:36 +08:00
Shuchang Zheng
a3d9917386 do not close the tab when download is not triggered (#2234) 2025-04-28 14:59:31 +08:00
Shuchang Zheng
8b184ce970 increase download max wait time and change logs (#2232) 2025-04-28 14:37:41 +08:00
Shuchang Zheng
0a0228b341 anthropic CUA (#2231)
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-04-28 09:49:44 +08:00
Shuchang Zheng
5582998490 fix interactable parsing (#2228) 2025-04-24 16:30:41 +08:00
Shuchang Zheng
19e86a197a fix phone number format issue (#2217) 2025-04-23 01:56:43 +08:00
Shuchang Zheng
654ba03e09 optimize and speed up custom selection (#2215) 2025-04-23 01:44:14 +08:00
Shuchang Zheng
de67f69252 handle null tagname (#2212) 2025-04-22 18:48:01 +08:00
Shuchang Zheng
c69e5848ed add more scrape page methods (#2211) 2025-04-22 16:37:39 +08:00
Shuchang Zheng
f2eef5aa6d support shadow dom mutation observer (#2206)
Co-authored-by: lawyzheng <lawyzheng1106@gmail.com>
2025-04-21 22:36:56 +08:00
Shuchang Zheng
f238c991f7 fix custom selection bug (#2201) 2025-04-21 12:44:48 +08:00
Shuchang Zheng
9038e6e047 support workflow_run_id in totp code (#2199) 2025-04-21 08:24:29 +08:00
Shuchang Zheng
63af3d984c terminate action when CUA verification code is not received (#2196) 2025-04-20 06:35:21 +08:00
Piyush
cebb04c736 Feature/self hosted proxy support (#2115) 2025-04-18 23:24:42 -04:00
Shuchang Zheng
9d286a059d extend auto completion coverage (#2184) 2025-04-18 19:19:35 +08:00
Shuchang Zheng
356046afb8 fix input handler bug (#2180) 2025-04-17 18:16:26 +08:00
Shuchang Zheng
e7b46c62a9 fix CUA nullaction bug (#2179) 2025-04-17 01:24:49 -07:00
Shuchang Zheng
83adc226d9 extend custom select part 2 (#2178) 2025-04-17 14:07:36 +08:00
Shuchang Zheng
e3541d8167 add log for fallback action repsonse for CUA (#2176) 2025-04-16 19:39:23 -07:00
Shuchang Zheng
a9c8a1d889 CUA feature - verification code / 2FA (#2174) 2025-04-16 17:11:01 -07:00
Shuchang Zheng
a8b8dfee5b extend custom select (#2167) 2025-04-17 01:52:21 +08:00
Shuchang Zheng
dd5c0f2e9d CUA feature - skyvern answers CUA questions and makes decision if being asked to (#2163) 2025-04-16 00:56:50 -07:00
Shuchang Zheng
f6d755da6b CUA feature - support drag action (#2160) 2025-04-15 19:07:37 -07:00
Shuchang Zheng
cac9e6a61a CUA feature - extraction data combined assisstant's message (#2157) 2025-04-14 22:54:41 -07:00
Shuchang Zheng
18f24745d0 no need to verify completion when we decide to complete according to CUA response; extract data based on CUA reponse as well (#2156) 2025-04-14 17:24:40 -07:00
Shuchang Zheng
ff80125314 shu/cua other action (#2154) 2025-04-14 13:56:13 -07:00
Shuchang Zheng
682a53c8c1 fix auto completion bug (#2152)
Co-authored-by: lawyzheng <lawyzheng1106@gmail.com>
2025-04-15 01:50:11 +08:00
Shuchang Zheng
1ed5f22200 Add any information that helps from the last message of CUA when there's no data extraction goal (#2149) 2025-04-13 02:50:07 -07:00
Shuchang Zheng
aa9db156bc cua keypress combo (#2146) 2025-04-13 01:40:25 -07:00
Shuchang Zheng
b584dc85b0 cua move action better reasoning (#2145) 2025-04-13 00:34:50 -07:00
Shuchang Zheng
3cbfda57bd add CUA MoveAction (#2144) 2025-04-13 00:22:46 -07:00
Shuchang Zheng
4a9ecd0cd2 add required action fields for cua fallback actions (#2142) 2025-04-12 23:08:15 -07:00
Shuchang Zheng
db7f1abeab shu/fallback to skyvern actions when cua returns no action (#2141) 2025-04-12 20:55:38 -07:00
Shuchang Zheng
962bf3bc84 add max limit for dom listner (#2132) 2025-04-12 10:55:46 +08:00
Shuchang Zheng
438a49f470 add cua cost to task step (#2131) 2025-04-11 17:25:43 -07:00
Shuchang Zheng
f883b91180 integration with CUA (#2126) 2025-04-11 11:18:53 -07:00
Shuchang Zheng
715fe9809e add phone number format checking (#2125) 2025-04-11 14:20:22 +08:00