Commit Graph

397 Commits

Author SHA1 Message Date
Shuchang Zheng
9d286a059d extend auto completion coverage (#2184) 2025-04-18 19:19:35 +08:00
Shuchang Zheng
356046afb8 fix input handler bug (#2180) 2025-04-17 18:16:26 +08:00
Shuchang Zheng
e7b46c62a9 fix CUA nullaction bug (#2179) 2025-04-17 01:24:49 -07:00
Shuchang Zheng
83adc226d9 extend custom select part 2 (#2178) 2025-04-17 14:07:36 +08:00
Shuchang Zheng
e3541d8167 add log for fallback action repsonse for CUA (#2176) 2025-04-16 19:39:23 -07:00
Shuchang Zheng
a9c8a1d889 CUA feature - verification code / 2FA (#2174) 2025-04-16 17:11:01 -07:00
Shuchang Zheng
a8b8dfee5b extend custom select (#2167) 2025-04-17 01:52:21 +08:00
Shuchang Zheng
dd5c0f2e9d CUA feature - skyvern answers CUA questions and makes decision if being asked to (#2163) 2025-04-16 00:56:50 -07:00
Shuchang Zheng
f6d755da6b CUA feature - support drag action (#2160) 2025-04-15 19:07:37 -07:00
Shuchang Zheng
cac9e6a61a CUA feature - extraction data combined assisstant's message (#2157) 2025-04-14 22:54:41 -07:00
Shuchang Zheng
18f24745d0 no need to verify completion when we decide to complete according to CUA response; extract data based on CUA reponse as well (#2156) 2025-04-14 17:24:40 -07:00
Shuchang Zheng
ff80125314 shu/cua other action (#2154) 2025-04-14 13:56:13 -07:00
Shuchang Zheng
682a53c8c1 fix auto completion bug (#2152)
Co-authored-by: lawyzheng <lawyzheng1106@gmail.com>
2025-04-15 01:50:11 +08:00
Shuchang Zheng
1ed5f22200 Add any information that helps from the last message of CUA when there's no data extraction goal (#2149) 2025-04-13 02:50:07 -07:00
Shuchang Zheng
aa9db156bc cua keypress combo (#2146) 2025-04-13 01:40:25 -07:00
Shuchang Zheng
b584dc85b0 cua move action better reasoning (#2145) 2025-04-13 00:34:50 -07:00
Shuchang Zheng
3cbfda57bd add CUA MoveAction (#2144) 2025-04-13 00:22:46 -07:00
Shuchang Zheng
4a9ecd0cd2 add required action fields for cua fallback actions (#2142) 2025-04-12 23:08:15 -07:00
Shuchang Zheng
db7f1abeab shu/fallback to skyvern actions when cua returns no action (#2141) 2025-04-12 20:55:38 -07:00
Shuchang Zheng
962bf3bc84 add max limit for dom listner (#2132) 2025-04-12 10:55:46 +08:00
Shuchang Zheng
438a49f470 add cua cost to task step (#2131) 2025-04-11 17:25:43 -07:00
Shuchang Zheng
f883b91180 integration with CUA (#2126) 2025-04-11 11:18:53 -07:00
Shuchang Zheng
715fe9809e add phone number format checking (#2125) 2025-04-11 14:20:22 +08:00
Shuchang Zheng
7e81386b63 add shadow host element into interactable detecting list (#2124) 2025-04-11 13:41:40 +08:00
Shuchang Zheng
a0bd4242f7 fix some prompts missing current date (#2122) 2025-04-11 13:29:47 +08:00
Shuchang Zheng
7d5ab76d73 send workflow_run_id to totp endpoint (#2120) 2025-04-09 13:51:16 -07:00
Shuchang Zheng
03d5383a42 fallback get incremental tree without waiting (#2118) 2025-04-10 02:36:27 +08:00
Shuchang Zheng
c11d0f63eb fix date input bug (#2117) 2025-04-10 02:00:34 +08:00
Shuchang Zheng
f7ca61c4bd improve option interactable detect (#2111) 2025-04-07 17:04:18 +08:00
Piyush
8d93ded199 added_extension_support_in_browser_context (#2038)
Co-authored-by: Suchintan <suchintan@users.noreply.github.com>
2025-04-06 00:50:30 -04:00
Shuchang Zheng
a72fcadd9a only take up to 1 screenshot if the html too big (#2108) 2025-04-05 23:33:34 -04:00
Shuchang Zheng
3c612968ce trim svg elements when prompt exceeds context window (#2106) 2025-04-04 22:33:52 -04:00
Shuchang Zheng
b9c7a4ac98 handle 'Exception: Can't Skyvern element rect' error (#2104) 2025-04-04 12:29:38 -04:00
Shuchang Zheng
be621d3b46 scroll the element into view when the blocking element is not interac… (#2093) 2025-04-03 12:55:46 -04:00
Suchintan
ff57f9977c Update docs plus init (#2073)
Co-authored-by: Shuchang Zheng <wintonzheng0325@gmail.com>
2025-04-03 00:46:57 -04:00
Shuchang Zheng
d4de0fe1a6 add classname invisible to dropdown detection (#2069) 2025-04-02 11:36:06 -04:00
Shuchang Zheng
3fc6e2532f shu/fix cdp connect with browser path (#2057) 2025-04-01 01:19:14 -04:00
Shuchang Zheng
83ad2adabd Rename old router to legacy_base_router (#2048)
Co-authored-by: Suchintan Singh <suchintansingh@gmail.com>
2025-03-31 02:57:54 -04:00
Shuchang Zheng
d54c2af544 use the BROWSER_REMOTE_DEBUGGING_URL for cdp connect directly (#2040) 2025-03-30 20:36:55 -04:00
Shuchang Zheng
e601a87298 update window.scroll/scrollTo syntax (#2032) 2025-03-27 01:11:19 -07:00
Shuchang Zheng
6c7e96d93e Handle createPolicy gracefully (#2031) 2025-03-27 01:03:25 -07:00
Shuchang Zheng
0ed236f092 safeScrollToTop (#2030) 2025-03-27 00:47:01 -07:00
Shuchang Zheng
e122821878 add safeWindowScroll function in js (#2029) 2025-03-27 00:44:49 -07:00
Shuchang Zheng
62591eff85 check null for document.body and document.documentElement inside function isWindowScrollable (#2028) 2025-03-27 00:26:41 -07:00
Shuchang Zheng
1532709224 improve date picker selection (#2018) 2025-03-25 18:00:15 +08:00
Shuchang Zheng
915bcfbf13 rename js sleep to asyncSleepFor (#2016) 2025-03-25 17:28:31 +08:00
Shuchang Zheng
19c7c56af7 migrate ProxyLocation to skyvern.schemas.runs (#2011) 2025-03-24 15:15:21 -07:00
Shuchang Zheng
ee8e1a2d44 improve navigation error handle (#2008) 2025-03-25 00:20:28 +08:00
Shuchang Zheng
fc32f917f8 support new browser type: cdp connect (#1875) 2025-03-23 17:05:38 -07:00
Shuchang Zheng
25837c7fe2 fix get_or_create_page by ensuring the page is returned (#1830) 2025-03-23 16:51:10 -07:00