Commit Graph

194 Commits

Author SHA1 Message Date
Shuchang Zheng
356046afb8 fix input handler bug (#2180) 2025-04-17 18:16:26 +08:00
Shuchang Zheng
e7b46c62a9 fix CUA nullaction bug (#2179) 2025-04-17 01:24:49 -07:00
Shuchang Zheng
e3541d8167 add log for fallback action repsonse for CUA (#2176) 2025-04-16 19:39:23 -07:00
Shuchang Zheng
a9c8a1d889 CUA feature - verification code / 2FA (#2174) 2025-04-16 17:11:01 -07:00
Shuchang Zheng
dd5c0f2e9d CUA feature - skyvern answers CUA questions and makes decision if being asked to (#2163) 2025-04-16 00:56:50 -07:00
Shuchang Zheng
f6d755da6b CUA feature - support drag action (#2160) 2025-04-15 19:07:37 -07:00
Shuchang Zheng
cac9e6a61a CUA feature - extraction data combined assisstant's message (#2157) 2025-04-14 22:54:41 -07:00
Shuchang Zheng
18f24745d0 no need to verify completion when we decide to complete according to CUA response; extract data based on CUA reponse as well (#2156) 2025-04-14 17:24:40 -07:00
Shuchang Zheng
ff80125314 shu/cua other action (#2154) 2025-04-14 13:56:13 -07:00
Shuchang Zheng
1ed5f22200 Add any information that helps from the last message of CUA when there's no data extraction goal (#2149) 2025-04-13 02:50:07 -07:00
Shuchang Zheng
aa9db156bc cua keypress combo (#2146) 2025-04-13 01:40:25 -07:00
Shuchang Zheng
b584dc85b0 cua move action better reasoning (#2145) 2025-04-13 00:34:50 -07:00
Shuchang Zheng
3cbfda57bd add CUA MoveAction (#2144) 2025-04-13 00:22:46 -07:00
Shuchang Zheng
4a9ecd0cd2 add required action fields for cua fallback actions (#2142) 2025-04-12 23:08:15 -07:00
Shuchang Zheng
db7f1abeab shu/fallback to skyvern actions when cua returns no action (#2141) 2025-04-12 20:55:38 -07:00
Shuchang Zheng
438a49f470 add cua cost to task step (#2131) 2025-04-11 17:25:43 -07:00
Shuchang Zheng
f883b91180 integration with CUA (#2126) 2025-04-11 11:18:53 -07:00
Shuchang Zheng
715fe9809e add phone number format checking (#2125) 2025-04-11 14:20:22 +08:00
Shuchang Zheng
a0bd4242f7 fix some prompts missing current date (#2122) 2025-04-11 13:29:47 +08:00
Shuchang Zheng
7d5ab76d73 send workflow_run_id to totp endpoint (#2120) 2025-04-09 13:51:16 -07:00
Shuchang Zheng
c11d0f63eb fix date input bug (#2117) 2025-04-10 02:00:34 +08:00
Shuchang Zheng
a72fcadd9a only take up to 1 screenshot if the html too big (#2108) 2025-04-05 23:33:34 -04:00
Shuchang Zheng
be621d3b46 scroll the element into view when the blocking element is not interac… (#2093) 2025-04-03 12:55:46 -04:00
Shuchang Zheng
1532709224 improve date picker selection (#2018) 2025-03-25 18:00:15 +08:00
Shuchang Zheng
6cc595d04c add angualar date picker support (#1955)
Co-authored-by: lawyzheng <lawyzheng1106@gmail.com>
2025-03-18 03:12:16 +08:00
Shuchang Zheng
46eaa3545d add action history even when empty (#1939) 2025-03-14 10:15:42 -07:00
Shuchang Zheng
a572126d61 improve dropdown detect (#1927) 2025-03-12 03:33:09 +08:00
Shuchang Zheng
69d9003735 improve custom selection exit logic (#1919) 2025-03-11 23:09:21 +08:00
Shuchang Zheng
eb4314591e fix ScrapedResult schema (#1898) 2025-03-06 12:18:42 -08:00
Shuchang Zheng
394d4cf64b do not raise error when agent hallucinate the download (#1872) 2025-03-04 03:39:15 +08:00
Shuchang Zheng
5e49685c76 refactor unique id generation (#1781) 2025-02-18 08:58:23 +08:00
Shuchang Zheng
1759f06f65 trigger TerminateAction when totp code is not found (#1768) 2025-02-14 01:50:38 +08:00
Shuchang Zheng
b411af56a6 fix custom selection issue (#1766) 2025-02-13 21:11:14 +08:00
Shuchang Zheng
866a16ec99 When replaying cached actions, ignore input_text action with empty text (#1763) 2025-02-12 20:09:32 +08:00
Shuchang Zheng
f16367bf96 fix terminate action in caching - do not replay terminate + introduce SINGLE_CLICK_AGENT_LLM_API_HANDLER (#1760) 2025-02-12 17:10:24 +08:00
Shuchang Zheng
9cb2a7dbaf no need to complete verify for cached action anymore (#1756) 2025-02-11 15:55:41 +08:00
Shuchang Zheng
defd761e58 add functionality to cache task_run (#1755) 2025-02-11 14:47:41 +08:00
Shuchang Zheng
cc449dc9de skip press esc when no dropdown shown (#1728) 2025-02-06 01:23:34 +08:00
Shuchang Zheng
430c6b7851 add select agent llm handler (#1713) 2025-02-04 19:16:39 +08:00
Shuchang Zheng
b43f1bfec2 wait files fully downloaded before complete task (#1707) 2025-02-03 23:49:46 +08:00
Shuchang Zheng
b4f2ec945c optimize multiple select (#1703) 2025-02-03 19:19:39 +08:00
Shuchang Zheng
204972e225 Add step / task / workflow run / observer metrics as logs (#1698)
Co-authored-by: Suchintan <suchintan@users.noreply.github.com>
2025-02-01 14:10:38 -05:00
Shuchang Zheng
0fa11a484b improve selection dom listener performance (#1667) 2025-01-28 21:14:31 +08:00
Shuchang Zheng
b62a6fec23 ExtractAction (#1632) 2025-01-24 16:21:26 +08:00
Shuchang Zheng
b42a1900e2 optimize downalod waiting time logic (#1626) 2025-01-23 22:04:32 +08:00
Shuchang Zheng
ed4d0c59e7 speed up extraction (#1617) 2025-01-22 22:43:50 +08:00
Shuchang Zheng
74d9c65e54 add reload action validate (#1598) 2025-01-20 11:56:09 +08:00
Shuchang Zheng
39bb4558bf introduce a way to reload the page (#1597) 2025-01-20 11:24:39 +08:00
Shuchang Zheng
0392763998 add webhook support for observer (#1546) 2025-01-14 08:59:53 -08:00
LawyZheng
d63061f13b fix search on auto completion (#1544) 2025-01-14 13:08:35 +08:00