Commit Graph

542 Commits

Author SHA1 Message Date
LawyZheng
cac4792f38 remove hard waiting time in scraping (#3195) 2025-08-15 02:24:59 +08:00
LawyZheng
f971cf8e58 optimize cache element tree logic (#3194) 2025-08-15 02:06:08 +08:00
LawyZheng
81767e3189 optimize scraping part 4 (#3192) 2025-08-15 01:55:59 +08:00
LawyZheng
04fd540cd5 stop building element tree again and again when drawing boudingbox (#3191) 2025-08-15 01:40:39 +08:00
LawyZheng
2556d04e70 fix scraping edge case (#3186) 2025-08-14 15:04:15 +08:00
LawyZheng
65e9cb10e9 optimize scraping part 2 (#3185) 2025-08-14 14:51:43 +08:00
LawyZheng
30606645ea optimize scraping part 1 (#3184) 2025-08-14 14:24:21 +08:00
LawyZheng
b88cf18590 optimize scraping part 3 (#3183) 2025-08-14 14:12:16 +08:00
Shuchang Zheng
52dc5a510b fix economy element tree trimming (#3182) 2025-08-13 21:45:14 -07:00
Shuchang Zheng
434bbff459 add support_empty_page and wait_seconds to the scrape_website interface (#3181) 2025-08-13 19:22:50 -07:00
LawyZheng
75b7a8ac4c fix script id bug on creating browser (#3173) 2025-08-13 12:13:17 +08:00
Shuchang Zheng
d0ab9a4eae script generation: regenerate click xpath from intention (#3169) 2025-08-12 17:40:02 -07:00
LawyZheng
d46d79e9e3 fix browser session bug (#3161) 2025-08-11 16:30:38 +00:00
Shuchang Zheng
58bd43171e Script generation (#3157) 2025-08-10 13:16:46 -07:00
devsy-bot[bot]
e3a3309e9c fix: change scraper log level from info to debug (#3143)
Co-authored-by: devsy-bot <no-reply@devsy.ai>
Co-authored-by: Claude <noreply@anthropic.com>
2025-08-08 08:56:30 -07:00
LawyZheng
44c9a81156 support uri format otp secrete (#3126) 2025-08-07 14:59:29 +08:00
LawyZheng
800c030e5c do not clear input when empty (#3114) 2025-08-06 23:15:59 +08:00
LawyZheng
977c9d4f13 select agent supports inputting secrete (#3103) 2025-08-05 11:51:09 +08:00
Jonathan Dobson
df8275aa4b set status to failed when browser session fails to initially connect (#3101) 2025-08-04 15:14:05 -04:00
LawyZheng
f33906509f fix dom listener bug (#3095) 2025-08-04 11:10:49 +08:00
Jonathan Dobson
7844b8372a fix backend logic for debugger browser session renewal (#3074) 2025-07-31 15:56:38 -04:00
LawyZheng
4ec4d7d1f5 optimize scrolling screenshot logic (#3058) 2025-07-30 15:37:44 +08:00
LawyZheng
d9537327da robust scrolling screenshot (#3050) 2025-07-29 14:56:13 +08:00
LawyZheng
ecc0e2e17d better failure reason for blank page (#3049)
Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
2025-07-29 14:40:54 +08:00
LawyZheng
bff7544b83 fix scraping issue (#3035) 2025-07-25 12:53:22 +08:00
LawyZheng
4093a7fab0 fix style map parsing (#3029) 2025-07-25 00:50:06 +08:00
LawyZheng
0045bf4a79 do not remove target attr (#3013) 2025-07-22 18:01:45 +08:00
LawyZheng
7630aa41ea use seperated userr goal check for sequential click agent (#3011) 2025-07-22 14:38:47 +08:00
LawyZheng
03cc8a5a52 extend auto completion agent logic (#3010) 2025-07-22 14:25:47 +08:00
LawyZheng
8c72538d1c current view coordinate click (#3001) 2025-07-21 17:31:54 +08:00
LawyZheng
fcd22017b7 make scraping timeout configurable (#2991) 2025-07-19 13:18:12 +08:00
Jonathan Dobson
f5d7639de8 allow empty urls (#2984) 2025-07-18 10:20:33 -04:00
Shuchang Zheng
764ac1928c browser session streaming fix and clean up wait_on_persistent_browser_address (#2983) 2025-07-18 00:16:07 -07:00
Jonathan Dobson
c13c36f99e distinctify failed scrapes due to no url (#2977) 2025-07-17 16:19:16 -04:00
Jonathan Dobson
05a24026e2 remove unused func from webeye persistent sessions manager (#2976) 2025-07-17 16:06:34 -04:00
Shuchang Zheng
fc20d8b902 add app_url for browser session (#2948) 2025-07-14 23:44:17 -07:00
Shuchang Zheng
8e13be2e28 expose browser_session.browser_address (#2946) 2025-07-14 22:55:36 -07:00
LawyZheng
90b7f55d3c fix max steps for date picker agent (#2944) 2025-07-15 10:21:18 +08:00
LawyZheng
5363d33dcc fix interactable detecting (#2941) 2025-07-15 03:31:34 +08:00
LawyZheng
873b7b774d do not tirgger select loigc when trying to input search value (#2940) 2025-07-15 01:17:08 +08:00
LawyZheng
1ecafbdf3a fix sequential click agent bug (#2939) 2025-07-15 00:57:48 +08:00
LawyZheng
974d1d2fca extend chain click to add coordinate click (#2937) 2025-07-14 14:02:26 +08:00
LawyZheng
dd9710eb9f add force textural element as interactable exp (#2936) 2025-07-14 13:09:40 +08:00
Shuchang Zheng
13c27c5178 browser address schema update (#2931) 2025-07-10 23:50:27 -07:00
LawyZheng
6c47a8709f add skyvern element check and uncheck (#2902) 2025-07-09 10:58:22 +08:00
LawyZheng
427ad4d9ac add session pool (#2899) 2025-07-08 23:44:50 +08:00
LawyZheng
95ab8295ce laminar integration (#2887) 2025-07-07 14:43:10 +08:00
LawyZheng
a0aec45a5d increase max step for datapicker agent (#2886) 2025-07-07 13:19:42 +08:00
Shuchang Zheng
41f77a40c8 enable inline import alert and fix inline imports (#2856) 2025-07-01 12:48:00 -07:00
Shuchang Zheng
bba1755ff1 scroll back after screenshot (#2851) 2025-07-01 06:00:54 +00:00