Commit Graph

237 Commits

Author SHA1 Message Date
Rohit Rajan
19f2df87fc fix: allow robots.txt, max depth config 2026-01-19 00:38:06 +05:30
amhsirak
2c795af858 temp: remove adblocker 2026-01-04 22:42:22 +05:30
Rohit
8ab2defdeb Merge branch 'develop' into crawl-search 2026-01-04 18:21:47 +05:30
Rohit Rajan
9898dc410d feat: add server side crawl and search logic 2026-01-02 15:46:10 +05:30
amhsirak
36b80da631 feat(core): real time progress update for runs 2026-01-02 11:18:23 +05:30
Rohit
8c653f113d Merge branch 'develop' into browser-service 2025-11-30 19:26:42 +05:30
Rohit Rajan
cf19a72dc0 feat: add separate browser service 2025-11-30 17:41:44 +05:30
amhsirak
bf1a6f1aa7 fix(core): clean socket handlers causing memory leaks 2025-11-28 15:03:43 +05:30
Rohit
8171e517d7 Merge branch 'develop' into persist-fix 2025-11-20 21:08:22 +05:30
Rohit Rajan
1b8e5046a8 fix: __name non existent field 2025-11-18 15:11:09 +05:30
Rohit Rajan
801ae5a365 fix: scrapeList pagination persistence and action data separation 2025-11-18 14:25:09 +05:30
Rohit Rajan
288614bdcf fix: use fresh button on clicking 2025-11-13 12:43:47 +05:30
Karishma Shukla
288f7fc4d3 Merge pull request #876 from getmaxun/pag-limiter
fix(maxun-core): run stuck in endless loop of clicking on pagination buttons
2025-11-12 21:54:53 +05:30
Rohit Rajan
deb2ae674b fix: add max no new items check 2025-11-06 18:56:24 +05:30
Rohit Rajan
85926ae784 fix: null error 2025-11-05 23:23:19 +05:30
Rohit Rajan
eafe11aef4 feat: recorder revamp core changes 2025-10-20 20:28:38 +05:30
Rohit Rajan
47d1b24de3 fix: timeout mechanism, revamp working button logic 2025-09-28 23:25:32 +05:30
Rohit Rajan
f77f42a929 feat: add abort state getter 2025-09-28 23:00:24 +05:30
Karishma Shukla
d0e1c9b8dd Merge pull request #774 from getmaxun/extract-reliable
feat(maxun-core): extraction and platform stability
2025-09-10 12:32:11 +05:30
Rohit Rajan
d92b62be00 feat: add abort checks 2025-09-10 00:17:38 +05:30
Rohit
49b0c484b9 fix: add multiple scroll approach 2025-08-28 15:29:14 +05:30
Rohit
8b8a08c54a feat: rm state checks workflow validation 2025-08-19 00:16:42 +05:30
Rohit
6dac0827b0 feat: null checks for doc and iframe,frame 2025-08-05 01:25:05 +05:30
Rohit
780b18b9f4 feat: page validity, continue if click fails 2025-08-05 01:24:18 +05:30
Rohit
47fc16806d feat: continue other job execution on fail 2025-08-05 01:22:51 +05:30
Karishma Shukla
e2d4073c36 Merge pull request #694 from getmaxun/child-shadow
feat(maxun-core): child extraction + deep shadow dom
2025-07-16 01:20:08 +05:30
Rohit
bc9469052c feat: shadow dom aware scrape list 2025-07-16 01:17:17 +05:30
amhsirak
cfd3c174fd feat(maxun-core): remove max duplicate item logic 2025-07-12 01:19:44 +05:30
Rohit
32d5fdc768 feat: add xpath content sign logic 2025-07-07 01:45:18 +05:30
Rohit
9a065a3d3d feat: xpath support for core extraction 2025-07-06 21:44:56 +05:30
Rohit
ac8dcf6857 feat: increment and add list results 2025-06-07 14:23:32 +05:30
RohitR311
d60855605a feat: add nth-child selector fallback logic 2025-05-10 16:59:43 +05:30
RohitR311
8b9893f68f feat: add timeout after navigation success 2025-05-09 23:37:20 +05:30
RohitR311
38430ec4c1 feat: add mode param options 2025-05-07 09:30:25 +05:30
Rohit
01ab958b60 feat: replace banned Function type with an explicit signature 2025-04-29 20:27:22 +05:30
Rohit
a00e69e40a feat: change scrape schema merge logic 2025-04-29 00:29:52 +05:30
Rohit
c6266fd17c feat: emit action type 2025-04-27 15:22:06 +05:30
Rohit
540c9ec709 feat: check parent element url and extract 2025-04-23 17:21:14 +05:30
Rohit
7761b2af35 feat: track results and return scroll pagination 2025-04-08 15:09:38 +05:30
Rohit
2d0e945abe feat: rm page timeout for pagination 2025-04-03 20:08:27 +05:30
Rohit
0f0b53472e feat: improve url extraction for images 2025-03-18 12:46:25 +05:30
Rohit
b172636eb1 feat: add pagination support for SPA and Ajax pagination 2025-03-17 16:03:14 +05:30
Rohit
acb3da38af feat: better find working button logic 2025-03-04 10:53:57 +05:30
Rohit
cb4dabfcf7 feat: add frame element support for scrapeList action 2025-03-04 09:14:27 +05:30
Rohit
ccbf9d074b feat: add scraping support for frame elements 2025-03-03 18:11:19 +05:30
Rohit
8f4e6a9f3e feat: match state if url and selectors empty 2025-03-03 18:09:27 +05:30
Rohit
1bde2c9fd8 feat: revamp click load more scraping 2025-03-03 01:49:31 +05:30
Rohit
cbe8d4fee8 fix: add selector check for state 2025-02-20 19:04:43 +05:30
Rohit
7e2d1ea4cd feat: better load more pagination handling 2025-02-03 23:50:29 +05:30
Rohit
dc44f6a9cd feat: add block scope 2025-02-03 23:36:57 +05:30