Commit Graph

63 Commits

Author SHA1 Message Date
karishmas6
2800e566e9 feat: set proxy 2024-10-27 01:09:00 +05:30
karishmas6
8567354fda feat: set page viewport size 2024-10-24 18:53:43 +05:30
karishmas6
32d5b09d6f feat: set page viewport size 2024-10-24 18:47:18 +05:30
karishmas6
9eec16feea fix: rename to maxun-core 2024-09-21 22:20:04 +05:30
karishmas6
db95038645 fix: use typeof operators 2024-09-21 21:50:54 +05:30
karishmas6
061714fcdc chore: lint 2024-09-20 23:37:00 +05:30
karishmas6
a7a1e9b305 fix: spacing 2024-09-20 23:36:28 +05:30
karishmas6
fb6ce10693 feat: click load more 2024-09-20 23:35:49 +05:30
karishmas6
b598d265b2 feat: scroll up 2024-09-20 20:26:51 +05:30
karishmas6
2bc9f70e09 fix(temporary): do not disable ad blocker manually 2024-08-21 05:55:05 +05:30
karishmas6
f8346f8985 chore: lint 2024-08-21 05:27:37 +05:30
karishmas6
928dc6141b fix: -rm currentPage var 2024-08-21 05:27:16 +05:30
karishmas6
a07e9b6969 fix: remove old scrapeList implementation 2024-08-21 05:26:39 +05:30
karishmas6
6eb1d94dea fix: remove fullLists & Request 2024-08-21 05:25:54 +05:30
karishmas6
57b56d3fcb feat: disable ad-blocker once runLoop closes 2024-08-21 05:25:30 +05:30
karishmas6
321bd01704 chore: lint 2024-08-21 05:24:52 +05:30
karishmas6
130f59a7c9 feat: disable ad blocker 2024-08-21 05:24:41 +05:30
karishmas6
1b06d8c00f feat: apply ad-blocker before running loop 2024-08-21 05:16:15 +05:30
karishmas6
cdb7ee0429 feat: apply ad blocker in page 2024-08-21 05:14:58 +05:30
karishmas6
b8679b356c fix: remove extra () 2024-08-21 05:11:28 +05:30
karishmas6
d23dad1990 feat: initialize ad-blocker 2024-08-21 05:10:56 +05:30
karishmas6
dd119955d2 feat: create blocker for Interpreter 2024-08-21 05:06:34 +05:30
karishmas6
c2db3cc720 fix: whitespace format 2024-08-20 23:16:11 +05:30
karishmas6
6d5ffb5222 chore: lint 2024-08-20 23:15:33 +05:30
karishmas6
6b6583647a chore: remove comments 2024-08-20 23:15:21 +05:30
karishmas6
24a3dd9a97 feat: remove redundant scraping outside switch case 2024-08-20 22:01:29 +05:30
karishmas6
8857de0b8f fix: remove while loop 2024-08-20 21:48:11 +05:30
karishmas6
e4b7ca5235 feat: scrape multiple pages 2024-08-19 19:23:31 +05:30
karishmas6
a715c56afe feat: initialize new set for unique items per page 2024-08-19 18:18:30 +05:30
karishmas6
1b3bfddcb1 feat: track pages 2024-08-19 02:47:41 +05:30
karishmas6
56bd3c38ae chore: lint 2024-08-19 01:42:41 +05:30
karishmas6
bdf68fb66d chore: add comments 2024-08-19 01:39:55 +05:30
karishmas6
b6bcc1d516 feat: handle clickNext pagination by tracking already scraped items 2024-08-19 01:38:41 +05:30
karishmas6
0d1f83c201 fix: remove current page variable 2024-08-19 00:39:24 +05:30
karishmas6
6a597daa42 feat: handle next click pagination on server 2024-08-19 00:17:38 +05:30
karishmas6
4c699adad4 chore: remove comments 2024-08-18 23:54:15 +05:30
karishmas6
47f5726619 fix: dont call window.scrollUp() from browser side 2024-08-18 22:47:14 +05:30
karishmas6
997a466f30 chore: remove comment 2024-08-18 22:46:44 +05:30
karishmas6
9a18f470f9 chore: lint 2024-08-18 22:46:10 +05:30
karishmas6
5d1747c874 feat: wait before next iteration for content load completion 2024-08-18 22:35:35 +05:30
karishmas6
48a5ac3b82 feat: scrape for default case 2024-08-18 22:34:46 +05:30
karishmas6
5daac01f1b fix: remove duplicate return 2024-08-18 22:32:58 +05:30
karishmas6
1c93e5430a feat: scrape after scroll completion 2024-08-18 22:32:39 +05:30
karishmas6
ccc68ceb09 feat: remove scraping before checking pagination type 2024-08-18 22:31:37 +05:30
karishmas6
8ddee6ac10 feat: call scrapeList based on pagination 2024-08-18 22:22:43 +05:30
karishmas6
1260730e56 chore: lint 2024-08-18 22:19:24 +05:30
karishmas6
3771de92ca feat: make previousHeight global 2024-08-18 22:19:06 +05:30
karishmas6
bf292f0516 feat: scroll donw on server side 2024-08-18 22:18:03 +05:30
karishmas6
95631541b9 feat: handle pagination on server side 2024-08-17 23:54:00 +05:30
karishmas6
87476c3e35 fix: remove flexible param 2024-08-16 18:21:34 +05:30