Commit Graph

108 Commits

Author SHA1 Message Date
karishmas6
b4eab60619 chore: remove comment 2024-09-20 20:20:44 +05:30
karishmas6
e9f1ff0294 feat: remove browser side scroll down 2024-09-20 20:19:55 +05:30
karishmas6
7ab668633c feat: remove browser side scroll up 2024-09-20 20:19:29 +05:30
karishmas6
e8e6a2d9b0 feat: remove browser based click next pagination 2024-09-20 20:17:45 +05:30
karishmas6
c6f7af6454 fix: format 2024-08-31 01:57:13 +05:30
karishmas6
2bc9f70e09 fix(temporary): do not disable ad blocker manually 2024-08-21 05:55:05 +05:30
karishmas6
c2fe629267 fix: remove log of workflow from preprocessor 2024-08-21 05:30:21 +05:30
karishmas6
dd12d136af fix: format 2024-08-21 05:29:41 +05:30
karishmas6
f8346f8985 chore: lint 2024-08-21 05:27:37 +05:30
karishmas6
928dc6141b fix: -rm currentPage var 2024-08-21 05:27:16 +05:30
karishmas6
a07e9b6969 fix: remove old scrapeList implementation 2024-08-21 05:26:39 +05:30
karishmas6
6eb1d94dea fix: remove fullLists & Request 2024-08-21 05:25:54 +05:30
karishmas6
57b56d3fcb feat: disable ad-blocker once runLoop closes 2024-08-21 05:25:30 +05:30
karishmas6
321bd01704 chore: lint 2024-08-21 05:24:52 +05:30
karishmas6
130f59a7c9 feat: disable ad blocker 2024-08-21 05:24:41 +05:30
karishmas6
1b06d8c00f feat: apply ad-blocker before running loop 2024-08-21 05:16:15 +05:30
karishmas6
cdb7ee0429 feat: apply ad blocker in page 2024-08-21 05:14:58 +05:30
karishmas6
b8679b356c fix: remove extra () 2024-08-21 05:11:28 +05:30
karishmas6
d23dad1990 feat: initialize ad-blocker 2024-08-21 05:10:56 +05:30
karishmas6
dd119955d2 feat: create blocker for Interpreter 2024-08-21 05:06:34 +05:30
karishmas6
6de92bfe4f chore(deps): stealth plugins 2024-08-21 04:42:00 +05:30
karishmas6
c2db3cc720 fix: whitespace format 2024-08-20 23:16:11 +05:30
karishmas6
6d5ffb5222 chore: lint 2024-08-20 23:15:33 +05:30
karishmas6
6b6583647a chore: remove comments 2024-08-20 23:15:21 +05:30
karishmas6
24a3dd9a97 feat: remove redundant scraping outside switch case 2024-08-20 22:01:29 +05:30
karishmas6
8857de0b8f fix: remove while loop 2024-08-20 21:48:11 +05:30
karishmas6
e4b7ca5235 feat: scrape multiple pages 2024-08-19 19:23:31 +05:30
karishmas6
a715c56afe feat: initialize new set for unique items per page 2024-08-19 18:18:30 +05:30
karishmas6
1b3bfddcb1 feat: track pages 2024-08-19 02:47:41 +05:30
karishmas6
56bd3c38ae chore: lint 2024-08-19 01:42:41 +05:30
karishmas6
bdf68fb66d chore: add comments 2024-08-19 01:39:55 +05:30
karishmas6
b6bcc1d516 feat: handle clickNext pagination by tracking already scraped items 2024-08-19 01:38:41 +05:30
karishmas6
0d1f83c201 fix: remove current page variable 2024-08-19 00:39:24 +05:30
karishmas6
6a597daa42 feat: handle next click pagination on server 2024-08-19 00:17:38 +05:30
karishmas6
4c699adad4 chore: remove comments 2024-08-18 23:54:15 +05:30
karishmas6
47f5726619 fix: dont call window.scrollUp() from browser side 2024-08-18 22:47:14 +05:30
karishmas6
997a466f30 chore: remove comment 2024-08-18 22:46:44 +05:30
karishmas6
9a18f470f9 chore: lint 2024-08-18 22:46:10 +05:30
karishmas6
5d1747c874 feat: wait before next iteration for content load completion 2024-08-18 22:35:35 +05:30
karishmas6
48a5ac3b82 feat: scrape for default case 2024-08-18 22:34:46 +05:30
karishmas6
5daac01f1b fix: remove duplicate return 2024-08-18 22:32:58 +05:30
karishmas6
1c93e5430a feat: scrape after scroll completion 2024-08-18 22:32:39 +05:30
karishmas6
ccc68ceb09 feat: remove scraping before checking pagination type 2024-08-18 22:31:37 +05:30
karishmas6
8ddee6ac10 feat: call scrapeList based on pagination 2024-08-18 22:22:43 +05:30
karishmas6
1260730e56 chore: lint 2024-08-18 22:19:24 +05:30
karishmas6
3771de92ca feat: make previousHeight global 2024-08-18 22:19:06 +05:30
karishmas6
bf292f0516 feat: scroll donw on server side 2024-08-18 22:18:03 +05:30
karishmas6
221c450546 feat: use window.scrollTo instead of scrollBy 2024-08-18 21:56:09 +05:30
karishmas6
95631541b9 feat: handle pagination on server side 2024-08-17 23:54:00 +05:30
karishmas6
a8e8b53d57 chore: remove comment 2024-08-17 23:51:32 +05:30