Commit Graph

1061 Commits

Author SHA1 Message Date
karishmas6
a07e9b6969 fix: remove old scrapeList implementation 2024-08-21 05:26:39 +05:30
karishmas6
6eb1d94dea fix: remove fullLists & Request 2024-08-21 05:25:54 +05:30
karishmas6
57b56d3fcb feat: disable ad-blocker once runLoop closes 2024-08-21 05:25:30 +05:30
karishmas6
321bd01704 chore: lint 2024-08-21 05:24:52 +05:30
karishmas6
130f59a7c9 feat: disable ad blocker 2024-08-21 05:24:41 +05:30
karishmas6
1b06d8c00f feat: apply ad-blocker before running loop 2024-08-21 05:16:15 +05:30
karishmas6
cdb7ee0429 feat: apply ad blocker in page 2024-08-21 05:14:58 +05:30
karishmas6
b8679b356c fix: remove extra () 2024-08-21 05:11:28 +05:30
karishmas6
d23dad1990 feat: initialize ad-blocker 2024-08-21 05:10:56 +05:30
karishmas6
dd119955d2 feat: create blocker for Interpreter 2024-08-21 05:06:34 +05:30
karishmas6
6de92bfe4f chore(deps): stealth plugins 2024-08-21 04:42:00 +05:30
karishmas6
91c10c72de feat: add scrapeListAuto as custom action 2024-08-21 04:37:46 +05:30
karishmas6
c2db3cc720 fix: whitespace format 2024-08-20 23:16:11 +05:30
karishmas6
6d5ffb5222 chore: lint 2024-08-20 23:15:33 +05:30
karishmas6
6b6583647a chore: remove comments 2024-08-20 23:15:21 +05:30
karishmas6
24a3dd9a97 feat: remove redundant scraping outside switch case 2024-08-20 22:01:29 +05:30
karishmas6
8857de0b8f fix: remove while loop 2024-08-20 21:48:11 +05:30
karishmas6
e4b7ca5235 feat: scrape multiple pages 2024-08-19 19:23:31 +05:30
karishmas6
a715c56afe feat: initialize new set for unique items per page 2024-08-19 18:18:30 +05:30
karishmas6
1b3bfddcb1 feat: track pages 2024-08-19 02:47:41 +05:30
karishmas6
56bd3c38ae chore: lint 2024-08-19 01:42:41 +05:30
karishmas6
bdf68fb66d chore: add comments 2024-08-19 01:39:55 +05:30
karishmas6
b6bcc1d516 feat: handle clickNext pagination by tracking already scraped items 2024-08-19 01:38:41 +05:30
karishmas6
0d1f83c201 fix: remove current page variable 2024-08-19 00:39:24 +05:30
karishmas6
6a597daa42 feat: handle next click pagination on server 2024-08-19 00:17:38 +05:30
karishmas6
4c699adad4 chore: remove comments 2024-08-18 23:54:15 +05:30
karishmas6
47f5726619 fix: dont call window.scrollUp() from browser side 2024-08-18 22:47:14 +05:30
karishmas6
997a466f30 chore: remove comment 2024-08-18 22:46:44 +05:30
karishmas6
9a18f470f9 chore: lint 2024-08-18 22:46:10 +05:30
karishmas6
5d1747c874 feat: wait before next iteration for content load completion 2024-08-18 22:35:35 +05:30
karishmas6
48a5ac3b82 feat: scrape for default case 2024-08-18 22:34:46 +05:30
karishmas6
5daac01f1b fix: remove duplicate return 2024-08-18 22:32:58 +05:30
karishmas6
1c93e5430a feat: scrape after scroll completion 2024-08-18 22:32:39 +05:30
karishmas6
ccc68ceb09 feat: remove scraping before checking pagination type 2024-08-18 22:31:37 +05:30
karishmas6
8ddee6ac10 feat: call scrapeList based on pagination 2024-08-18 22:22:43 +05:30
karishmas6
1260730e56 chore: lint 2024-08-18 22:19:24 +05:30
karishmas6
3771de92ca feat: make previousHeight global 2024-08-18 22:19:06 +05:30
karishmas6
bf292f0516 feat: scroll donw on server side 2024-08-18 22:18:03 +05:30
karishmas6
221c450546 feat: use window.scrollTo instead of scrollBy 2024-08-18 21:56:09 +05:30
karishmas6
95631541b9 feat: handle pagination on server side 2024-08-17 23:54:00 +05:30
karishmas6
a8e8b53d57 chore: remove comment 2024-08-17 23:51:32 +05:30
karishmas6
029a6b9e98 chore: lint 2024-08-17 23:51:00 +05:30
karishmas6
9f8e8fc01a feat: remove splice 2024-08-17 23:33:33 +05:30
karishmas6
f4511b7abc fix: remove else statement 2024-08-17 23:32:55 +05:30
karishmas6
4abc2cf9ba fix: add function keyword 2024-08-17 23:31:52 +05:30
karishmas6
2799d5055e chore: lint 2024-08-17 23:27:28 +05:30
karishmas6
794d540f81 feat: move scrollDown & scrollUp inside window 2024-08-17 23:27:17 +05:30
karishmas6
985c1034d3 chore: lint 2024-08-17 21:20:03 +05:30
karishmas6
94daa02806 feat: remove pagination param 2024-08-17 21:16:49 +05:30
karishmas6
9bc94f4614 feat: move pagination from browser side 2024-08-17 21:16:22 +05:30