Commit Graph

41 Commits

Author SHA1 Message Date
karishmas6
c2db3cc720 fix: whitespace format 2024-08-20 23:16:11 +05:30
karishmas6
6d5ffb5222 chore: lint 2024-08-20 23:15:33 +05:30
karishmas6
6b6583647a chore: remove comments 2024-08-20 23:15:21 +05:30
karishmas6
24a3dd9a97 feat: remove redundant scraping outside switch case 2024-08-20 22:01:29 +05:30
karishmas6
8857de0b8f fix: remove while loop 2024-08-20 21:48:11 +05:30
karishmas6
e4b7ca5235 feat: scrape multiple pages 2024-08-19 19:23:31 +05:30
karishmas6
a715c56afe feat: initialize new set for unique items per page 2024-08-19 18:18:30 +05:30
karishmas6
1b3bfddcb1 feat: track pages 2024-08-19 02:47:41 +05:30
karishmas6
56bd3c38ae chore: lint 2024-08-19 01:42:41 +05:30
karishmas6
bdf68fb66d chore: add comments 2024-08-19 01:39:55 +05:30
karishmas6
b6bcc1d516 feat: handle clickNext pagination by tracking already scraped items 2024-08-19 01:38:41 +05:30
karishmas6
0d1f83c201 fix: remove current page variable 2024-08-19 00:39:24 +05:30
karishmas6
6a597daa42 feat: handle next click pagination on server 2024-08-19 00:17:38 +05:30
karishmas6
4c699adad4 chore: remove comments 2024-08-18 23:54:15 +05:30
karishmas6
47f5726619 fix: dont call window.scrollUp() from browser side 2024-08-18 22:47:14 +05:30
karishmas6
997a466f30 chore: remove comment 2024-08-18 22:46:44 +05:30
karishmas6
9a18f470f9 chore: lint 2024-08-18 22:46:10 +05:30
karishmas6
5d1747c874 feat: wait before next iteration for content load completion 2024-08-18 22:35:35 +05:30
karishmas6
48a5ac3b82 feat: scrape for default case 2024-08-18 22:34:46 +05:30
karishmas6
5daac01f1b fix: remove duplicate return 2024-08-18 22:32:58 +05:30
karishmas6
1c93e5430a feat: scrape after scroll completion 2024-08-18 22:32:39 +05:30
karishmas6
ccc68ceb09 feat: remove scraping before checking pagination type 2024-08-18 22:31:37 +05:30
karishmas6
8ddee6ac10 feat: call scrapeList based on pagination 2024-08-18 22:22:43 +05:30
karishmas6
1260730e56 chore: lint 2024-08-18 22:19:24 +05:30
karishmas6
3771de92ca feat: make previousHeight global 2024-08-18 22:19:06 +05:30
karishmas6
bf292f0516 feat: scroll donw on server side 2024-08-18 22:18:03 +05:30
karishmas6
95631541b9 feat: handle pagination on server side 2024-08-17 23:54:00 +05:30
karishmas6
87476c3e35 fix: remove flexible param 2024-08-16 18:21:34 +05:30
karishmas6
6cafc9ef2d chore: lint 2024-08-12 06:35:00 +05:30
karishmas6
2bd4bc9ff1 feat: use scrapeListAuto 2024-08-12 06:28:08 +05:30
karishmas6
20810aa85b feat: handle scrapeList in WAW actions 2024-08-06 23:20:10 +05:30
karishmas6
ffa992f186 feat: pass scrapeList to ensureScriptsLoaded 2024-08-06 23:15:12 +05:30
karishmas6
062ded7c01 feat(core): accept attribute 2024-08-04 03:50:03 +05:30
karishmas6
39b8cdfbb4 feat: handle object instead of str for key-val pair 2024-08-03 20:32:12 +05:30
karishmas6
25eb58945e chore: lint 2024-08-03 02:20:59 +05:30
karishmas6
92db9e5b93 fix: -rm bypassCSP 2024-08-03 02:20:16 +05:30
karishmas6
420725a8c3 chore: remove unused import 2024-08-03 00:28:54 +05:30
karishmas6
2aa7cdc4bc fix: use addInitScript THE RIGHT WAY!!! 2024-08-02 19:05:41 +05:30
karishmas6
12e40f089d feat: bypass CSP by setting extra HTTP headers for page context 2024-08-02 13:10:26 +05:30
karishmas6
92bb30d8b7 fix(core): script injection for scrape | scrapeSchema 2024-08-01 19:16:13 +05:30
karishmas6
c6bbd27c71 refactor: create src dir 2024-07-31 20:42:19 +05:30