Commit Graph

156 Commits

Author SHA1 Message Date
karishmas6
977537a90e chore(deps): install cheerio 2024-05-10 22:01:56 +05:30
karishmas6
5d96017c0c feat(wip): core selection webpreview 2024-05-10 03:34:20 +05:30
karishmas6
296857d8e0 chore: lint 2024-05-10 02:18:29 +05:30
karishmas6
731a3f1824 chore: remove old generateCssSelector fxn 2024-05-10 02:17:54 +05:30
karishmas6
ac7da0f721 chore: remove unused imports 2024-05-10 02:16:32 +05:30
karishmas6
6b84b77418 feat(wip): core selection webpreview 2024-05-10 02:15:01 +05:30
karishmas6
514f9f5615 feat(wip): html and elements state 2024-05-10 01:13:14 +05:30
karishmas6
788137e528 feat(wip): core selection 2024-05-10 01:11:46 +05:30
karishmas6
6816bf24dc chore(deps): uninstall @tremor/react 2024-05-09 21:26:06 +05:30
karishmas6
2c1a9a4cd0 feat: load website html 2024-04-21 19:51:35 +05:30
karishmas6
ed5dd602ac feat: load website html route 2024-04-21 19:51:19 +05:30
karishmas6
f33e70af17 chore(deps): npm i css-selector-generator 2024-04-20 22:57:30 +05:30
karishmas6
51aec5afdc chore: remove Scraper 2024-04-20 22:32:25 +05:30
karishmas6
537f4b4e1f chore: remove Scraper 2024-04-20 22:32:03 +05:30
karishmas6
5f5600a387 chore: code cleanup (old scraper) 2024-04-20 22:30:25 +05:30
karishmas6
527fa05b9f chore(deps): remove node-fetch 2024-04-20 02:41:08 +05:30
karishmas6
242c0a1a79 chore: code cleanuo 2024-04-20 00:52:37 +05:30
karishmas6
8ba8a6927c chore: lint 2024-04-20 00:51:38 +05:30
karishmas6
497a248163 feat: remove timeout 2024-04-20 00:51:10 +05:30
karishmas6
41ebb3b2aa chore: remove console logs 2024-04-20 00:48:35 +05:30
karishmas6
b4cb0568fb feat: set persistStorage to false 2024-04-20 00:47:50 +05:30
karishmas6
e385142428 chore: / messae 2024-04-19 20:39:55 +05:30
karishmas6
b21a942812 feat: basic working scraping endpoint 2024-04-19 03:22:41 +05:30
karishmas6
20b40562b5 fix: return scrapedData after crawlee.run 2024-04-19 03:21:35 +05:30
karishmas6
0bc497b933 fix: default export 2024-04-19 02:23:46 +05:30
karishmas6
614a600b90 feat: remove cli arguments 2024-04-19 01:04:57 +05:30
karishmas6
fe707f71d8 chore: remove unwanted comments 2024-04-19 01:01:16 +05:30
karishmas6
f89603b1a2 chore: remove unused imports 2024-04-18 22:21:40 +05:30
karishmas6
25173295d2 fix: import crawlee 2024-04-18 22:20:06 +05:30
karishmas6
75d55f398c chore: move cli scraper 2024-04-18 22:19:40 +05:30
karishmas6
32ec5b6f45 chore: move cli scraper 2024-04-18 22:19:24 +05:30
karishmas6
2803d302e3 chore: remove old logic 2024-04-18 22:18:50 +05:30
karishmas6
c1720ed84d feat(wip): cli scrape 2024-04-18 22:17:09 +05:30
karishmas6
536a59bdd0 chore(deps): install crawlee 2024-04-18 22:02:38 +05:30
karishmas6
784d54b7e1 feat(engine): remove proxy 2024-04-18 21:39:02 +05:30
karishmas6
1eeb218f1d feat(engine): stale scrape 2024-04-18 21:38:41 +05:30
karishmas6
a5e09f9098 feat(engine): stale 2024-04-18 21:38:07 +05:30
karishmas6
04e8676cde feat(wip): ui 2024-04-17 20:54:28 +05:30
karishmas6
4c3c986731 fix: remove {} 2024-04-17 00:42:03 +05:30
karishmas6
f00b860bb7 fix: add await 2024-04-17 00:40:37 +05:30
karishmas6
cd3e379c5e fix: fastify module imports 2024-04-17 00:39:12 +05:30
karishmas6
3f2128bbc2 fix: default export 2024-04-17 00:33:48 +05:30
karishmas6
dde1604011 refactor: proper playwright usae 2024-04-17 00:17:31 +05:30
karishmas6
b33e6fc508 refactor: follow module syntax 2024-04-16 23:52:11 +05:30
karishmas6
12aa67890d feat: move to module 2024-04-16 23:50:10 +05:30
karishmas6
a7c7d53889 feat: basic scraping (wip) 2024-04-16 23:49:35 +05:30
karishmas6
48b36e974c feat: proxy route 2024-04-16 23:49:05 +05:30
karishmas6
73c678774f feat: scrape route 2024-04-16 23:48:32 +05:30
karishmas6
e23eb5936f chore(deps): install node-fetch 2024-04-16 22:59:41 +05:30
karishmas6
36a7b61ff7 chore(deps): remove crawlee 2024-04-16 22:43:44 +05:30