Commit Graph

42 Commits

Author SHA1 Message Date
karishmas6
527fa05b9f chore(deps): remove node-fetch 2024-04-20 02:41:08 +05:30
karishmas6
242c0a1a79 chore: code cleanuo 2024-04-20 00:52:37 +05:30
karishmas6
8ba8a6927c chore: lint 2024-04-20 00:51:38 +05:30
karishmas6
497a248163 feat: remove timeout 2024-04-20 00:51:10 +05:30
karishmas6
41ebb3b2aa chore: remove console logs 2024-04-20 00:48:35 +05:30
karishmas6
b4cb0568fb feat: set persistStorage to false 2024-04-20 00:47:50 +05:30
karishmas6
e385142428 chore: / messae 2024-04-19 20:39:55 +05:30
karishmas6
b21a942812 feat: basic working scraping endpoint 2024-04-19 03:22:41 +05:30
karishmas6
20b40562b5 fix: return scrapedData after crawlee.run 2024-04-19 03:21:35 +05:30
karishmas6
0bc497b933 fix: default export 2024-04-19 02:23:46 +05:30
karishmas6
614a600b90 feat: remove cli arguments 2024-04-19 01:04:57 +05:30
karishmas6
fe707f71d8 chore: remove unwanted comments 2024-04-19 01:01:16 +05:30
karishmas6
f89603b1a2 chore: remove unused imports 2024-04-18 22:21:40 +05:30
karishmas6
25173295d2 fix: import crawlee 2024-04-18 22:20:06 +05:30
karishmas6
75d55f398c chore: move cli scraper 2024-04-18 22:19:40 +05:30
karishmas6
32ec5b6f45 chore: move cli scraper 2024-04-18 22:19:24 +05:30
karishmas6
2803d302e3 chore: remove old logic 2024-04-18 22:18:50 +05:30
karishmas6
c1720ed84d feat(wip): cli scrape 2024-04-18 22:17:09 +05:30
karishmas6
536a59bdd0 chore(deps): install crawlee 2024-04-18 22:02:38 +05:30
karishmas6
784d54b7e1 feat(engine): remove proxy 2024-04-18 21:39:02 +05:30
karishmas6
1eeb218f1d feat(engine): stale scrape 2024-04-18 21:38:41 +05:30
karishmas6
a5e09f9098 feat(engine): stale 2024-04-18 21:38:07 +05:30
karishmas6
4c3c986731 fix: remove {} 2024-04-17 00:42:03 +05:30
karishmas6
f00b860bb7 fix: add await 2024-04-17 00:40:37 +05:30
karishmas6
cd3e379c5e fix: fastify module imports 2024-04-17 00:39:12 +05:30
karishmas6
3f2128bbc2 fix: default export 2024-04-17 00:33:48 +05:30
karishmas6
dde1604011 refactor: proper playwright usae 2024-04-17 00:17:31 +05:30
karishmas6
b33e6fc508 refactor: follow module syntax 2024-04-16 23:52:11 +05:30
karishmas6
12aa67890d feat: move to module 2024-04-16 23:50:10 +05:30
karishmas6
a7c7d53889 feat: basic scraping (wip) 2024-04-16 23:49:35 +05:30
karishmas6
48b36e974c feat: proxy route 2024-04-16 23:49:05 +05:30
karishmas6
73c678774f feat: scrape route 2024-04-16 23:48:32 +05:30
karishmas6
e23eb5936f chore(deps): install node-fetch 2024-04-16 22:59:41 +05:30
karishmas6
36a7b61ff7 chore(deps): remove crawlee 2024-04-16 22:43:44 +05:30
karishmas6
d92db8920a chore: remove crawlee logic 2024-04-16 22:42:26 +05:30
karishmas6
0b49dd6acb feat: enable logger 2024-04-12 12:24:59 +05:30
karishmas6
c77608d6d6 feat: CORS setup 2024-04-12 12:24:41 +05:30
karishmas6
11c40fae6c chore: remove commented code 2024-04-12 12:13:38 +05:30
karishmas6
fa6ff65a4c feat(wip): init be scraping 2024-04-12 12:12:55 +05:30
karishmas6
792e26e01f chore: setup scraper engine 2024-04-04 09:12:35 +05:30
karishmas6
2e6a0290f2 chore: fastify + ts api setup 2024-04-04 08:58:17 +05:30
karishmas6
5c07c54b57 chore: fastify + ts setup 2024-04-04 07:53:54 +05:30