Commit Graph

6740 Commits

Author SHA1 Message Date
karishmas6
8ba8a6927c chore: lint 2024-04-20 00:51:38 +05:30
karishmas6
497a248163 feat: remove timeout 2024-04-20 00:51:10 +05:30
karishmas6
41ebb3b2aa chore: remove console logs 2024-04-20 00:48:35 +05:30
karishmas6
b4cb0568fb feat: set persistStorage to false 2024-04-20 00:47:50 +05:30
karishmas6
e385142428 chore: / messae 2024-04-19 20:39:55 +05:30
karishmas6
b21a942812 feat: basic working scraping endpoint 2024-04-19 03:22:41 +05:30
karishmas6
20b40562b5 fix: return scrapedData after crawlee.run 2024-04-19 03:21:35 +05:30
karishmas6
0bc497b933 fix: default export 2024-04-19 02:23:46 +05:30
karishmas6
614a600b90 feat: remove cli arguments 2024-04-19 01:04:57 +05:30
karishmas6
fe707f71d8 chore: remove unwanted comments 2024-04-19 01:01:16 +05:30
karishmas6
f89603b1a2 chore: remove unused imports 2024-04-18 22:21:40 +05:30
karishmas6
25173295d2 fix: import crawlee 2024-04-18 22:20:06 +05:30
karishmas6
75d55f398c chore: move cli scraper 2024-04-18 22:19:40 +05:30
karishmas6
32ec5b6f45 chore: move cli scraper 2024-04-18 22:19:24 +05:30
karishmas6
2803d302e3 chore: remove old logic 2024-04-18 22:18:50 +05:30
karishmas6
c1720ed84d feat(wip): cli scrape 2024-04-18 22:17:09 +05:30
karishmas6
536a59bdd0 chore(deps): install crawlee 2024-04-18 22:02:38 +05:30
karishmas6
784d54b7e1 feat(engine): remove proxy 2024-04-18 21:39:02 +05:30
karishmas6
1eeb218f1d feat(engine): stale scrape 2024-04-18 21:38:41 +05:30
karishmas6
a5e09f9098 feat(engine): stale 2024-04-18 21:38:07 +05:30
karishmas6
04e8676cde feat(wip): ui 2024-04-17 20:54:28 +05:30
karishmas6
4c3c986731 fix: remove {} 2024-04-17 00:42:03 +05:30
karishmas6
f00b860bb7 fix: add await 2024-04-17 00:40:37 +05:30
karishmas6
cd3e379c5e fix: fastify module imports 2024-04-17 00:39:12 +05:30
karishmas6
3f2128bbc2 fix: default export 2024-04-17 00:33:48 +05:30
karishmas6
dde1604011 refactor: proper playwright usae 2024-04-17 00:17:31 +05:30
karishmas6
b33e6fc508 refactor: follow module syntax 2024-04-16 23:52:11 +05:30
karishmas6
12aa67890d feat: move to module 2024-04-16 23:50:10 +05:30
karishmas6
a7c7d53889 feat: basic scraping (wip) 2024-04-16 23:49:35 +05:30
karishmas6
48b36e974c feat: proxy route 2024-04-16 23:49:05 +05:30
karishmas6
73c678774f feat: scrape route 2024-04-16 23:48:32 +05:30
karishmas6
e23eb5936f chore(deps): install node-fetch 2024-04-16 22:59:41 +05:30
karishmas6
36a7b61ff7 chore(deps): remove crawlee 2024-04-16 22:43:44 +05:30
karishmas6
d92db8920a chore: remove crawlee logic 2024-04-16 22:42:26 +05:30
karishmas6
ea3dd0185d chore: react frame lib 2024-04-16 22:38:56 +05:30
karishmas6
201b9fff6c feat: visual selection (wip) 2024-04-16 22:38:27 +05:30
karishmas6
3fcf3d732f fix: .tsx extension (needs to be rolled back) 2024-04-12 14:56:09 +05:30
karishmas6
6121963998 fix: rename to .jsx 2024-04-12 14:49:15 +05:30
karishmas6
0b49dd6acb feat: enable logger 2024-04-12 12:24:59 +05:30
karishmas6
c77608d6d6 feat: CORS setup 2024-04-12 12:24:41 +05:30
karishmas6
11c40fae6c chore: remove commented code 2024-04-12 12:13:38 +05:30
karishmas6
fa6ff65a4c feat(wip): init be scraping 2024-04-12 12:12:55 +05:30
karishmas6
83a7942300 refactor: remove VisualSelector component 2024-04-12 12:02:31 +05:30
karishmas6
221b476fad feat(wip): render url 2024-04-12 12:02:08 +05:30
karishmas6
d716e09355 refactor: remove typescript 2024-04-11 14:14:26 +05:30
karishmas6
577c1af79b refactor: remove typescript 2024-04-11 14:13:55 +05:30
karishmas6
71193d9c85 refactor: remove typescript 2024-04-11 14:12:40 +05:30
karishmas6
586c4f2b88 refactor: remove typescript 2024-04-11 14:11:47 +05:30
karishmas6
bf60078087 refactor: remove typescript 2024-04-11 14:11:13 +05:30
karishmas6
f2858df857 chore(deps): install html-react-parser 2024-04-05 22:46:50 +05:30