fix: broken crawl docs link

This commit is contained in:
Karishma Shukla
2026-01-30 21:50:19 +05:30
committed by GitHub
parent 43915ca3d9
commit dd01267893

View File

@@ -65,7 +65,7 @@ Learn more <a href="https://docs.maxun.dev/robot/scrape/scrape-robots">here</a>.
### 3. Crawl
Crawl entire websites and extract content from every relevant page, with full control over scope and discovery.
Learn more <a href="/robot/crawl/crawl-introduction">here</a>.
Learn more <a href="https://docs.maxun.dev/robot/crawl/crawl-introduction">here</a>.
### 4. Search
Run automated web searches to discover or scrape results, with support for time-based filters.