vodorod/parcer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Merge pull request #975 from getmaxun/pre-release-33

Browse Source 
chore: pre-release v0.0.33
This commit is contained in:
Karishma Shukla
2026-02-15 02:28:18 +05:30
committed by Dorod Parser
parent ae4f9d800b 550261e158
commit 7fa1901e5f
3 changed files with 61 additions and 61 deletions
Download Patch File Download Diff File Expand all files Collapse all files

110
README.md
View File

@@ -1,9 +1,9 @@
<h2 align="center"> <h2 align="center">
<div> <div>
<a href="https://www.maxun.dev/?ref=ghread"> <a href="https://www.Dorod Parser.dev/?ref=ghread">
<img src="/src/assets/maxunlogo.png" width="70" /> <img src="/src/assets/Dorod Parserlogo.png" width="70" />
<br> <br>
Maxun Dorod Parser
</a> </a>
</div> </div>
Turn Any Website Into A Structured API Turn Any Website Into A Structured API
@@ -11,44 +11,44 @@
</h2> </h2>
<p align="center"> <p align="center">
✨ The unified open-source no-code platform for real-time web scraping, crawling, search and AI data extraction ✨ вњЁ The unified open-source no-code platform for real-time web scraping, crawling, search and AI data extraction вњЁ
<p align="center"> <p align="center">
<a href="https://app.maxun.dev/?ref=ghread"><b>Go To App</b></a> • <a href="https://app.Dorod Parser.dev/?ref=ghread"><b>Go To App</b></a> •
<a href="https://docs.maxun.dev/?ref=ghread"><b>Documentation</b></a> • <a href="https://docs.Dorod Parser.dev/?ref=ghread"><b>Documentation</b></a> •
<a href="https://www.maxun.dev/?ref=ghread"><b>Website</b></a> • <a href="https://www.Dorod Parser.dev/?ref=ghread"><b>Website</b></a> •
<a href="https://discord.gg/5GbPjBUkws"><b>Discord</b></a> • <a href="https://discord.gg/5GbPjBUkws"><b>Discord</b></a> •
<a href="https://www.youtube.com/@MaxunOSS?ref=ghread"><b>Watch Tutorials</b></a> <a href="https://www.youtube.com/@Dorod ParserOSS?ref=ghread"><b>Watch Tutorials</b></a>
<br /> <br />
<br /> <br />
<a href="https://trendshift.io/repositories/12113" target="_blank"><img src="https://trendshift.io/api/badge/repositories/12113" alt="getmaxun%2Fmaxun | Trendshift" style="width: 250px; height: 55px; margin-top: 10px;" width="250" height="55"/></a> <a href="https://trendshift.io/repositories/12113" target="_blank"><img src="https://trendshift.io/api/badge/repositories/12113" alt="getDorod Parser%2FDorod Parser | Trendshift" style="width: 250px; height: 55px; margin-top: 10px;" width="250" height="55"/></a>
</p> </p>
## What is Maxun? ## What is Dorod Parser?
Maxun is an open-source no-code web data platform for turning the web into structured, reliable data. Dorod Parser is an open-source no-code web data platform for turning the web into structured, reliable data.
It supports extraction, crawling, scraping, and search — designed to scale from simple use cases to complex, automated workflows. It supports extraction, crawling, scraping, and search — designed to scale from simple use cases to complex, automated workflows.
### Ecosystem ### Ecosystem
1. **[Extract](https://docs.maxun.dev/category/extract)** – Emulate real user behavior and collect structured data from any website. 1. **[Extract](https://docs.Dorod Parser.dev/category/extract)** – Emulate real user behavior and collect structured data from any website.
* **[Recorder Mode](https://docs.maxun.dev/robot/extract/robot-actions)** - Record your actions as you browse; Maxun turns them into a reusable extraction robot. * **[Recorder Mode](https://docs.Dorod Parser.dev/robot/extract/robot-actions)** - Record your actions as you browse; Dorod Parser turns them into a reusable extraction robot.
* **[AI Mode](https://docs.maxun.dev/robot/extract/llm-extraction)** - Describe what you want in natural language and let LLM-powered extraction do the rest. * **[AI Mode](https://docs.Dorod Parser.dev/robot/extract/llm-extraction)** - Describe what you want in natural language and let LLM-powered extraction do the rest.
2. **[Scrape](https://docs.maxun.dev/robot/scrape/scrape-robots)** – Convert full webpages into clean Markdown or HTML and capture screenshots. 2. **[Scrape](https://docs.Dorod Parser.dev/robot/scrape/scrape-robots)** – Convert full webpages into clean Markdown or HTML and capture screenshots.
3. **[Crawl](https://docs.maxun.dev/robot/crawl/crawl-introduction)** - Crawl entire websites and extract content from every relevant page, with full control over scope and discovery. 3. **[Crawl](https://docs.Dorod Parser.dev/robot/crawl/crawl-introduction)** - Crawl entire websites and extract content from every relevant page, with full control over scope and discovery.
4. **[Search](https://docs.maxun.dev/robot/search/search-introduction)** - Run automated web searches to discover or scrape results, with support for time-based filters. 4. **[Search](https://docs.Dorod Parser.dev/robot/search/search-introduction)** - Run automated web searches to discover or scrape results, with support for time-based filters.
5. **[SDK](https://docs.maxun.dev/sdk/sdk-overview)** – A complete developer toolkit for scraping, extraction, scheduling, and end-to-end data automation. 5. **[SDK](https://docs.Dorod Parser.dev/sdk/sdk-overview)** – A complete developer toolkit for scraping, extraction, scheduling, and end-to-end data automation.
## How Does It Work? ## How Does It Work?
Maxun robots are automated tools that help you collect data from websites without writing any code. Think of them as your personal web assistants that can navigate websites, extract information, and organize data just like you would manually - but faster and more efficiently. Dorod Parser robots are automated tools that help you collect data from websites without writing any code. Think of them as your personal web assistants that can navigate websites, extract information, and organize data just like you would manually - but faster and more efficiently.
There are four types of robots, each designed for a different job. There are four types of robots, each designed for a different job.
### 1. Extract ### 1. Extract
Extract emulates real user behavior and captures structured data. Extract emulates real user behavior and captures structured data.
- <a href="/robot/extract/robot-actions">Recorder Mode</a> - Record your actions as you browse; Maxun turns them into a reusable extraction robot. - <a href="/robot/extract/robot-actions">Recorder Mode</a> - Record your actions as you browse; Dorod Parser turns them into a reusable extraction robot.
### Example: Extract 10 Property Listings from Airbnb ### Example: Extract 10 Property Listings from Airbnb
[https://github.com/user-attachments/assets/recorder-mode-demo-video](https://github.com/user-attachments/assets/c6baa75f-b950-482c-8d26-8a8b6c5382c3) [https://github.com/user-attachments/assets/recorder-mode-demo-video](https://github.com/user-attachments/assets/c6baa75f-b950-482c-8d26-8a8b6c5382c3)
@@ -62,41 +62,41 @@ Learn more <a href="/category/extract">here</a>.
### 2. Scrape ### 2. Scrape
Scrape converts full webpages into clean Markdown, HTML and can capture screenshots. Ideal for AI workflows, agents, and document processing. Scrape converts full webpages into clean Markdown, HTML and can capture screenshots. Ideal for AI workflows, agents, and document processing.
Learn more <a href="https://docs.maxun.dev/robot/scrape/scrape-robots">here</a>. Learn more <a href="https://docs.Dorod Parser.dev/robot/scrape/scrape-robots">here</a>.
### 3. Crawl ### 3. Crawl
Crawl entire websites and extract content from every relevant page, with full control over scope and discovery. Crawl entire websites and extract content from every relevant page, with full control over scope and discovery.
Learn more <a href="https://docs.maxun.dev/robot/crawl/crawl-introduction">here</a>. Learn more <a href="https://docs.Dorod Parser.dev/robot/crawl/crawl-introduction">here</a>.
### 4. Search ### 4. Search
Run automated web searches to discover or scrape results, with support for time-based filters. Run automated web searches to discover or scrape results, with support for time-based filters.
Learn more <a href="https://docs.maxun.dev/robot/search/search-introduction">here</a>. Learn more <a href="https://docs.Dorod Parser.dev/robot/search/search-introduction">here</a>.
## Quick Start ## Quick Start
### Getting Started ### Getting Started
The simplest & fastest way to get started is to use the hosted version: https://app.maxun.dev. You can self-host if you prefer! The simplest & fastest way to get started is to use the hosted version: https://app.Dorod Parser.dev. You can self-host if you prefer!
### Installation ### Installation
Maxun can run locally with or without Docker Dorod Parser can run locally with or without Docker
1. [Setup with Docker Compose](https://docs.maxun.dev/installation/docker) 1. [Setup with Docker Compose](https://docs.Dorod Parser.dev/installation/docker)
2. [Setup without Docker](https://docs.maxun.dev/installation/local) 2. [Setup without Docker](https://docs.Dorod Parser.dev/installation/local)
3. [Environment Variables](https://docs.maxun.dev/installation/environment_variables) 3. [Environment Variables](https://docs.Dorod Parser.dev/installation/environment_variables)
4. [SDK](https://github.com/getmaxun/node-sdk) 4. [SDK](https://github.com/getDorod Parser/node-sdk)
### Upgrading & Self Hosting ### Upgrading & Self Hosting
1. [Self Host Maxun With Docker & Portainer](https://docs.maxun.dev/self-host) 1. [Self Host Dorod Parser With Docker & Portainer](https://docs.Dorod Parser.dev/self-host)
2. [Upgrade Maxun With Docker Compose Setup](https://docs.maxun.dev/installation/upgrade#upgrading-with-docker-compose) 2. [Upgrade Dorod Parser With Docker Compose Setup](https://docs.Dorod Parser.dev/installation/upgrade#upgrading-with-docker-compose)
3. [Upgrade Maxun Without Docker Compose Setup](https://docs.maxun.dev/installation/upgrade#upgrading-with-local-setup) 3. [Upgrade Dorod Parser Without Docker Compose Setup](https://docs.Dorod Parser.dev/installation/upgrade#upgrading-with-local-setup)
## Sponsors ## Sponsors
<table> <table>
<tr> <tr>
<td width="229"> <td width="229">
<br/> <br/>
<a href="https://www.testmu.ai/?utm_source=maxun&utm_medium=sponsor" target="_blank"> <a href="https://www.testmuai.com/?utm_medium=sponsor&utm_source=Dorod Parser" target="_blank">
<img src="https://github.com/user-attachments/assets/6c96005b-85df-43e0-9b63-96aaca676c11" /><br/><br/> <img src="https://github.com/user-attachments/assets/6c96005b-85df-43e0-9b63-96aaca676c11" /><br/><br/>
<b>TestMu AI</b> <b>TestMu AI</b>
</a> </a>
@@ -109,24 +109,24 @@ Maxun can run locally with or without Docker
## Features ## Features
- ✨ **Extract Data With No-Code** – Point and click interface - вњЁ **Extract Data With No-Code** – Point and click interface
- ✨ **LLM-Powered Extraction** – Describe what you want; use LLMs to scrape structured data - вњЁ **LLM-Powered Extraction** – Describe what you want; use LLMs to scrape structured data
- ✨ **Developer SDK** – Programmatic extraction, scheduling, and robot management - вњЁ **Developer SDK** – Programmatic extraction, scheduling, and robot management
- ✨ **Handle Pagination & Scrolling** – Automatic navigation - вњЁ **Handle Pagination & Scrolling** – Automatic navigation
- ✨ **Run Robots On Schedules** – Set it and forget it - вњЁ **Run Robots On Schedules** – Set it and forget it
- ✨ **Turn Websites to APIs** – RESTful endpoints from any site - вњЁ **Turn Websites to APIs** – RESTful endpoints from any site
- ✨ **Turn Websites to Spreadsheets** – Direct data export to Google Sheets & Airtable - вњЁ **Turn Websites to Spreadsheets** – Direct data export to Google Sheets & Airtable
- ✨ **Adapt To Website Layout Changes** – Auto-recovery from site updates - вњЁ **Adapt To Website Layout Changes** – Auto-recovery from site updates
- ✨ **Extract Behind Login** – Handle authentication seamlessly - вњЁ **Extract Behind Login** – Handle authentication seamlessly
- ✨ **Integrations** – Connect with your favorite tools - вњЁ **Integrations** – Connect with your favorite tools
- ✨ **MCP Support** – Model Context Protocol integration - вњЁ **MCP Support** – Model Context Protocol integration
- ✨ **LLM-Ready Data** – Clean Markdown for AI applications - вњЁ **LLM-Ready Data** – Clean Markdown for AI applications
- ✨ **Self-Hostable** – Full control over your infrastructure - вњЁ **Self-Hostable** – Full control over your infrastructure
- ✨ **Open Source** – Transparent and community-driven - вњЁ **Open Source** – Transparent and community-driven
## Demos ## Demos
Maxun can be used for various use-cases, including lead generation, market research, content aggregation and more. Dorod Parser can be used for various use-cases, including lead generation, market research, content aggregation and more.
View demos here: https://www.maxun.dev/usecases View demos here: https://www.Dorod Parser.dev/usecases
## Note ## Note
This project is in early stages of development. Your feedback is very important for us - we're actively working on improvements. </a> This project is in early stages of development. Your feedback is very important for us - we're actively working on improvements. </a>
@@ -143,11 +143,11 @@ If you rely on this project commercially, please consider contributing back
or supporting its development. or supporting its development.
## Support Us ## Support Us
Star the repository, contribute if you love what we’re building, or [sponsor us](https://github.com/sponsors/amhsirak). Star the repository, contribute if you love what we’re building, or [sponsor us](https://github.com/sponsors/amhsirak).
## Contributors ## Contributors
Thank you to the combined efforts of everyone who contributes! Thank you to the combined efforts of everyone who contributes!
<a href="https://github.com/getmaxun/maxun/graphs/contributors"> <a href="https://github.com/getDorod Parser/Dorod Parser/graphs/contributors">
<img src="https://contrib.rocks/image?repo=getmaxun/maxun" /> <img src="https://contrib.rocks/image?repo=getDorod Parser/Dorod Parser" />
</a> </a>

2
maxun-core/package.json
View File

@@ -1,6 +1,6 @@
{ {
"name": "maxun-core", "name": "maxun-core",
"version": "0.0.30", "version": "0.0.31",
"description": "Core package for Maxun, responsible for data extraction", "description": "Core package for Maxun, responsible for data extraction",
"main": "build/index.js", "main": "build/index.js",
"typings": "build/index.d.ts", "typings": "build/index.d.ts",

10
package.json
View File

@@ -1,7 +1,7 @@
{ {
"name": "maxun", "name": "dorod-parser",
"version": "0.0.32", "version": "0.0.33",
"author": "Maxun", "author": "Dorod Parser",
"license": "AGPL-3.0-or-later", "license": "AGPL-3.0-or-later",
"dependencies": { "dependencies": {
"@anthropic-ai/sdk": "^0.71.2", "@anthropic-ai/sdk": "^0.71.2",
@@ -54,7 +54,7 @@
"lodash": "^4.17.21", "lodash": "^4.17.21",
"loglevel": "^1.8.0", "loglevel": "^1.8.0",
"loglevel-plugin-remote": "^0.6.8", "loglevel-plugin-remote": "^0.6.8",
"maxun-core": "^0.0.30", "Dorod Parser-core": "^0.0.31",
"minio": "^8.0.1", "minio": "^8.0.1",
"moment-timezone": "^0.5.45", "moment-timezone": "^0.5.45",
"node-cron": "^3.0.3", "node-cron": "^3.0.3",