> For the complete documentation index, see [llms.txt](https://docs.scraperapi.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.scraperapi.com/resources/release-notes/january-2026/scraperapi-crawler-v2.0-and-dashboard-ui-launch.md).

# ScraperAPI Crawler v2.0 & dashboard UI launch

### <mark style="background-color:$primary;">All-New Crawler UI</mark>

#### **Streamlined Crawler Workspace**

* **Centralized Management**: View all active and inactive crawlers in one place
* **Quick Status Overview**: Monitor job health, costs, and performance at a glance
* **Intuitive Navigation**: Easy access to create, configure, and manage crawlers

#### **Visual Job Monitoring**

* **Real-time Progress Tracking**: Watch your crawlers work with live updates
* **Interactive Job Tables**: Search, and filter through crawler job list
* **Detailed insights**: Cost tracking and success monitoring

#### **Simplified Crawler Setup**

* **Step-by-Step Configuration**: Guided process for creating new crawlers
* **Download job results** directly from the dashboard.

### <mark style="background-color:$primary;">What's New in Crawler v2.0</mark>

### **Key Improvements**

**Smarter, job-based crawling engine**

* Starts from a **single URL** and automatically **discovers and scrapes new pages** based on your rules.
* **Skips duplicate URLs** to avoid loops and wasted credits.
* Handles **failed requests gracefully** (failures don’t cost credits, and full reasons are included in job summaries).
* Automatically **stops at your credit budget or depth limit**, so you stay in control of cost and scope.
* **Streams page results in real time** to your webhook, plus delivers a **full job summary** when the crawl is done.
* **Flexible scheduling:** You can run a crawl once or schedule it hourly, daily, weekly, or monthly, all while keeping budget and depth controls in place.

Whether you’re crawling 10 pages or 10,000, Crawler 2.0 runs each job from start to finish and sends every page result to your webhook as it’s processed.

<a href="/pages/x7ppoMyIbpskmqaByd91" class="button primary" data-icon="book-open">Crawler 2.0 detailed documentation</a>


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://docs.scraperapi.com/resources/release-notes/january-2026/scraperapi-crawler-v2.0-and-dashboard-ui-launch.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.