Track Prices

DataPipeline is ScraperAPI's no-code dashboard for scheduled scraping. In this tutorial, you will use DataPipeline to monitor prices across Amazon and Walmart on a recurring schedule. By the end, you will have structured JSON with pricing, availability, and offers for every product you monitor, refreshed on your schedule, so you can spot price changes and stock issues before they hit your margins.

Step 1: Create the Amazon project

Click DataPipeline in the left sidebar.

Select New project.
Select Amazon product pages.

Step 2: Configure input settings

Under Input settings, choose List and enter your ASINs, one per line:

B0BFC7WQ6R
B09B8V1LZ3

For larger catalogs, switch to Upload file and upload a CSV with one ASIN per row.

Step 3: Configure output settings

Under Output settings, choose Download. Results will be available in the dashboard when the job completes. For larger setups, you can enter a Webhook URL to have results posted to your server automatically.

Step 4: Set scraping frequency

Under Scraping frequency, select Just scrape once. To monitor prices on a recurring basis, switch this to Daily, Weekly, or another interval. Recurring schedules require a paid plan.

Step 5: Review and start

Click Review & start scraping. The Job summary panel shows the estimated credit cost before you confirm.

Step 6: Create the Walmart project

Repeat the same steps for Walmart:

Click New project and select Walmart product.
Under Input settings, choose List and enter your Walmart product IDs, one per line:
```
946796118
741412707
```
Under Output settings, choose Download.
Under Scraping frequency, select Just scrape once.
Click Review & start scraping.

Step 7: Review results

Click into each project after the run completes and click Download results. Results are retained for 30 days.

Compare against your price thresholds to flag changes.

Additional options

Under Additional options & filters you can fine-tune your requests:

Country code: targets a specific country's Amazon or Walmart results.
Domain: sets the Amazon domain to search (e.g. co.uk, com.au).
Activate retrying 404 responses: retries requests that return a 404 instead of treating them as final.

Some parameters increase the cost per request. Check the Cost per Job panel before committing to a configuration at scale.

Prefer to set this up in your own codebase? Try the API playground instead.