Making Requests
Using ScraperAPI is easy. Just send the URL you would like to scrape to the API along with your API key and the API will return the HTML response from the URL you want to scrape.
ScraperAPI uses API keys to authenticate requests. To use the API you need to sign up for an account and include your unique API key in every request.
If you haven’t signed up for an account yet, then sign up for a free trial here with 5,000 free API credits!
You can use the API to scrape web pages, API endpoints, images, documents, PDFs, or other files just as you would any other URL. Note: there is a 2MB limit per request.
There are five ways in which you can send GET requests to ScraperAPI:
- Via our Async Scraper service
http://async.scraperapi.com - Via our API endpoint
http://api.scraperapi.com? - Via one of our SDKs (only available for some programming languages)
- Via our proxy port
http://scraperapi:[email protected]:8001 - Via our Structured Data service
https://api.scraperapi.com/structured/
Choose whichever option best suits your scraping requirements.
Important note: regardless of how you invoke the service, we highly recommend you set a 60 seconds timeout in your application to get the best possible success rates, especially for some hard-to-scrape domains.
Last modified 3mo ago