LogoLogo
OverviewRelease NotesDataPipelineFAQs
Python
Python
  • Make Requests with ScraperAPI in Python
    • Use ScraperAPI Endpoint in Python
    • Use ScraperAPI Proxy Port in Python
    • Use ScraperAPI SDK in Python
    • Make Async Requests with ScraperAPI in Python
      • How to Use ScraperAPI Async Web Scraping in Python
      • Use Async ScraperAPI Callbacks in Python
      • Configure ScraperAPI Parameters in Python
      • Request Async Batch Scraping with ScraperAPI in Python
      • Decode Base64 Async Responses in Python
    • ScraperAPI Structured Data Collection in Python
      • Amazon Product Page API: Structured Data in Python
      • Amazon Search API: Structured Data in Python
      • Amazon Offers API: Structured Data in Python
      • Amazon Reviews API: Structured Data in Python
      • Ebay Product Page API: Structured Data in Python
      • Ebay Search API: Structured Data in Python
      • Google SERP API: Structured Data in Python
      • Google News API: Structured Data in Python
      • Google Jobs API: Structured Data in Python
      • Google Shopping API: Structured Data in Python
      • Google Maps Search API: Structured Data in Python
      • Redfin Agent Details API: Structured Data in Python
      • Redfin 'For Rent' Listings API: Structured Data in Python
      • Redfin 'For Sale' Listings API: Structured Data in Python
      • Redfin Listing Search API: Structured Data in Python
      • Walmart Search API: Structured Data in Python
      • Walmart Category API: Structured Data in Python
      • Walmart Product API: Structured Data in Python
      • Walmart Reviews API: Structured Data in Python
    • ScraperAPI Async Structured Data Collection in Python
      • Amazon Product Page API: Async Structured Data in Python
      • Amazon Search API: Async Structured Data in Python
      • Amazon Offers API: Async Structured Data in Python
      • Amazon Reviews API: Async Structured Data in Python
      • Ebay Product Page API: Async Structured Data in Python
      • Ebay Search API: Async Structured Data in Python
      • Google SERP API: Async Structured Data in Python
      • Google News API: Async Structured Data in Python
      • Google Jobs API: Async Structured Data in Python
      • Google Shopping API: Async Structured Data in Python
      • Google Maps Search API: Async Structured Data in Python
      • Redfin Agent Details API: Async Structured Data in Python
      • Redfin 'For Rent' Listings API: Async Structured Data in Python
      • Redfin 'For Sale' Listings API: Async Structured Data in Python
      • Redfin Listing Search API: Async Structured Data in Python
      • Walmart Search API: Async Structured Data in Python
      • Walmart Category API: Async Structured Data in Python
      • Walmart Product API: Async Structured Data in Python
      • Walmart Reviews API: Async Structured Data in Python
    • Making POST/PUT Requests with ScraperAPI in Python
    • Customizing ScraperAPI Requests in Python
      • Customize Amazon Requests by ZIP Code via ScraperAPI in Python
      • Customize Cached Results via ScraperAPI in Python
      • Customize Control Costs with ScraperAPI Parameter in Python
      • Send Custom Headers with ScraperAPI in Python
      • Customize Device Type with ScraperAPI in Python
      • Customize Geotargeted Content Scrape via ScraperAPI in Python
      • Customize Premium Geotargeted Scrape via ScraperAPI in Python
      • Customize Header Parameter with ScraperAPI in Python
      • Customize Premium Residential/Mobile Proxies in Python
      • Customize JavaScript-Rendered Pages via ScraperAPI in Python
        • Use Render Instruction Set to Scrape Dynamic Pages in Python
        • Customize Taking a Website Screenshots via ScraperAPI in Python
      • Customize Scrape Session-Based Proxies via ScraperAPI in Python
  • Handle and Process Responses via ScraperAPI in Python
    • Use API Status Codes to Retry Failed Requests in Python
    • Customize Output Formats via ScraperAPI Parameters in Python
      • Request JSON Response via Autoparse Parameter in Python
      • Request LLM Output Formats with ScraperAPI in Python
    • Request Response Encoding and Content-Type via ScraperAPI in Python
  • Dashboard & Billing
    • API Key
    • Credit Usage
    • Delete Account
    • Invoice History
    • Billing Email
    • Billing Adress
    • VAT Number
    • Payment Method
    • Cancel Subscription
  • Credits and Requests
  • Monitor Your ScraperAPI Account Information in Python
  • Documentation Overview
Powered by GitBook

Quick links

  • Homepage
  • Dashboard
  • Pricing
  • Contact Sales

Resources

  • Developer Guides
  • Blog
  • Learning Hub
  • Contact Support
On this page

Was this helpful?

  1. Make Requests with ScraperAPI in Python

Customizing ScraperAPI Requests in Python

Learn how to customize ScraperAPI requests in Python with JavaScript rendering, geotargeting, sessions, headers, parsing, and output format. Maximize scraping flexibility.

Last updated 4 months ago

Was this helpful?

Customize API Functionality

ScraperAPI enables you to customize the API’s functionality by adding additional parameters to your requests. The API will accept the following parameters:

Parameter
Description

render

Activate javascript rendering by setting render=true in your request. The API will automatically render the javascript on the page and return the HTML response after the javascript has been rendered.

Requests using this parameter cost 10 API credits, or 75 if used in combination with ultra-premium ultra_premium=true.

screenshot

Gves you the ability to take a screenshot of the target page through the use of the parameter screenshot=true. This parameter automatically enables JS rendering to get the full page content, before taking a screenshot.

country_code

Activate country geotargeting by setting country_code=us to use US proxies for example.

This parameter does not increase the cost of the API request.

premium

Activate premium residential and mobile IPs by setting premium=true. Using premium proxies costs 10 API credits, or 25 API credits if used in combination with Javascript rendering render=true. (Can not be combined withUltra_Premium)

session_number

Reuse the same proxy by setting session_number=123 for example.

This parameter does not increase the cost of the API request. (Can not be combined with Premium/Ultra_Premium)

binary_target

Helpful when trying to scrape files or images. This tells our API that the target is a file.

keep_headers

Use your own custom headers by setting keep_headers=true along with sending your own headers to the API.

This parameter does not increase the cost of the API request.

device_type

Set your requests to use mobile or desktop user agents by setting device_type=desktop or device_type=mobile.

This parameter does not increase the cost of the API request.

autoparse

Activate auto parsing for select websites by setting autoparse=true. The API will parse the data on the page and return it in JSON format.

This parameter does not increase the cost of the API request.

ultra_premium

Activate our advanced bypass mechanisms by setting ultra_premium=true.

Requests using this parameter cost 30 API credits, or 75 if used in combination with javascript rendering. (Can not be combined with Premium)

output_format

The output_format parameter allows you to instruct the API on what the response file type should be. Valid options:

  • markdown

  • text

valid options:

  • json

  • csv

  • markdown

  • text

SDEs