Custom Headers

Important note: Only use this feature if you need to send custom headers to retrieve specific results from the website. Within the API we have a sophisticated header management system designed to increase success rates and performance on difficult sites. When you send your own custom headers you override our header system, which oftentimes lowers your success rates. Unless you absolutely need to send custom headers to get the data you need, we advise that you don’t use this functionality.

If you would like to use your own custom headers (user agents, cookies, etc.) when making a request to the website, simply set keep_headers=true and send the API the headers you want to use. The API will then use these headers when sending requests to the website.

If you need to get results for mobile devices, use the device_type parameter to set the user-agent header for your request, instead of setting your own.

• API REQUEST

import fetch from 'node-fetch';

options = {
method: 'GET',
url: 'http://api.scraperapi.com/?api_key=APIKEY&url=http://httpbin.org/anything&keep_headers=true',
headers: {
Accept: 'application/json',
'X-MyHeader': '123',
},
}
fetch(options)
.then(response => {
console.log(response)
})
.catch(error => {
console.log(error)
})

• PROXY MODE

const axios = require('axios');

axios.get('http://httpbin.org/ip', {
  method: 'GET',
  proxy: {
    host: 'proxy-server.scraperapi.com',
    port: 8001,
    auth: {
      user: 'scraperapi.keep_headers=true',
      password: 'APIKEY'  
    },
    protocol: 'http'
  },
  headers: {
Accept: 'application/json',
'X-MyHeader': '123',
},

})
  .then(response => {
    console.log(response)
  })
  .catch(error => {
    console.log(error)
  });

• SDK Method

// remember to install the library: npm install scraperapi-sdk --save
const scraperapiClient = require('scraperapi-sdk')('APIKEY')
scraperapiClient.get('http://httpbin.org/anything', {headers: {'X-MyHeader': '123'}})
.then(response => {
  console.log(response)
})
.catch(error => {
  console.log(error)
})