Ctrlk
For the complete documentation index, see llms.txt. This page is also available as Markdown.

Claude Code

Prerequisites

  • ScraperAPI account

  • Claude Code installed

  • Claude account

Setup

If you don't have an account with us yet, head over to scraperapi.com to create one and grab your API key from the Dashboard area. You will need it to authenticate the requests that your LLM client will be making.

Configuration for Claude Code:

Add the server manually to your .claude/settings.json by pasting the contents below

//This config uses ScraperAPI's remote MCP server, no local setup required"
{
  "mcpServers": {
    "ScraperAPIRemote": {
      "command": "npx",
      "args": [
        "mcp-remote",
        "https://mcp.scraperapi.com/mcp",
        "--header",
        "Authorization: Bearer {YOUR_API_KEY}"
      ]
    }
  }
}
claude mcp add scraperapi -- npx mcp-remote https://mcp.scraperapi.com/mcp --header "Authorization: Bearer {YOUR_API_KEY}"

Parameters

scrape (required)

Tells the LLM to scrape a URL from the internet using ScraperAPI.

url (requierd)

URL you wish to scrape.

render (optional)

Defaults to False. Set to True if the page requires JavaScript rendering to display its contents.

country_code (optional)

Activate country geotargeting (e.g. “us”, “es”, “uk”, etc.).

premium (optional)

Set to True to use residential IPs with your scrapes.

ultra_premium (optional)

Activates advanced bypass mechanisms when set to True. Can not be combined with premium.

device_type (optional)

Defaults to desktop. Set to mobile to use mobile user agents with the scrapes.

output_format (optional)

Instructs the API on what the response file type should be. Defaul is HTML. Valid options: - markdown - text - json (for a list of domains)

autoparse (optional)

Boolean. Activate auto parsing for a list of supported domains. Defaults to False. Set to True only if you want the output format in csv or json.

Prompt Example

Ger proerpty listing details from Redfin

- "Get the prices of all properties listed on the first page of Redfin results for Queens."

Response

The task was to get property prices from the first page of Redfin results for Queens, NY. The ScraperAPI MCP skill provides a dedicated redfin_search tool for exactly this. It returns structured listing data (price, address, beds/baths, etc.) directly without needing to scrape and parse raw HTML. Claude correctly selected the redfin_search tool:

"41 listings total (2 were ads, excluded). Queens-specific listings are marked with (Queens). Redfin's Queens search page surfaces results from across the broader NYC metro area. Prices range from $182,367 (Bronx co-op) to $8,900,000 (Manhattan townhouse)."

RedfinQueensListings.md
PreviousMCP ServerNextClaude Desktop

Last updated