Windsurf
Prerequisites
ScraperAPI account
Windsurf account
Windsurf desktop app
Setup
If you don't have an account with us yet, head over to scraperapi.com to create one and grab your API key from the Dashboard area. You will need it to authenticate the requests that your LLM client will be making.
Configure Windsurf:
Open Windsurf.
Head over to the Settings menu.
Click on the Cascades tab.
Click on MCP Server Marketplace.
Click on the gear icon next to Installed MCPs, the
mcp_config.jsonfile will open.Choose Manual and paste the contents of this JSON configuration file.
Parameters
scrape (required)
Tells the LLM to scrape a URL from the internet using ScraperAPI.
url (requierd)
URL you wish to scrape.
render (optional)
Defaults to False. Set to True if the page requires JavaScript rendering to display its contents.
country_code (optional)
Activate country geotargeting (e.g. “us”, “es”, “uk”, etc.).
premium (optional)
Set to True to use residential IPs with your scrapes.
ultra_premium (optional)
Activates advanced bypass mechanisms when set to True. Can not be combined with premium.
device_type (optional)
Defaults to desktop. Set to mobile to use mobile user agents with the scrapes.
output_format (optional)
Instructs the API on what the response file type should be. Defaul is HTML. Valid options: - markdown - text - json (for a list of domains)
autoparse (optional)
Boolean. Activate auto parsing for a list of supported domains. Defaults to False. Set to True only if you want the output format in csv or json.
Prompt Example
Get Walmart product data for competitive analysis
- "I want to get data from Walmart to see how my competitors are pricing their products. Show me the top 10 results for 'breakfast cereal'. I want name, price, size and any available shipping information."
Response
Windsurf fetched the Walmart product information via ScraperAPI's dedicated Walmart Search and Product API endpoints. It first called the Search endpoint to retrieve the top results for the specified keyword, then used the returned product IDs to call the Product endpoint and extract detailed information such as name, price, size, and available shipping data.
Last updated