Cursor
Prerequisites
ScraperAPI account
Cursor AI account
Cusor AI desktop app
Setup
If you don't have an account with us yet, head over to scraperapi.com to create one and grab your API key from the Dashboard area. You will need it to authenticate the requests that your LLM client will be making.
Configure Cursor Editor:
Open Cursor.
Access the Settings menu.
Open Cursor Settings.
Go to Tools & MCP section
Click + 'New MCP Server'.
Choose Manual and paste the contents of this JSON configuration file.
Parameters
scrape (required)
Tells the LLM to scrape a URL from the internet using ScraperAPI.
url (requierd)
URL you wish to scrape.
render (optional)
Defaults to False. Set to True if the page requires JavaScript rendering to display its contents.
country_code (optional)
Activate country geotargeting (e.g. “us”, “es”, “uk”, etc.).
premium (optional)
Set to True to use residential IPs with your scrapes.
ultra_premium (optional)
Activates advanced bypass mechanisms when set to True. Can not be combined with premium.
device_type (optional)
Defaults to desktop. Set to mobile to use mobile user agents with the scrapes.
output_format (optional)
Instructs the API on what the response file type should be. Defaul is HTML. Valid options: - markdown - text - json (for a list of domains)
autoparse (optional)
Boolean. Activate auto parsing for a list of supported domains. Defaults to False. Set to True only if you want the output format in csv or json.
Prompt Example
Get product data information from Amazon
- "Scrape Amazon for iPhone 16 and return the first 10 results."
Response
Cursor successfully executed an Amazon search through ScraperAPI by simply recognizing the word 'scrape' in the prompt, which acts as the trigger for invoking the ScraperAPI MCP tool. Cursor called ScraperAPI, which handled the request and scraped the data without getting blocked or requiring any additional input or prompt adjustments. All the underlying complexity, such as proxy rotation and anti-bot handling was managed by ScraperAPI, allowing the data to be reliably retrieved and transformed into useful information.
Last updated