Cline (as VS Code extension)
Prerequisites
ScraperAPI account
Cline account
VS Code
Cline extension installed on VS Code
Setup
If you don't have an account with us yet, head over to scraperapi.com to create one and grab your API key from the Dashboard area. You will need it to authenticate the requests that your LLM client will be making.
Configure Cline inside VS Code:
Open VS Code.
Click the Cline icon in the activity bar to open the Cline panel.
Click the
MCP Serversicon in the top navigation bar of the Cline panel.Select the "Configure" tab.
Click "Configure MCP Servers" at the bottom of the pane, this opens
cline_mcp_settings.json.Paste the JSON configuration file.
Parameters
scrape (required)
Tells the LLM to scrape a URL from the internet using ScraperAPI.
url (requierd)
URL you wish to scrape.
render (optional)
Defaults to False. Set to True if the page requires JavaScript rendering to display its contents.
country_code (optional)
Activate country geotargeting (e.g. “us”, “es”, “uk”, etc.).
premium (optional)
Set to True to use residential IPs with your scrapes.
ultra_premium (optional)
Activates advanced bypass mechanisms when set to True. Can not be combined with premium.
device_type (optional)
Defaults to desktop. Set to mobile to use mobile user agents with the scrapes.
output_format (optional)
Instructs the API on what the response file type should be. Defaul is HTML. Valid options: - markdown - text - json (for a list of domains)
autoparse (optional)
Boolean. Activate auto parsing for a list of supported domains. Defaults to False. Set to True only if you want the output format in csv or json.
Prompt Example
Get product data information from eBay
- "I need product information on the top 3 eBay (in US) results for 2nd hand 19' rims."
Response
Cline executed an eBay search through ScrperAPI by recognizing the request and invoking ScraperAPI's eBay Search SDE to retrieve product listings from eBay (United States). It then followed up by calling ScraperAPI's eBay Product SDE 3 times, to fetch detailed data for the top 3 products returned in the search results. ScraperAPI took care of the scraping workflow, so no extra user input or prompt changes were necessary. After collecting the search and product-level data, Cline summarized the results for all 3 product listings, showing price, seller details, condition, shipping and key specs.
Last updated