n8n IntegrationMCP ServerScraperAPI Crawler v2.0LangChain + ScraperAPIRelease Notes

Google News API

Scrape Google News headlines into structured JSON/CSV with ScraperAPI in Java. Monitor trending topics, gather media coverage, and analyse real-time news sentiment.

This endpoint will retrieve news data from an Google news result page and transform it into usable JSON or CSV.

try {
String apiKey = "APIKEY";
String query = "QUERY";
String country_code = "COUNTRY_CODE";
String tld = "TLD";
String url = "https://api.scraperapi.com/structured/google/news?api_key=" + apiKey + "&query=" + QUERY + "&country_code=" + COUNTRY_CODE + "&tld=" + tld;
URL urlForGetRequest = new URL(url);
String readLine = null;
HttpURLConnection conection = (HttpURLConnection) urlForGetRequest.openConnection();
conection.setRequestMethod("GET");
int responseCode = conection.getResponseCode();
if (responseCode == HttpURLConnection.HTTP_OK) {
BufferedReader in = new BufferedReader(new InputStreamReader(conection.getInputStream()));
StringBuffer response = new StringBuffer();
while ((readLine = in.readLine()) != null) {
response.append(readLine);
}
in.close();
System.out.println(response.toString());
} else {
throw new Exception("Error in API Call");
}
} catch (Exception ex) {
ex.printStackTrace();
}

Parameters
Details

API_KEY(required)

User's normal API Key

QUERY(required)

Query keywords that a user wants to search for e.g. local news

COUNTRY_CODE

Where a google domain needs to be scraped from another country (e.g. scraping google.com from Canada to get Canadian results), specify the TLD as well as the COUNTRY_CODE parameters. Valid values are valid TLDs (e.g. “.com.au”, “.es”, etc.).

TLD

Country of Google domain to scrape. This is an optional argument and defaults to “us” (google.com). Valid values include:

us: 'google.com',

uk: 'google.co.uk',

ca: 'google.ca',

de: 'google.de',

es: 'google.es',

fr: 'google.fr',

it: 'google.it',

jp: 'google.co.jp',

in: 'google.in',

cn: 'google.cn',

sg: 'google.com.sg',

mx: 'google.com.mx',

ae: 'google.ae',

br: 'google.com.br',

nl: 'google.nl',

au: 'google.com.au',

tr: 'google.com.tr',

sa: 'google.sa',

se: 'google.se',

pl: 'google.pl'

OUTPUT_FORMAT

For structured data methods we offer CSV and JSON output. JSON is default if parameter is not added. Options:

  • csv

  • json

Google Parameters supported by this endpoint

Google Parameters
Details

UULE

Set a region for a search. For example: w+CAIQICINUGFyaXMsIEZyYW5jZQ. You can find an online UULE generator here.

NUM

Number of results

HL

Host Language. For example: DE

GL

Boosts matches whose country of origin matches the parameter value. For example: DE

TBS

Limits results to a specific time range. For example: tbs=d returns results from the past day. Possible values: tbs=h - Hour

tbs=d - Day

tbs=w - Week

tbs=m - Month

tbs=y - Year

IE

Character encoding how the engine interpret the query string. For example: UTF8

OE

Character encoding used for the results. For example: UTF8

START

Set the starting offset in the result list. When start=10 set the first element in the result list will be the 10th search result. (meaning it starts with page 2 of results if the "num" is 10)

Sample Response

PreviousGoogle SERP APINextGoogle Jobs API

Last updated

Was this helpful?