Request LLM Output Formats with ScraperAPI in Java
Learn how to use ScraperAPI’s output parameter in Java to generate clean, structured text and markdown responses ideal for training large language models.
To properly train LLMs, a lot of high quality unbiased data is needed. There is a lot of public data that is relevant for LLMs, but at times, that data can be too noisy and too large. Luckily, we have a solution. One that gathers large-scale
data and cleans it by removing irrelevant or duplicate content. The result - structured format responses, that can be used to train LLMs effectively. Simply add the parameter output_format=text
or output_format=markdown
to the request structure. Here are some examples:
API REQUEST
try {
String apiKey = "API_KEY";
String url = "https://api.scraperapi.com?api_key=" + apiKey + "&output_format=OUTPUT_FORMAT&url=https://www.google.com/search?q=Carglass+GmbH+Halle+%28Saale%29+%28Stadtbezirk+Nord%29&hl=en";
URL urlForGetRequest = new URL(url);
String readLine = null;
HttpURLConnection connection = (HttpURLConnection) urlForGetRequest.openConnection();
connection.setRequestMethod("GET");
int responseCode = connection.getResponseCode();
if (responseCode == HttpURLConnection.HTTP_OK) {
BufferedReader in = new BufferedReader(new InputStreamReader(connection.getInputStream()));
StringBuffer response = new StringBuffer();
while ((readLine = in.readLine()) != null) {
response.append(readLine);
}
in.close();
System.out.println(response.toString());
} else {
throw new Exception("Error in API Call");
}
} catch (Exception ex) {
ex.printStackTrace();
}
}
}
ASYNC REQUEST
try {
String apiKey = "API_KEY";
String urlString = "https://async.scraperapi.com/jobs";
String jsonInputString = "{\"apiKey\": \"" + apiKey + "\", \"apiParams\": {\"output_format\": \"OUTPUT_FORMAT\"}, \"url\": \"https://www.google.com/search?q=Carglass+GmbH+Halle+%28Saale%29+%28Stadtbezirk+Nord%29&hl=en\"}";
URL url = new URL(urlString);
HttpURLConnection connection = (HttpURLConnection) url.openConnection();
connection.setRequestMethod("POST");
connection.setRequestProperty("Content-Type", "application/json");
connection.setDoOutput(true);
try (OutputStream os = connection.getOutputStream()) {
byte[] input = jsonInputString.getBytes("utf-8");
os.write(input, 0, input.length);
}
int responseCode = connection.getResponseCode();
BufferedReader in = new BufferedReader(new InputStreamReader(connection.getInputStream()));
String inputLine;
StringBuilder response = new StringBuilder();
while ((inputLine = in.readLine()) != null) {
response.append(inputLine);
}
in.close();
System.out.println("Response Code: " + responseCode);
System.out.println("Response: " + response.toString());
} catch (Exception e) {
e.printStackTrace();
}
}
}
PROXY MODE - COMING SOON!
Sample Response
Markdown:
# Accessibility Links
Skip to main content[Accessibility help](https://support.google.com/websearch/answer/181196?hl=en)
Accessibility feedback
[](https://www.google.com/webhp?hl=en&ictx=0&sa=X&ved=0ahUKEwjxgcn7ov2KAxVake4BHQb0DYwQpYkNCAo)
Press / to jump to the search box
Carglass GmbH Halle (Saale) (Stadtbezirk Nord)
[Sign in](https://accounts.google.com/ServiceLogin?hl=en&passive=true&continue=https://www.google.com/search%3Fq%3DCarglass%2BGmbH%2BHalle%2B%28Saale%29%2B%28Stadtbezirk%2BNord%29%26hl%3Den&ec=GAZAAQ)
# Filters and Topics
All
[Images](/search?sca%5Fesv=bca4d6818df5eb0f&hl=en&q=Carglass+GmbH+Halle+%28Saale%29+%28Stadtbezirk+Nord%29&udm=2&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w%5FkfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns%5F0jgvLA1%5FkZTbFN-119W9tHwJnaFRmMV8%5FhusR1diKA9zwo5dnLUwQE5gzw&sa=X&ved=2ahUKEwjxgcn7ov2KAxVake4BHQb0DYwQtKgLegQIExAB)
[Jobs](/search?sca%5Fesv=bca4d6818df5eb0f&hl=en&q=Carglass+GmbH+Halle+%28Saale%29+%28Stadtbezirk+Nord%29&udm=8&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w%5FkfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns%5F0jgvLA1%5FkZTbFN-119W9tHwJnaFRmMV8%5FhusR1diKA9zwo5dnLUwQE5gzw&sa=X&ved=2ahUKEwjxgcn7ov2KAxVake4BHQb0DYwQs6gLegQIDxAB)
[Maps](https://maps.google.com/maps?sca%5Fesv=bca4d6818df5eb0f&hl=en&output=search&q=Carglass+GmbH+Halle+%28Saale%29+%28Stadtbezirk+Nord%29&source=lnms&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w%5FkfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns%5F0jgvLA1%5FkZTbFN-119W9tHwJnaFRmMV8%5FhusR1diKA9zwo5dnLUwQE5gzw&entry=mc&ved=1t:200715&ictx=111)
[Shopping](/search?sca%5Fesv=bca4d6818df5eb0f&hl=en&q=Carglass+GmbH+Halle+%28Saale%29+%28Stadtbezirk+Nord%29&udm=28&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w%5FkfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns%5F0jgvLA1%5FkZTbFN-119W9tHwJnaFRmMV8%5FhusR1diKA9zwo5dnLUwQE5gzw&ved=1t:220175&ictx=111)
[Forums](/search?sca%5Fesv=bca4d6818df5eb0f&hl=en&q=Carglass+GmbH+Halle+%28Saale%29+%28Stadtbezirk+Nord%29&udm=18&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w%5FkfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns%5F0jgvLA1%5FkZTbFN-119W9tHwJnaFRmMV8%5FhusR1diKA9zwo5dnLUwQE5gzw&sa=X&ved=2ahUKEwjxgcn7ov2KAxVake4BHQb0DYwQs6gLegQIDBAB)
[Videos](/search?sca%5Fesv=bca4d6818df5eb0f&hl=en&q=Carglass+GmbH+Halle+%28Saale%29+%28Stadtbezirk+Nord%29&udm=7&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w%5FkfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns%5F0jgvLA1%5FkZTbFN-119W9tHwJnaFRmMV8%5FhusR1diKA9zwo5dnLUwQE5gzw&sa=X&ved=2ahUKEwjxgcn7ov2KAxVake4BHQb0DYwQtKgLegQICxAB)
More
About 269 results (0.29 seconds)
Results for Halle (Saale)-Stadtbezirk Nord
∙ [Choose area](#)
# Search Results
# Main Results
.................
Text:
Please click here [/httpservice/retry/enablejs?sei=rZeKZ9COCOTAkPIP0p26oQk] if you are not redirected within a few seconds.
ACCESSIBILITY LINKS
Skip to main contentAccessibility help [https://support.google.com/websearch/answer/181196?hl=en]
Accessibility feedback
https://www.google.com/webhp?hl=en&sa=X&ved=0ahUKEwiQmZaHqP2KAxVkIEQIHdKOLpQQPAgI
https://www.google.com/webhp?hl=en&ictx=0&sa=X&ved=0ahUKEwiQmZaHqP2KAxVkIEQIHdKOLpQQpYkNCAo
Press / to jump to the search box
Carglass GmbH Halle (Saale) (Stadtbezirk Nord)
https://www.google.com/intl/en/about/products?tab=wh
Sign in [https://accounts.google.com/ServiceLogin?hl=en&passive=true&continue=https://www.google.com/search%3Fq%3DCarglass%2BGmbH%2BHalle%2B(Saale)%2B(Stadtbezirk%2BNord)%26hl%3Den&ec=GAZAAQ]
FILTERS AND TOPICS
All
Images
[/search?sca_esv=204cf606c36776c7&hl=en&q=Carglass+GmbH+Halle+(Saale)+(Stadtbezirk+Nord)&udm=2&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w_kfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns_0jgvLA1_kZTbFN-119W9tHwJnaFRmMV8_husR1diKA9zwo5dnLUwQE5gzw&sa=X&ved=2ahUKEwiQmZaHqP2KAxVkIEQIHdKOLpQQtKgLegQIEBAB]
Jobs
[/search?sca_esv=204cf606c36776c7&hl=en&q=Carglass+GmbH+Halle+(Saale)+(Stadtbezirk+Nord)&udm=8&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w_kfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns_0jgvLA1_kZTbFN-119W9tHwJnaFRmMV8_husR1diKA9zwo5dnLUwQE5gzw&sa=X&ved=2ahUKEwiQmZaHqP2KAxVkIEQIHdKOLpQQs6gLegQIDxAB]
Maps
[https://maps.google.com/maps?sca_esv=204cf606c36776c7&hl=en&output=search&q=Carglass+GmbH+Halle+(Saale)+(Stadtbezirk+Nord)&source=lnms&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w_kfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns_0jgvLA1_kZTbFN-119W9tHwJnaFRmMV8_husR1diKA9zwo5dnLUwQE5gzw&entry=mc&ved=1t:200715&ictx=111]
Shopping
[/search?sca_esv=204cf606c36776c7&hl=en&q=Carglass+GmbH+Halle+(Saale)+(Stadtbezirk+Nord)&udm=28&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w_kfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns_0jgvLA1_kZTbFN-119W9tHwJnaFRmMV8_husR1diKA9zwo5dnLUwQE5gzw&ved=1t:220175&ictx=111]
Forums
[/search?sca_esv=204cf606c36776c7&hl=en&q=Carglass+GmbH+Halle+(Saale)+(Stadtbezirk+Nord)&udm=18&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w_kfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns_0jgvLA1_kZTbFN-119W9tHwJnaFRmMV8_husR1diKA9zwo5dnLUwQE5gzw&sa=X&ved=2ahUKEwiQmZaHqP2KAxVkIEQIHdKOLpQQs6gLegQIDBAB]
Videos
[/search?sca_esv=204cf606c36776c7&hl=en&q=Carglass+GmbH+Halle+(Saale)+(Stadtbezirk+Nord)&udm=7&fbs=AEQNm0Aa4sjWe7Rqy32pFwRj0UkWd8nbOJfsBGGB5IQQO6L3J3BiN9fdhXvF2hIZnLYPFIpnRllAApQe54Ndkz8NZ2uq4JyeAShsPLKuiQt4w_kfDQb0vUvpRZ-tfSALXX7LTuUZ0j3vFCOGbXWbwDt55wNBVTSGsIdQjns_0jgvLA1_kZTbFN-119W9tHwJnaFRmMV8_husR1diKA9zwo5dnLUwQE5gzw&sa=X&ved=2ahUKEwiQmZaHqP2KAxVkIEQIHdKOLpQQtKgLegQIChAB]
More
About 269 results (0.29 seconds)
Results for
Halle (Saale)-Stadtbezirk Nord
∙ Choose area
SEARCH RESULTS
MAIN RESULTS
Last updated
Was this helpful?