Creating a DataPipeline project

To create a new DataPipeline project, head over to the DataPipeline section of your account. From there, you can choose between different data collection types:

• Extract data from arbitrary websites and get raw HTML.

• Choose one of our Structured Data Endpoints and get well-structured JSON files or CSV as results.

• Get data in LLM-ready format like text and markdown, to effectively train LLMs on a large scale.

Available use-case specific project types:

Amazon	Ebay	Walmart	Google	Redfin
Product page data	Product page data	Product page data	Search page results	Single listing for sale
Search results	Search results	Category Pages	News results	Single listing for rent
Offers		Search Results	Job results	Listing search results
		Reviews	Shopping data	Agent Details
			Maps search results

Example Project

We have created an example project for each user to see the basic setup of a DataPipeline project. You can just leave it as it is or you can edit it and make your first own project out of it.

👉 Go to example project