Scraping frequency

The automatic scheduling is set to weekly for every new project. You have to manually switch to another option while editing your project.

You can choose if you want to run a job manually or configure when your project should trigger jobs automatically. This is called "Scraping frequency". During project creation, you can find the dropdown for this option in the Output settings menu. Available options:

• Don't scrape now: No jobs will be triggered, only a project will be created. You can manually trigger a job from the project detail page. Read about this option here.

• Just scrape once: A job will start once you click on "Save project".

• Hourly, Daily, Weekly, Monthly: The first job will start once you click on "Save project". The following jobs will be automatically fired based on the frequency you chose.

• Cron: You can set up your frequency by using the cron expression. You can learn more about cron-expressions here.

You can also see when the next jobs are scheduled to run, based on the scraping frequency chosen in the settings.

Disable job frequency

When you set the scraping frequency to "Don't scrape now", the project will be in a "not scheduled" state and jobs won't start automatically. You can manually start a job any time from inside the project's detail page. For more information, see here.