When creating a job to populate a database in Catchr, you can choose a field to partition the data.
In most cases (99% of the time), this field should be the date.
Partitioning informs Catchr which rows already exist, allowing data to be updated instead of duplicated.
What happens if no partition field is selected?
If you don’t select a partition field:
Catchr cannot update existing records.
Each job run will append new rows, leading to duplicates.
How to fix this?
Select the appropriate partition field (usually the date) when setting up your job. This ensures:
Data is correctly updated.
No duplicates appear in your database.
If your job already exists, we recommend creating a new one. It will also create a new table in the database to get a fresh start.