Why are my database records duplicated instead of updated?

When creating a job to populate a database in Catchr, you can choose a field to partition the data.

• In most cases (99% of the time), this field should be the date.

• Partitioning informs Catchr which rows already exist, allowing data to be updated instead of duplicated.

What happens if no partition field is selected?

If you don’t select a partition field:

• Catchr cannot update existing records.

• Each job run will append new rows, leading to duplicates.

How to fix this?

Select the appropriate partition field (usually the date) when setting up your job. This ensures:

• Data is correctly updated.

• No duplicates appear in your database.

• If your job already exists, we recommend creating a new one. It will also create a new table in the database to get a fresh start.