View Jitterbit Developer Portal
If your source records may contain duplicates, and you want to process only the first record and filter out the duplicates, you can accomplish this using scripts and a condition. This process is also referred to as deduplication. Once you have your Transformation in place, identify the field you want to use to check for duplicates. Select Add Condition. This adds another item at the very top of your target fields called Condition. Double-click this Field to display the Formula Builder box. Input this formula into the script section: The Get function will use the value in the field Email to retrieve the dynamic variable that we created in the previous steps and check if the variable has a value of 1. If it does, it will skip over the record; otherwise, it will continue with the insertion. Click OK to save. Our completed sample transformation should looks like this: Once you have completed the steps outlined above, you will be able to run your transformation, and the duplicates will not be processed. Set(Email, "1");
Email
If(Get(Email)==1, False, True)