Configure Batching¶

Batch processing, or batching, is the processing of transactions in a group or batch. In Vinyl, batching is an optional feature that can be used when processing very large sets of data through CRUD Rules in the Business Layer. One of the benefits to using batching is that it can prevent deadlocks by freeing the connection to the Table / Database on both the source and target sides.

By default, batching is not enabled in Vinyl and must be manually configured.

General Guidelines for Batching:¶

• Source Batch Size value must be less than 32000
• If the data is changing from under you, (i.e., hundreds of people are adding/removing records while your batch is running) the CRUD Action should use CRAM rather than Insert

To Enable Batching on a CRUD Rule¶

1. Navigate to the CRUD Rule in the Business Layer
2. Click on More > Edge Case
3. Enter a numeric value into Source Batch Size. This value represents the number of records to be included in a single batch. For example: 1000

4. Select the appropriate Batch mode setting:

   • Cycle through rows should be selected when the result set will not change after the CRUD Rule executes.
     • For example: You want to update a column A of every row that has a Column B = 3, that source will not change throughout (running the results before and after will yield the same results), so you can cycle through the rows.
   • Consume rows should be selected when the result set changes after the CRUD Rule executes.
     • For example: You want to update all rows with Column B = 3 to have a value of 2 on that same row, that means after the first batch runs the result set will change, so you have to consume rows instead.