Spring Batch commit-interval dynamic value

Question

I have a Spring batch job with standard reader , writer and processor

I have a simple requirement like below :

1)Whatever records reader reads all should be passed to writer by processing through processor

2)My reader reads records by SQL query So if reader reads 100 records , all should be passed to writer at once

3)If it reads 1000 records , all 1000 should be passed at once

4)So in essence , commit-interval is dynamic here and not fixed.

5)Is there any way we can achieve this ?

EDIT :

To give more clarity , in sprint batch , commit-interval plays a role of chunk oriented processing E.g : if chunk-size = 10 , reader reads 10 records , passes one record 1 by 1 to processor and at commit-interval (count = 10 ) , all records are written by writer .

Now what we want is dynamic commit-interval. Whatever is being read by reader , all will be passed to writer at once

Your question is not clear. What do you mean by "should be passed to writer at once"? Can you explain what are trying to achieve without referring to Spring Batch? — Mahmoud Ben Hassine
– Mahmoud Ben Hassine, Commented May 8, 2019 at 12:29
At which moment you will know commit-interval then? Only when performing SELECT query? — Igor Konoplyanko
– Igor Konoplyanko, Commented May 8, 2019 at 14:19
@Atul Could you please provide your solution how did you achieved to set commit-interval dynamically ? — Mahesh
– Mahesh, Commented Jul 31, 2021 at 16:54

Sushil Behera · Accepted Answer · 2019-05-08 15:40:02Z

0

Can be achieved using chunk-completion-policy property.

<step id="XXXXX">
            <tasklet>
                <chunk reader="XXXReader"
                       processor="XXXProcessor"
                       writer="XXXWriter"
                       chunk-completion-policy="defaultResultCompletionPolicy">
                </chunk>
            </tasklet>
        </step>

<bean id="defaultResultCompletionPolicy" class="org.springframework.batch.repeat.policy.DefaultResultCompletionPolicy" scope="step"/>

Also we can write custom chunk-completion policy

see this post

Spring Batch custom completion policy for dynamic chunk size

answered May 8, 2019 at 15:40

Sushil Behera

9757 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Spring Batch commit-interval dynamic value

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related