Combine rows from 2 files and write to DB using Spring Batch

Question

I have File1.csv, with the columns id,name,age. File2.csv has the columns id,designation. In both the files ID refers to same value and is unique. Sample data File1.csv

id    name    age
101   abc     30
102   def     25

File2.csv

id     designation
101    manager
102    Assistant manager

Spring batch should read the files simultaneously, combine the data and write to DB as below

id   name    age   designation
101  abc     30     manager
102  def     25     Assistant manager

How to read 2 files simultaneously in spring batch?

Community · Accepted Answer · 2017-05-23 12:24:30Z

1

You have to implement a Reader that merges the two files togehter.

Have a look at my answer here Aggregating processor or aggregating reader

where I have linked to other answers to a similar question

edited May 23, 2017 at 12:24

CommunityBot

11 silver badge

answered Nov 23, 2016 at 10:20

Hansjoerg Wingeier

4,4845 gold badges19 silver badges25 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

user3510366 Over a year ago

Will this work for 2 files with different columns and are not in sorted order?

Hansjoerg Wingeier Over a year ago

No, that is not possible. You need to have an identifier column, which links the two elements together. And, because of the sequentiel reading, all sources must be ordered based in this id column. This also ensures the best possible performance that is attainable.

Collectives™ on Stack Overflow

Combine rows from 2 files and write to DB using Spring Batch

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related