Parallel processing of List in java

Question

I have a list of objects with list size of 500K. Each object in the list have a unique identifier. I want to validate the list for any duplicate objects(having the same identifier) and mark them with a flag. Since there are lot of elements in the list, the processing takes quite long time and i am not able to achieve within allotted time frame.

Is there any way to process the list in parallel(Using java Future/Callable)?

Thanks in advance. Mayuran

If identifier is the only criteria for 2 objects being equal, then why don't you override equals() and hashCode() and use a Set ? — TheLostMind
– TheLostMind, Commented Oct 14, 2014 at 5:58
@subhrajyoti Majumder, If i divide the list, how can i check for duplicate? The duplicate object may be in the another divided list — Mayuran
– Mayuran, Commented Oct 14, 2014 at 6:03

NPE · Accepted Answer · 2014-10-14 06:00:36Z

3

I don't know what your definition of a long time is, but 500K object is not a lot. Most likely your algorithm is quite inefficient. Rather than relying on parallelisation (how would you parallelise this anyway?), consider using a better data structure/algorithm for this.

HashMap or HashSet should work quite well for this.

answered Oct 14, 2014 at 6:00

NPE

503k114 gold badges970 silver badges1k bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Mayuran Over a year ago

Thanks, but each object has to go through lot of validation scenarios. So validation for each object takes some time. So that i want to process in parallel

NPE Over a year ago

@Mayuran: That's not what your questions says. You might want to work on improving the clarity of the question then.

Collectives™ on Stack Overflow

Parallel processing of List in java

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related