How to split a string array into a new string array with remove duplicate

Question

I have a string and I don't know its count of items. I want to split this string array into a new array. After that I need to remove duplicate items as in the example below.

For example in the below: the word "hi" and "friends" goes twice, but we write them once in second array, it doesn't always have to be two over, sometimes 3 or more over and word "hi" and "friends" only for example, maybe other words goes two or more times).

For example;

string[] myString = {"hello friends", "hi guys", "hi friends", "how are", "123654 u?", "today man", "! ?", "maybe tomorrow", "5 2-", "99 1585126", "(/&&/& _____"};

I want to split it into a new string array like that (according space characater);

string[] new = {"hello", "friends", "hi", "guys", "how", "are", "123654", "u?", "today", "man", "!", "?", "maybe", "tomorrow","5" ,"2-" ,"99", "1585126", "/&&/&", "_____"} ;

Tim Schmelter · Accepted Answer · 2019-01-21 13:59:26Z

7

Use SelectMany and Distinct:

string[] newArray = myString.SelectMany(s => s.Split(' ')).Distinct().ToArray();

If you want to compare in a case insensitive manner pass the appropriate comparer to Distinct:

string[] newArray = myString.SelectMany(s => s.Split(' ')).Distinct(StringComparer.InvariantCultureIgnoreCase).ToArray();

answered Jan 21, 2019 at 13:59

Tim Schmelter

462k79 gold badges721 silver badges981 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

Johnny Over a year ago

Might be better to use Split(null) to separate by any white-space instead of just one space...

Tim Schmelter Over a year ago

@Johnny: Then use Split() without an argument. But in what way better? OP hasn't mentioned that he wants to include all white-space- or new-line-characters

Johnny Over a year ago

@Rango in the way the code is more robust. I agree in this specific example it doesn't matter but generally...

Tim Schmelter Over a year ago

@Johnny: not necessarily more robust, that depends on the business rules of OP which i don't know. If he says he wants to split by spaces("according space character") i don't provide a solution that silently splits also by other characters.

heymycoder Over a year ago

@Rango I forgot. I mark it right now. Thank you again.

cemahi · Accepted Answer · 2019-01-22 06:08:25Z

1

You can write a function:

public string[] GetDistinctArray(string[] input) { var str = string.Join("",input).Split(' ');return str.Distinct().ToArray();}

edited Jan 22, 2019 at 6:08

answered Jan 22, 2019 at 5:26

cemahi

275 bronze badges

Comments

kkoyuncu · Accepted Answer · 2019-01-21 14:54:23Z

0

Use "SelectMany" and "Distinct" with "Trim" :

var arr = myString.SelectMany(x => x.Trim().Split(' ')).Distinct(StringComparer.InvariantCultureIgnoreCase).ToArray();

answered Jan 21, 2019 at 14:54

kkoyuncu

564 bronze badges

5 Comments

heymycoder Over a year ago

Why with trim? What's the difference from the top answer?

kkoyuncu Over a year ago

Do you want empty string in your result?

heymycoder Over a year ago

Like what for example?

kkoyuncu Over a year ago

Example input : string[] myString ={" hello "}; unless "Trim()" result -> {"", "hello"}

heymycoder Over a year ago

Hmm. Thank you for answer.

Collectives™ on Stack Overflow

How to split a string array into a new string array with remove duplicate

3 Answers 3

5 Comments

Comments

5 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

5 Comments

Comments

5 Comments

Your Answer

Sign up or log in

Post as a guest

Related