The fastest way to count string occurences in another string in c#

Question

I have to count string occurences in one very loooong string (about 30mb in plain text) I use the following code for now: int count = new Regex(Regex.Escape(stringThatIamLookingFor)).Matches(stringToSearchIn).Count; but is is too slow. It takes about 3 minutes on i7 and 16gb ram. The example data is:

43.996442,-31.768039
43.996432,-31.768039
43.996432,-31.768049
43.996422,-31.768049
43.996422,-31.768059

I want to count (for example) .7 Is there faster way than regeex?

ok, solved

The fastest function so far is: (I need to check only two chars.)

public int countOccurences2(string source, char charOne, char charTwo)
    {
        int count = 0;
        for (int i=0; i<=source.Length-1; i=i+2)
            if (source[i] == charOne && source[i + 1] == charTwo) { count++; }
        return count;
    }

How long does it take to convert the string into a byte array and just looking for the correct two numbers with a simple for loop? Sometimes the low tech method isn't the worst. — Jens
– Jens, Commented Mar 13, 2015 at 17:08
possible duplicate of How would you count occurrences of a string within a string? — Jens
– Jens, Commented Mar 13, 2015 at 17:16
please let us know how well perform each solution. For science! :D — Sim1
– Sim1, Commented Mar 13, 2015 at 17:16
HOLY CRAP, Simone Riboldi's answer is about 10 times faster than regex. — pythoner
– pythoner, Commented Mar 13, 2015 at 17:18

Community · Accepted Answer · 2017-05-23 12:22:14Z

3

from this question: How would you count occurrences of a string within a string?

the following code seems the most performing:

int count = 0, n = 0;

if(substring != "")
{
    while ((n = source.IndexOf(substring, n, StringComparison.InvariantCulture)) != -1)
    {
        n += substring.Length;
        ++count;
    }
}

solution provided by Richard Watson in the mentioned question

edited May 23, 2017 at 12:22

CommunityBot

11 silver badge

answered Mar 13, 2015 at 17:11

Sim1

5324 silver badges24 bronze badges

Sign up to request clarification or add additional context in comments.

6 Comments

TaW Over a year ago

Note that the accepted answer and actually most answers are plain wrong as they count characters; also note that any Linq solution breaks down for large strings! This is the worst example of vote gauging going wrong I have ever seen on SO

TaW Over a year ago

Yes, probably because the needle is so short. I did tests last year and when both needle and haystack grow regex finally wins.

Sim1 Over a year ago

@TaW good to know, very good to know! We always need this kind of function and it is really usefull to know the weakness of each approach.

Gary Walker Over a year ago

I might also add that due to Unicode considerations, any comparison based on simple byte comparisons will give the incorrect answer on some data, so using a method like this that respects Unicode is a definite plus.

Jared Moore Over a year ago

I think this answer is (arguably) wrong due to the "n += substring.Length" line - if you search for "abca" in the string "abcabca" then it will only return 1 when (arguably) it should return 2.

|

Collectives™ on Stack Overflow

The fastest way to count string occurences in another string in c#

ok, solved

1 Answer 1

6 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

ok, solved

1 Answer 1

6 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related