convert Java regex OR operator to Scala Regex

Question

I'm doing a project with Twitter and one part is to take out all emoticons in a tweet so it doesn't trip the parser. I took a look at Carnegie Mellon's Ark Tweet NLP and it's pretty amazing and they have this really nice Java Regex pattern to detect emoticons!

However, I'm not exactly familiar with Java's regex syntax (I'm familiar with the basic ones)

https://github.com/brendano/ark-tweet-nlp/blob/master/src/cmu/arktweetnlp/Twokenize.java

The code I need to convert to Scala looks like this:

public static String emoticon = OR(
        // Standard version  :) :( :] :D :P
        "(?:>|&gt;)?" + OR(normalEyes, wink) + OR(noseArea,"[Oo]") + 
            OR(tongue+"(?=\\W|$|RT|rt|Rt)", otherMouths+"(?=\\W|$|RT|rt|Rt)", sadMouths, happyMouths),


        // reversed version (: D:  use positive lookbehind to remove "(word):"
        // because eyes on the right side is more ambiguous with the standard usage of : ;
        "(?<=(?: |^))" + OR(sadMouths,happyMouths,otherMouths) + noseArea + OR(normalEyes, wink) + "(?:<|&lt;)?",


        //inspired by http://en.wikipedia.org/wiki/User:Scapler/emoticons#East_Asian_style
        eastEmote.replaceFirst("2", "1"), basicface
        // iOS 'emoji' characters (some smileys, some symbols) [\ue001-\uebbb]  
        // TODO should try a big precompiled lexicon from Wikipedia, Dan Ramage told me (BTO) he does this
);

The OR operator is a bit confusing.

So can anyone let me know how to do the conversion? Also after the conversion, all I need to do is a quick splitting tweets into words and see word.contains(emoticon) right? Thank you!

It seems like the above question is rather idiotic. However, there's the last bit of task I don't know:

I'm taking those emoticons out of my sentence. Will it work if I just split my sentences by space into words and do for (word <- words if !word.contains(regexpattern))?

There's no OR operator. It's a static method in the Twokenize class. — Robby Cornelissen
– Robby Cornelissen, Commented Jul 3, 2014 at 13:38
Change public static String emoticon to val emoticon: String and this could be Scala code. Scala uses the same regex engine as Java and could use the arktweetnlp library as well. — wingedsubmariner
– wingedsubmariner, Commented Jul 3, 2014 at 13:45

Will Fitzgerald · Accepted Answer · 2014-07-03 13:46:09Z

2

You can use this function:

def OR(patterns : String*) = patterns.map{p => s"(?:$p)"}.mkString("|")

answered Jul 3, 2014 at 13:46

Will Fitzgerald

1,38212 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

convert Java regex OR operator to Scala Regex

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related