How to detect the language of a given text

Question

In my Rails 3 application, users may write messages in forum. I would like to identify what the language is for a given message. I'm interested in English, Russian, and Hebrew languages. Is there any built-in library in Ruby/Rails for such a task? If not, any ideas will be appreciated.

here good answers too stackoverflow.com/questions/3285511/… — Oleksandr Bratashov
– Oleksandr Bratashov, Commented Oct 6, 2017 at 9:10

Vasiliy Ermolovich · Accepted Answer · 2011-05-07 17:23:05Z

7

Use this: https://github.com/nashby/wtf_lang

"ruby is so awesome!".lang # => "en"
"ruby is so awesome!".full_lang # => "ENGLISH"

answered May 7, 2011 at 17:23

Vasiliy Ermolovich

24.7k5 gold badges84 silver badges78 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Misha Moroshko Over a year ago

Thanks! Do you know if there is something similar that can translate one language to other and uses Google translator ?

Hartator · Accepted Answer · 2011-05-05 12:38:25Z

5

You can use the api provided by google to guess it with google translate.

See here for documentation : http://code.google.com/apis/language/translate/v1/using_rest_langdetect.html

answered May 5, 2011 at 12:38

Hartator

5,1874 gold badges46 silver badges74 bronze badges

4 Comments

Misha Moroshko Over a year ago

There is no "Using Ruby" section there :(

Matt Over a year ago

Oh, in that case you'll have to use Java... Sorry, couldn't resist :). It has a JSON interface. You can generate and parse JSON easily with Ruby.

Hartator Over a year ago

In fact, there are just examples, you have to anyway parse the JSON in every language. In ruby, you can use this : developer.yahoo.com/ruby/ruby-json.html

Henley Wing Chiu Over a year ago

Not the best solution. Google has rate limits. There's a dependency on a 3rd party.. you want to limit those as much as possible.

digitalWestie · Accepted Answer · 2011-05-05 13:30:25Z

2

Since you're concerned with languages with different character sets you could dig up the character codes that are predominantly in your strings. You could then see if they fall into the code sets that represent hebrew / cryllic characters.

answered May 5, 2011 at 13:30

digitalWestie

2,8596 gold badges32 silver badges49 bronze badges

Comments

Caley Woods · Accepted Answer · 2011-05-05 20:21:31Z

2

Perhaps you could look at the whatlanguage gem?

answered May 5, 2011 at 20:21

Caley Woods

4,7454 gold badges32 silver badges38 bronze badges

Comments

shajin · Accepted Answer · 2011-05-05 12:40:57Z

1

Take a look at this blog
http://blog.kenweiner.com/2008/04/server-side-language-detection-with.html
This may be helpful

answered May 5, 2011 at 12:40

shajin

3,2646 gold badges42 silver badges56 bronze badges

Comments

Laurynas · Accepted Answer · 2013-06-27 21:02:06Z

1

Language Detection API provides Ruby GEM to detect language.

answered Jun 27, 2013 at 21:02

Laurynas

3,8692 gold badges34 silver badges22 bronze badges

1 Comment

Misha Moroshko Over a year ago

Looks interesting. Thanks for posting this!

alexizydorczyk · Accepted Answer · 2012-09-10 01:41:41Z

0

Just a quick demo of WhatLanguage for anyone interested : http://www.youtube.com/watch?v=lNqZ2cqOReo&list=UUJ_3fstMOH-g4yBxtvgAWkw&index=0&feature=plcp

answered Sep 10, 2012 at 1:41

alexizydorczyk

9301 gold badge7 silver badges27 bronze badges

Comments

user3871311 · Accepted Answer · 2014-08-18 05:08:53Z

0

http://rubygems.org/gems/prose Prose dose it without a gem. Try it.

answered Aug 18, 2014 at 5:08

user3871311

32 bronze badges

Collectives™ on Stack Overflow

How to detect the language of a given text

8 Answers 8

1 Comment

4 Comments

Comments

Comments

Comments

1 Comment

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

8 Answers 8

1 Comment

4 Comments

Comments

Comments

Comments

1 Comment

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related