import NLTK fails when calling Python method from Java

Question

First of all, I'm using Eclipse on MacBook for Java coding. I wrote a Python code that uses NLTK "for natural language processing" and it worked nicely. I tried to call a simple Python code from Java and it also worked as expected.

BUT when I tried to call the Python code that uses the NLTK, the import statement fails: "ImportError: No module named nltk"

It seems that Python was able to locate the NLTK library, but from Java it couldn't.

I tried to have the import statement in both the Python code and the Java code but with no luck.

Here is the Python code:

#!/usr/local/bin/python
# coding: UTF-8
import os, sys
from nltk.tokenize import word_tokenize # Tokenizer
class RTE:
    def WordPhraseRate(self, Text):
        T_tokens = word_tokenize(Text)
.
.
.

And Here is the Java Code:

import org.python.util.*;
import org.python.core.*;
import org.python.util.PythonInterpreter;

public class NLU_RTE
{
    public PythonInterpreter interpreter = null;
    public NLU_RTE()
    {
        PythonInterpreter.initialize(System.getProperties(), System.getProperties(), new String[0]);
        this.interpreter = new PythonInterpreter();
    }
    void execfile( final String fileName )
    {
        this.interpreter.execfile(fileName);
    }
    PyInstance createClass( final String className, final String opts )
    {
        return (PyInstance) this.interpreter.eval(className + "(" + opts + ")");
    }

    public static void main( String gargs[] )
    {
        NLU_RTE ie = new NLU_RTE();
        ie.execfile("/Users/Desktop/nlu.py");
        ie.interpreter.exec("from nltk.tokenize import word_tokenize # Tokenizer");
        String T="About two weeks before the trial started, I was in Shapiro's office in Century City."; // Text
        ie.interpreter.set("T", T);
        PyObject answer = ie.interpreter.eval("RTE('None').WordPhraseRate(T)");
        System.out.print(answer.toString());    

    }
}

See stackoverflow.com/questions/1164810/… (search for NLTK) — jdigital
– jdigital, Commented Dec 5, 2012 at 6:31

Ehtesh Choudhury · Accepted Answer · 2012-12-05 19:34:31Z

2

I'm not sure what the differences are in performance, but you can just call the script directly in Java if you don't want to worry about bridging or other problems. Something like the following.

Python, in a file named testing.py:

#!/usr/local/bin/python
# coding: UTF-8
import os, sys
from nltk.tokenize import word_tokenize # Tokenizer

if __name__ == "__main__":
    # If you want to read from a file instead of passing data
    #text = open(sys.argv[1]).read()

    # read the first argument passed to script
    text = sys.argv[1]

    tokens = word_tokenize(text)
    print tokens

Java:

import java.io.BufferedReader;
import java.io.InputStreamReader;
import java.io.InputStream;
import java.io.File;

public class pythonfromjava{
    public static void main(String argv[]) {
        try{
            // for tilda expansion
            //if (filepath.startsWith("~" + File.separator)) {
                //filepath = System.getProperty("user.home") + filepath.substring(1);
            //}

            //ProcessBuilder builder = new ProcessBuilder("python", "-c", "import sys; import nltk; print \"whatever\"");
            ProcessBuilder builder = new ProcessBuilder("python", "testing.py", "four scores and seven years ago");
            builder.redirectErrorStream(true);
            Process p = builder.start();
            InputStream stdout = p.getInputStream();
            BufferedReader reader = new BufferedReader (new InputStreamReader(stdout));

            String line;
            while ((line = reader.readLine ()) != null) {
                System.out.println ("Stdout: " + line);
            }
        } catch (Exception e){
            e.printStackTrace();
        }
    }
}

edited Dec 5, 2012 at 19:34

answered Dec 5, 2012 at 7:22

Ehtesh Choudhury

7,8705 gold badges45 silver badges49 bronze badges

Sign up to request clarification or add additional context in comments.

8 Comments

user1483799 Over a year ago

I tried this approach, but I wasn't able to call a specific python method and capture the return that value in Java?

Ehtesh Choudhury Over a year ago

You would have to print out the captured value in python, and then read the information in from stdout. Or you can write the data to a file and reopen that file in Java.

Ehtesh Choudhury Over a year ago

But can you give an example of the code you weren't able to run?

user1483799 Over a year ago

It is the exact code that I have in my question. I used your method, but how to send the variable that is declated in Java to the called python code. In java I have this variable: String T="About two weeks before the trial started, I was in Shapiro's office in Century City."; // Text

user1483799 Over a year ago

And how to edit my python code to accept that variable from java

|

Collectives™ on Stack Overflow

import NLTK fails when calling Python method from Java

1 Answer 1

8 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

8 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related