Spark java.io.IOException: No input paths specified in job

Question

I have the following error:

java.io.IOException: No input paths specified in job

When I execute the following line:

val df = sqlContext.read.json("file://home/test.json")

Any ideas?

koiralo · Accepted Answer · 2017-05-05 09:22:53Z

1

If you want to load data from local please use

sqlContext.read.json("file:///home/shankar/test.json")

or just

sqlContext.read.json("/home/shankar/test.json")

will work

If you want to load the file from HDFS use

sqlContext.read.json("hdfs:///user/shankar/test.json")

Hope this helps!

answered May 5, 2017 at 9:22

koiralo

23.2k6 gold badges57 silver badges77 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1