Hadoop hdfs, java client cannot connect to hdfs

Question

I am trying to connect my java client to my hadoop HDFS, but i am stuck when i try to get the fs from my configuration

Configuration conf = new Configuration();
conf.set("fs.default.name", _PATH_);
conf.set("fs.hdfs.impl", "org.apache.hadoop.hdfs.DistributedFileSystem");
FileSystem f = FileSystem.get( conf );

Then I get this exp..

java.lang.RuntimeException: class org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback not org.apache.hadoop.security.GroupMappingServiceProvider

I googled it but noting handfull come. Any advices?

PS: I use the package hadoop-common, hadoop-hdfs from 2.0.0-cdh4.2.0

Thanks Anthony.

Jubin Patel · Accepted Answer · 2014-04-29 10:10:11Z

1

Try below Code:

Path coreSitePath = new Path("/path/of/HADOOP_HOME", "conf/core-site.xml");
conf.addResource(coreSitePath);
FileSystem fs = FileSystem.get(conf)

edited Apr 29, 2014 at 10:10

Jubin Patel

2,05221 silver badges40 bronze badges

answered Apr 1, 2013 at 6:30

Sourav Gulati

1,3449 silver badges18 bronze badges

Sign up to request clarification or add additional context in comments.

5 Comments

AnthonyC Over a year ago

thankyou for your answer but my hadoop_home is on a server, I try to run my client on my computer.

AnthonyC Over a year ago

I tried your solution (i copied core-site from server to my computer) and i still get the same Exception JniBasedUnixGroupsMappingWithFallback

Sourav Gulati Over a year ago

I tried it in the same way u have done, it worked for me Configuration conf = new Configuration(); conf.set("fs.default.name","hdfs://hostname:9000/"); FileSystem fs = FileSystem.get(conf);

Sourav Gulati Over a year ago

just check there might be an issue with versions of jars you are using

linrongbin Over a year ago

Hello, may I ask you two question? Which version of hadoop HDFS do you use ? And where do you download the HDFS client java jar package ? I cannot find a valid hadoop HDFS client jar package for 2.7.1 hadoop HDFS.

Collectives™ on Stack Overflow

Hadoop hdfs, java client cannot connect to hdfs

1 Answer 1

5 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

5 Comments

Your Answer

Sign up or log in

Post as a guest

Related