RHDFS and kerberos

[anoopkumarkm]

I am facing any issue when interacting with HDFS from R shell. RHDFS is properly installed. Does rdhfs support kerberos?
The underlying cluster is using Pivotal HD as the hadoop distribution and its secured using kerberos. The error message is below.

14/01/30 04:47:50 ERROR security.UserGroupInformation: PriviledgedActionException as:root (auth:KERBEROS) cause:javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
14/01/30 04:47:50 WARN ipc.Client: Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
14/01/30 04:47:50 ERROR security.UserGroupInformation: PriviledgedActionException as:root (auth:KERBEROS) cause:java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl, :

java.io.IOException: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; Host Details : local host is: "host2.com/192.168.74.113"; destination host is: "host.com":8020;

[TinoSM]

If it helps (2 years later), i fixed it by restarting my R and:

With the following call I made it work:

.jinit(); <-- Not sure if needed, rhdfs starts it too I guess.
.jcall("java/lang/System", "S", "setProperty", "javax.security.auth.useSubjectCredsOnly","false")
hdfs.init()

PD: Kerberos ticket has to be available on the client machine (do a kinit programatically or whatever) or maybe you can setup your JVM inside R to use a keytab.

[bedantaguru]

Check kindly

Sys.setenv(HADOOP_OPTS="-Djava.security.krb5.conf=/etc/krb5.conf")
Sys.setenv(HADOOP_CMD="/usr/bin/hadoop")
library(rhdfs)

hdfs.init()

This code working for me. Thanks to the writer of this blog

[ashishsr123]

If it helps (2 years later), i fixed it by restarting my R and:

With the following call I made it work:

.jinit(); <-- Not sure if needed, rhdfs starts it too I guess.
.jcall("java/lang/System", "S", "setProperty", "javax.security.auth.useSubjectCredsOnly","false")
hdfs.init()

PD: Kerberos ticket has to be available on the client machine (do a kinit programatically or whatever) or maybe you can setup your JVM inside R to use a keytab.

Restart Rstudio should fix this issue.