Showing posts from December, 2017

RegionServer crashing with error "Direct buffer memory"

Region server might crash with below error

INFO [main] zookeeper.ZooKeeper: Initiating client connection,,ip-******,ip-***** sessionTimeout=180000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@253c1256 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting java.lang.RuntimeException: Failed construction of Regionserver: class org.apache.hadoop.hbase.regionserver.HRegionServer at org.apache.hadoop.hbase.regionserver.HRegionServer.constructRegionServer( at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start( at at at org.apache.hadoop.hbase.util.ServerCommandLine.doMain( at org.a…

HMaster error during startup

HMaster throws error as below during startup

FATAL [ip-:16000.activeMasterManager] master.HMaster: The coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor threw java.lang.RuntimeException: /etc/hbase/ (No such file or directory)
This is happening because the ranger co-processor is defined in xml config to load but the requested plugin is not installed. Remove below attributes from hbase-site.xml

hbase.coprocessor.master.classeshbase.coprocessor.region.classeshbase.coprocessor.regionserver.classes Now restart the HMaster process.

Unable to start namenode. Error "couldn't find resource file location"

Sometimes starting the namenode might throw below error.
ERROR config.RangerConfiguration ( - addResourceIfReadable(ranger-hdfs-security.xml): couldn't find resource file location INFO provider.AuditProviderFactory ( - AuditProviderFactory: creating.. FATAL conf.Configuration ( - error parsing conf file:/etc/hadoop/ /etc/hadoop/ (No such file or directory)
This is causing because, ranger plugin is not installed and authorization provider class is registered for ranger. Your config (hdfs-site.xml) will have below xml attribute with the value
ATTRIBUTE : dfs.namenode.inode.attributes.provider.class VALUE: org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer
Now search for above attribute in hdfs-site.xml and remove attribute.Now you are good to start the se…