Posts

Showing posts from December, 2017

RegionServer crashing with error "Direct buffer memory"

Region server might crash with below error

INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ip-100-122-218-159.us-east-1.ec2.aws.symcpe.net:2181,ip-******.us-east-1.ec2.aws.net:2181,ip-*****.us-east-1.ec2.aws.net:2181 sessionTimeout=180000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@253c1256 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting java.lang.RuntimeException: Failed construction of Regionserver: class org.apache.hadoop.hbase.regionserver.HRegionServer at org.apache.hadoop.hbase.regionserver.HRegionServer.constructRegionServer(HRegionServer.java:2666) at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:64) at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126) at org.a…

HMaster error during startup

HMaster throws error as below during startup

FATAL [ip-:16000.activeMasterManager] master.HMaster: The coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor threw java.lang.RuntimeException: java.io.FileNotFoundException: /etc/hbase/2.5.0.55-1/0/xasecure-audit.xml (No such file or directory)
This is happening because the ranger co-processor is defined in xml config to load but the requested plugin is not installed. Remove below attributes from hbase-site.xml

hbase.coprocessor.master.classeshbase.coprocessor.region.classeshbase.coprocessor.regionserver.classes Now restart the HMaster process.

Unable to start namenode. Error "couldn't find resource file location"

Sometimes starting the namenode might throw below error.
ERROR config.RangerConfiguration (RangerConfiguration.java:addResourceIfReadable(110)) - addResourceIfReadable(ranger-hdfs-security.xml): couldn't find resource file location INFO provider.AuditProviderFactory (AuditProviderFactory.java:(77)) - AuditProviderFactory: creating.. FATAL conf.Configuration (Configuration.java:loadResource(2672)) - error parsing conf file:/etc/hadoop/2.5.0.55-1/0/xasecure-audit.xml java.io.FileNotFoundException: /etc/hadoop/2.5.0.55-1/0/xasecure-audit.xml (No such file or directory)
This is causing because, ranger plugin is not installed and authorization provider class is registered for ranger. Your config (hdfs-site.xml) will have below xml attribute with the value
ATTRIBUTE : dfs.namenode.inode.attributes.provider.class VALUE: org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer
Now search for above attribute in hdfs-site.xml and remove attribute.Now you are good to start the se…