安徽Hadoop集群RegionServer宕机问题分析与优化方案.pdfVIP

hadoop集群RegionServer宕机问题分析及解决方案

xdhadoop006RegionServer日志：

2015-03-2300:01:50,318DEBUG

[regionserver8602-smallCompactions-1422966578813]regionserver.HStore:

Removingstorefiaftercompaction...

从2015-03-2300:01:50集群开始进行compaction

2015-03-2300:07:02,353DEBUG[Thread-16]regionserver.HRegion:Started

memstoreflushfor

OCS_LOG1000,1426698441430.fdd0085436fdac70468b5627fa5ad8e9.,

currentregionmemstoresize128.0M

此时应该还有写入

2015-03-2300:33:00,150DEBUG[regionserver8602.logRoller]

regionserver.LogRoller:HLogrollrequested

2015-03-2300:33:02,862INFO[regionserver8602.logRoller]wal.FSHLog:Rolled

WAL

/hbase/WALs/xdhadoop006,8602,1422966550646/xdhadoop006%2C8602%2C142291427041764559withentries=27878,fiize=124.2M;newWAL

/hbase/WALs/xdhadoop006,8602,1422966550646/xdhadoop006%2C8602%2C142291427041980151

2015-03-2300:33:32,179INFO[JvmPauseMonitor]util.JvmPauseMonitor:

DetectedpauseinJVMorhostmachine(egGC):pauseofapproximately5908ms

不知道为何触发一个JVM的GC

2015-03-2300:33:49,728INFO[regionserver8602.leaseChecker]

regionserver.HRegionServer:Scanner4leaseexpiredonregion

sdetail_201412,608,1416530842249.478709b021d7a8cb2a3fd075d9f33703.

2015-03-2300:33:49,829INFO[regionserver8602.leaseChecker]

regionserver.HRegionServer:Scanner4leaseexpiredonregion

sdetail_201412,152,1416530842248.bcf662eca225240434cef5753b92aa33.

2015-03-2300:33:49,829INFO[regionserver8602.leaseChecker]

regionserver.HRegionServer:Scanner4leaseexpiredonregion

sdetail_201412,652,1416530842249.7fc518a3168c3ca48c9d70883d09adb0.

2015-03-2300:33:49,829INFO[regionserver8602.leaseChecker]

regionserver.HRegionServer:Scanner0leaseexpiredonregion

sdetail_201412,680,14165308422