HBase ???????????????????
???????????? ???????[ 2015/8/17 10:13:35 ] ??????????????????? ?????
????HBase ????
???????? HBase ?????????????? 32G???? 1 ?????????????????????????????潨?????
??????? ???????? ???????
????HDFS HDFS NameNode 16GB
????HDFS DataNode 2GB
????HBase HMaster 2GB
????HRegionServer 16GB
????ZooKeeper ZooKeeper 4GB
?????? 1. HBase ?????????????
????HBase ????? Region ??С??????????Щ????? 2G??RegionServer ??????????? Region ???????С Region ???????????????????????????????????????????????????????????屸????? 2????????????????????????????????????д???????????????????????? 3 ????????????????????????????
??????????
?????????????????洢?? HBase ??????е???????????? HBase ?е? Rowkey ?????? ID(?????????????) ???? 16 λ??????????????????????????????? 2 ???????????????????
????? 2. ????????????
????????????????????????????????? ID ?????????洢?? HBase ?е????????????? HBase ??????????????????????????????? I/O ????????????????д?????
?????? HBase ?????????????????HBase ???? Major Compaction ??????Major Compaction ?????????????????????????????????????汾???????Major Compaction ? HBase ????? Region ?? StoreFile?????????????????????????? Region ?????????????????л?????Щ Region ?????????
????????????? Major Compaction ??????????????????????? HBase ????? RegionServer ?????????и? CompactionChecker ?????????????????? Compact?????????? 3 ?????
????? 3. CompactionChecker ???????
????isMajorCompaction ?л???? hbase.hregion.majorcompaction ???????ж?????? Major Compact????? hbase.hregion.majorcompaction ? 0?????? false???????????? hbase.hregion.majorcompaction ? 0????? HBase ????? Major Compaction ???????????????????? (???賿 HBase ???????) ??? Major ????????????????????? Linux cron ??????????????????? Java ?? timer schedule??????????????? Quartz ?????????????????????????????и???????????????? Major Compact ????????????????????????????????????????? Compact ????????????????? needsCompaction = true ???????? needsCompaction ?ж?????? (storefiles.size() – filesCompacting.size()) > minFilesToCompact ?????????????????????????? Store ?????????????Minor Compact ???????? Major Compact?????? Compact ?????????????????????????????????????????Ч???
?????????????????????????????????????????????????????????????????????????????????м??????ɡ??????????????????????????????????????????????????????????????????????????????? HBase ??????е?????????? Region ?? Major Compact????????????????????????????????????????????????????????????????????? HBase ?????á?
????? 4. ??????????????
?????????????????? HBase ??????е??????????????????????????? HBase ?????????????????????????????????????????????????
??????????
????HBase ????????ü???????????????????????????????????????????????????巽?????????? HBase ???????? API ????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
??????
???·???
??????????????????
2023/3/23 14:23:39???д?ò??????????
2023/3/22 16:17:39????????????????????Щ??
2022/6/14 16:14:27??????????????????????????
2021/10/18 15:37:44???????????????
2021/9/17 15:19:29???·???????·
2021/9/14 15:42:25?????????????
2021/5/28 17:25:47??????APP??????????
2021/5/8 17:01:11