HBase 2.0 MOB 保存图片小视频利器-upload.zip_HBase 2.0 MOB_NoSQL

<html xmlns="http://www.w3.org/1999/xhtml"> <head> <meta charset="utf-8"> <meta name="generator" content="pdf2htmlEX"> <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"> <link rel="stylesheet" href="https://static.pudn.com/base/css/base.min.css"> <link rel="stylesheet" href="https://static.pudn.com/base/css/fancy.min.css"> <link rel="stylesheet" href="https://static.pudn.com/prod/directory_preview_static/6271b08640256a40ceead8fb/raw.css"> <script src="https://static.pudn.com/base/js/compatibility.min.js"></script> <script src="https://static.pudn.com/base/js/pdf2htmlEX.min.js"></script> <script> try{ pdf2htmlEX.defaultViewer = new pdf2htmlEX.Viewer({}); }catch(e){} </script> <title></title> </head> <body> <div id="sidebar" style="display: none"> <div id="outline"> </div> </div> <div id="pf1" class="pf w0 h0" data-page-no="1"><div class="pc pc1 w0 h0"><img class="bi x0 y0 w1 h1" alt="" src="https://static.pudn.com/prod/directory_preview_static/6271b08640256a40ceead8fb/bg1.jpg"><div class="c x0 y1 w2 h2"><div class="t m0 x1 h3 y2 ff1 fs0 fc0 sc0 ls0 ws0">HBase 2.0 MOB</div><div class="t m0 x2 h4 y3 ff2 fs1 fc0 sc1 ls0 ws0">初步了解</div><div class="t m0 x2 h5 y4 ff1 fs2 fc0 sc0 ls0 ws0">HBase MOB<span class="_"> </span><span class="ff2">主要解<span class="_ _0"></span>决的是<span class="_ _1"> </span></span>100KB--10MB<span class="_"> </span><span class="ff2">文件保存<span class="_ _0"></span>。</span>MOB<span class="_"> </span><span class="ff2">的引入<span class="_ _0"></span>，使得<span class="_ _1"> </span></span>HBase<span class="_"> </span><span class="ff2">非常适合存<span class="_ _0"></span>储</span></div><div class="t m0 x2 h5 y5 ff2 fs2 fc0 sc0 ls0 ws0">图片、文件、短视频等二进制对象。</div><div class="t m0 x2 h5 y6 ff1 fs2 fc0 sc0 ls0 ws0">MOB<span class="_"> </span><span class="ff2">之前，也可以保存<span class="_ _2"> </span></span>100KB<span class="_ _2"> </span><span class="ff2">以上的文件，但是<span class="_ _3"> </span></span>HBase<span class="_ _2"> </span><span class="ff2">性能比常差，理论上<span class="_ _3"> </span></span>MOB<span class="_"> </span><span class="ff2">二进制</span></div><div class="t m0 x2 h5 y7 ff2 fs2 fc0 sc0 ls0 ws0">对象大小应该在<span class="_ _2"> </span><span class="ff1">1<span class="_ _0"></span>00KB--10MB<span class="_"> </span></span>之间，超过<span class="_ _2"> </span><span class="ff1">10MB<span class="_ _2"> </span></span>的文件<span class="_ _3"> </span><span class="ff1">HBase<span class="_ _2"> </span></span>也能进行存储但是效率相对</div><div class="t m0 x2 h5 y8 ff2 fs2 fc0 sc0 ls0 ws0">比较低，不过可以采用切割文件的方式，把文件分为小于<span class="_ _2"> </span><span class="ff1">10M<span class="_"> </span></span>大小的文件进行保存，获取</div><div class="t m0 x2 h5 y9 ff2 fs2 fc0 sc0 ls0 ws0">时候再进行合并。超过<span class="_ _2"> </span><span class="ff1">10<span class="_ _0"></span>0M<span class="_ _2"> </span></span>的文件，建议直接存放在<span class="_ _3"> </span><span class="ff1">HDFS<span class="_ _2"> </span></span>上。</div><div class="t m0 x2 h5 ya ff2 fs2 fc0 sc0 ls0 ws0">版本支持</div><div class="t m0 x2 h5 yb ff1 fs2 fc0 sc0 ls0 ws0">HBase MOB<span class="_"> </span><span class="ff2">是<span class="_ _2"> </span></span>HBase 2.0 <span class="ff2">版本引入的功能，因此<span class="_ _2"> </span></span>Apac<span class="_ _0"></span>he HBase<span class="_ _2"> </span><span class="ff2">要<span class="_ _3"> </span></span>2.0<span class="_ _2"> </span><span class="ff2">及以上版本才支持。</span></div><div class="t m0 x2 h5 yc ff1 fs2 fc0 sc0 ls0 ws0">CDH5.4.x<span class="_"> </span><span class="ff2">版本开始支持<span class="_ _2"> </span></span>MOB </div><div class="t m0 x2 h5 yd ff1 fs2 fc0 sc0 ls0 ws0">HDP2.5.x<span class="_"> </span><span class="ff2">版本开始支持<span class="_ _2"> </span></span>MOB</div><div class="t m0 x2 h4 ye ff3 fs1 fc0 sc0 ls0 ws0">MOB<span class="_ _4"> </span><span class="ff2 sc1">开启</span></div><div class="t m0 x2 h4 yf ff4 fs1 fc0 sc0 ls0 ws0">1.HFile v3<span class="_ _4"> </span><span class="ff2 sc1">的配置</span></div><div class="t m0 x2 h5 y10 ff2 fs2 fc0 sc0 ls0 ws0">通过修改<span class="_ _2"> </span><span class="ff1">hbase-site.xml<span class="_"> </span></span>中<span class="_ _2"> </span><span class="ff4">hle.f<span class="_ _5"></span>ormat.<span class="_ _5"></span>v<span class="_ _5"></span>ersion<span class="_"> </span><span class="ff2 sc1">属性值为 <span class="_ _5"></span><span class="ff4 sc0">3<span class="ff2">：</span></span></span></span></div><div class="t m0 x2 h6 y11 ff1 fs2 fc0 sc0 ls0 ws0"><property></div><div class="t m0 x2 h6 y12 ff1 fs2 fc0 sc0 ls0 ws0"> <name>h&le.f<span class="_ _5"></span>ormat.<span class="_ _6"></span>ver<span class="_ _5"></span>sion</name></div><div class="t m0 x2 h6 y13 ff1 fs2 fc0 sc0 ls0 ws0"> <value>3</v<span class="_ _5"></span>alue></div><div class="t m0 x2 h6 y14 ff1 fs2 fc0 sc0 ls0 ws0"></property></div><div class="t m0 x2 h5 y15 ff2 fs2 fc0 sc0 ls0 ws0">在<span class="_ _2"> </span><span class="ff1">HBase 2.0<span class="_"> </span></span>中<span class="_ _2"> </span><span class="ff1">3<span class="_"> </span></span>是默认配置。</div><div class="t m0 x2 h4 y16 ff4 fs1 fc0 sc0 ls0 ws0">2.<span class="ff2 sc1">修改列族属性</span></div><div class="t m0 x2 h5 y17 ff1 fs2 fc0 sc0 ls0 ws0">IS_MOB<span class="ff2">：设置为<span class="_ _3"> </span></span>true</div><div class="t m0 x2 h5 y18 ff1 fs2 fc0 sc0 ls0 ws0">MOB_THRESHOLD<span class="ff2">：设置<span class="_ _2"> </span></span>MOB<span class="_"> </span><span class="ff2">阈值，超过阈值的被当做<span class="_ _2"> </span></span>MOB<span class="_"> </span><span class="ff2">存储，默认<span class="_ _2"> </span></span>100KB<span class="ff2">。</span></div></div></div><div class="pi" data-data='{"ctm":[1.611850,0.000000,0.000000,1.611850,0.000000,0.000000]}'></div></div> </body> </html>