斯坦福CS224n_自然语言处理与深度学习_笔记_深度学习_人工智能/神经网络/深度学习

<html xmlns="http://www.w3.org/1999/xhtml"> <head> <meta charset="utf-8"> <meta name="generator" content="pdf2htmlEX"> <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"> <link rel="stylesheet" href="https://static.pudn.com/base/css/base.min.css"> <link rel="stylesheet" href="https://static.pudn.com/base/css/fancy.min.css"> <link rel="stylesheet" href="https://static.pudn.com/prod/directory_preview_static/624716ea54457c44d0393b40/raw.css"> <script src="https://static.pudn.com/base/js/compatibility.min.js"></script> <script src="https://static.pudn.com/base/js/pdf2htmlEX.min.js"></script> <script> try{ pdf2htmlEX.defaultViewer = new pdf2htmlEX.Viewer({}); }catch(e){} </script> <title></title> </head> <body> <div id="sidebar" style="display: none"> <div id="outline"> </div> </div> <div id="pf1" class="pf w0 h0" data-page-no="1"><div class="pc pc1 w0 h0"><img class="bi x0 y0 w1 h1" alt="" src="https://static.pudn.com/prod/directory_preview_static/624716ea54457c44d0393b40/bg1.jpg"><div class="t m0 x1 h2 y1 ff1 fs0 fc0 sc0 ls0 ws0">斯坦福<span class="_ _0"> </span>CS2<span class="_ _1"></span>24N</div><div class="t m0 x2 h2 y2 ff1 fs0 fc0 sc0 ls0 ws0">自然语言<span class="_ _1"></span>处理与深<span class="_ _1"></span>度学习</div><div class="t m0 x3 h2 y3 ff1 fs0 fc0 sc0 ls0 ws0">笔记</div><div class="t m0 x4 h3 y4 ff1 fs1 fc0 sc0 ls0 ws0">作者<span class="_ _2"> </span>han<span class="_ _1"></span>kcs</div><div class="t m0 x4 h3 y5 ff1 fs1 fc0 sc0 ls0 ws0">编辑<span class="_ _2"> </span>守望<span class="_ _1"></span>者白狼</div><div class="t m0 x5 h3 y6 ff1 fs1 fc0 sc0 ls0 ws0">201<span class="_ _1"></span>7<span class="_ _3"> </span>年</div><div class="t m0 x6 h4 y7 ff2 fs2 fc1 sc1 ls0 ws0">想要获取更多机器学习、深度学习、</div><div class="t m0 x6 h4 y8 ff2 fs2 fc1 sc1 ls0 ws0">自然语言处理、计算机视觉相关资</div><div class="t m0 x6 h4 y9 ff2 fs2 fc1 sc1 ls0 ws0">料，添加Jews老师微信：Jews_nlp</div><div class="t m0 x6 h4 ya ff2 fs2 fc1 sc1 ls0 ws0">更有顶尖论文、项目经验及面试经验</div><div class="t m0 x6 h4 yb ff2 fs2 fc1 sc1 ls0 ws0">分享，干货多多，不容错过！！！</div></div><div class="pi" data-data='{"ctm":[1.611830,0.000000,0.000000,1.611830,0.000000,0.000000]}'></div></div> </body> </html>

<div id="pf2" class="pf w0 h0" data-page-no="2"><div class="pc pc2 w0 h0"><img class="bi x0 y0 w1 h1" alt="" src="https://static.pudn.com/prod/directory_preview_static/624716ea54457c44d0393b40/bg2.jpg"><div class="t m0 x7 h5 yc ff1 fs3 fc1 sc1 ls0 ws0">目<span class="_ _4"> </span>录</div><div class="t m0 x6 h6 yd ff1 fs4 fc1 sc1 ls0 ws0">笔记<span class="_ _5"> </span><span class="ff3">1<span class="_"> </span></span>自然语言处理<span class="_ _1"></span>与深度学习简介</div><div class="t m0 x8 h7 ye ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 yd ff3 fs4 fc1 sc1 ls0 ws0">13</div><div class="t m0 xa h6 yf ff3 fs4 fc1 sc1 ls0 ws0">1.1<span class="_"> </span><span class="ff1">新旧<span class="_ _5"> </span></span>CS224<span class="_ _5"> </span><span class="ff1">对比</span></div><div class="t m0 xb h7 y10 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>........</div><div class="t m0 x9 h8 yf ff3 fs4 fc1 sc1 ls0 ws0">13</div><div class="t m0 xa h6 y11 ff3 fs4 fc1 sc1 ls0 ws0">1.2<span class="_ _7"> </span>CS224<span class="_ _5"> </span><span class="ff1">资料</span></div><div class="t m0 xc h7 y12 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..............</div><div class="t m0 x9 h8 y11 ff3 fs4 fc1 sc1 ls0 ws0">14</div><div class="t m0 xa h6 y13 ff3 fs4 fc1 sc1 ls0 ws0">1.3<span class="_"> </span><span class="ff1">什么是自然语<span class="_ _1"></span>言处理</span></div><div class="t m0 xd h7 y14 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y13 ff3 fs4 fc1 sc1 ls0 ws0">15</div><div class="t m0 xa h6 y15 ff3 fs4 fc1 sc1 ls0 ws0">1.4<span class="_"> </span><span class="ff1">自然语言处理<span class="_ _1"></span>应用</span></div><div class="t m0 xe h7 y16 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....</div><div class="t m0 x9 h8 y15 ff3 fs4 fc1 sc1 ls0 ws0">16</div><div class="t m0 xa h6 y17 ff3 fs4 fc1 sc1 ls0 ws0">1.5<span class="_"> </span><span class="ff1">人类语言的特<span class="_ _1"></span>殊之处</span></div><div class="t m0 xd h7 y18 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y17 ff3 fs4 fc1 sc1 ls0 ws0">17</div><div class="t m0 xa h6 y19 ff3 fs4 fc1 sc1 ls0 ws0">1.6<span class="_"> </span><span class="ff1">什么是深度学<span class="_ _1"></span>习</span></div><div class="t m0 xb h7 y1a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>........</div><div class="t m0 x9 h8 y19 ff3 fs4 fc1 sc1 ls0 ws0">17</div><div class="t m0 xa h6 y1b ff3 fs4 fc1 sc1 ls0 ws0">1.7<span class="_ _8"> </span>“<span class="ff1">深度学习<span class="_ _1"></span></span>”<span class="ff1">的历史</span></div><div class="t m0 xf h7 y1c ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....</div><div class="t m0 x9 h8 y1b ff3 fs4 fc1 sc1 ls0 ws0">19</div><div class="t m0 xa h6 y1d ff3 fs4 fc1 sc1 ls0 ws0">1.8<span class="_"> </span><span class="ff1">为什么需要研<span class="_ _1"></span>究深度学习</span></div><div class="t m0 x10 h7 y1e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.............</div><div class="t m0 x9 h8 y1d ff3 fs4 fc1 sc1 ls0 ws0">19</div><div class="t m0 xa h6 y1f ff3 fs4 fc1 sc1 ls0 ws0">1.9<span class="_"> </span><span class="ff1">语音识别中的<span class="_ _1"></span>深度学习</span></div><div class="t m0 x4 h7 y20 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x9 h8 y1f ff3 fs4 fc1 sc1 ls0 ws0">19</div><div class="t m0 xa h6 y21 ff3 fs4 fc1 sc1 ls0 ws0">1.20<span class="_"> </span><span class="ff1">计算机视<span class="_ _1"></span>觉中的深度学习</span></div><div class="t m0 x11 h7 y22 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>..........</div><div class="t m0 x9 h8 y21 ff3 fs4 fc1 sc1 ls0 ws0">20</div><div class="t m0 xa h6 y23 ff3 fs4 fc1 sc1 ls0 ws0">1.21<span class="_"> </span><span class="ff1">课程相关</span></div><div class="t m0 x12 h7 y24 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..................</div><div class="t m0 x9 h8 y23 ff3 fs4 fc1 sc1 ls0 ws0">21</div><div class="t m0 xa h6 y25 ff3 fs4 fc1 sc1 ls0 ws0">1.22<span class="_"> </span><span class="ff1">为什么<span class="_ _5"> </span></span>NLP<span class="_ _5"> </span><span class="ff1">难</span></div><div class="t m0 x13 h7 y26 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.........</div><div class="t m0 x9 h8 y25 ff3 fs4 fc1 sc1 ls0 ws0">21</div><div class="t m0 xa h8 y27 ff3 fs4 fc1 sc1 ls0 ws0">1.23<span class="_ _7"> </span>Deep<span class="_ _8"> </span>NLP<span class="_ _8"> </span>=<span class="_ _5"> </span>Deep<span class="_ _8"> </span>Learning<span class="_ _8"> </span>+<span class="_ _8"> </span>NLP</div><div class="t m0 x14 h7 y28 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................</div><div class="t m0 x9 h8 y27 ff3 fs4 fc1 sc1 ls0 ws0">21</div><div class="t m0 xa h8 y29 ff3 fs4 fc1 sc1 ls0 ws0">1.24<span class="_ _7"> </span>word<span class="_ _8"> </span>vector</div><div class="t m0 x15 h7 y2a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>............</div><div class="t m0 x9 h8 y29 ff3 fs4 fc1 sc1 ls0 ws0">22</div><div class="t m0 xa h6 y2b ff3 fs4 fc1 sc1 ls0 ws0">1.25<span class="_ _7"> </span>NLP<span class="_ _5"> </span><span class="ff1">表示层次：形<span class="_ _1"></span>态级别</span></div><div class="t m0 x16 h7 y2c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.........</div><div class="t m0 x9 h8 y2b ff3 fs4 fc1 sc1 ls0 ws0">22</div><div class="t m0 xa h6 y2d ff3 fs4 fc1 sc1 ls0 ws0">1.26<span class="_ _7"> </span>NLP<span class="_ _5"> </span><span class="ff1">工具：句法分<span class="_ _1"></span>析</span></div><div class="t m0 x17 h7 y2e ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x9 h8 y2d ff3 fs4 fc1 sc1 ls0 ws0">22</div><div class="t m0 xa h6 y2f ff3 fs4 fc1 sc1 ls0 ws0">1.27<span class="_ _7"> </span>NLP<span class="_ _5"> </span><span class="ff1">语义层面的表<span class="_ _1"></span>示</span></div><div class="t m0 x17 h7 y30 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x9 h8 y2f ff3 fs4 fc1 sc1 ls0 ws0">23</div><div class="t m0 xa h6 y31 ff3 fs4 fc1 sc1 ls0 ws0">1.28<span class="_"> </span><span class="ff1">情感分析</span></div><div class="t m0 x12 h7 y32 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..................</div><div class="t m0 x9 h8 y31 ff3 fs4 fc1 sc1 ls0 ws0">23</div><div class="t m0 xa h8 y33 ff3 fs4 fc1 sc1 ls0 ws0">1.29<span class="_ _7"> </span>QA</div><div class="t m0 x18 h7 y34 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>......</div><div class="t m0 x9 h8 y33 ff3 fs4 fc1 sc1 ls0 ws0">24</div><div class="t m0 xa h6 y35 ff3 fs4 fc1 sc1 ls0 ws0">1.30<span class="_"> </span><span class="ff1">客服系统</span></div><div class="t m0 x12 h7 y36 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..................</div><div class="t m0 x9 h8 y35 ff3 fs4 fc1 sc1 ls0 ws0">25</div><div class="t m0 xa h6 y37 ff3 fs4 fc1 sc1 ls0 ws0">1.31<span class="_"> </span><span class="ff1">机器翻译</span></div><div class="t m0 x12 h7 y38 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..................</div><div class="t m0 x9 h8 y37 ff3 fs4 fc1 sc1 ls0 ws0">26</div><div class="t m0 xa h6 y39 ff3 fs4 fc1 sc1 ls0 ws0">1.32<span class="_"> </span><span class="ff1">结论：所<span class="_ _1"></span>有层级的表示都是<span class="_ _1"></span>向量</span></div><div class="t m0 x19 h7 y3a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>......................<span class="_ _6"></span>....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y39 ff3 fs4 fc1 sc1 ls0 ws0">27</div><div class="t m0 x6 h6 y3b ff1 fs4 fc1 sc1 ls0 ws0">研究热点<span class="_ _5"> </span><span class="ff3">1<span class="_"> </span></span>一个简单<span class="_ _1"></span>但很难超越的<span class="_ _5"> </span><span class="ff3">Sentence<span class="_ _8"> </span>Embedding<span class="_ _9"> </span></span>基线方法</div><div class="t m0 x1a h7 y3c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>....................</div><div class="t m0 x9 h8 y3b ff3 fs4 fc1 sc1 ls0 ws0">29</div><div class="t m0 xa h6 y3d ff3 fs4 fc1 sc1 ls0 ws0">1.1<span class="_"> </span><span class="ff1">句子<span class="_ _5"> </span></span>Embedding<span class="_ _5"> </span><span class="ff1">动机</span></div><div class="t m0 x1b h7 y3e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................</div><div class="t m0 x9 h8 y3d ff3 fs4 fc1 sc1 ls0 ws0">29</div><div class="t m0 xa h6 y3f ff3 fs4 fc1 sc1 ls0 ws0">1.2<span class="_"> </span><span class="ff1">已有方法</span></div><div class="t m0 x1c h7 y40 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y3f ff3 fs4 fc1 sc1 ls0 ws0">30</div><div class="t m0 xa h6 y41 ff3 fs4 fc1 sc1 ls0 ws0">1.3<span class="_"> </span><span class="ff1">新方法</span></div><div class="t m0 x1d h7 y42 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..</div><div class="t m0 x9 h8 y41 ff3 fs4 fc1 sc1 ls0 ws0">31</div><div class="t m0 xa h6 y43 ff3 fs4 fc1 sc1 ls0 ws0">1.4<span class="_"> </span><span class="ff1">概率论解释</span></div><div class="t m0 x1e h7 y44 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...............</div><div class="t m0 x9 h8 y43 ff3 fs4 fc1 sc1 ls0 ws0">32</div><div class="t m0 xa h6 y45 ff3 fs4 fc1 sc1 ls0 ws0">1.5<span class="_"> </span><span class="ff1">效果</span></div><div class="t m0 x1f h7 y46 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y45 ff3 fs4 fc1 sc1 ls0 ws0">32</div><div class="t m0 x6 h6 y47 ff1 fs4 fc1 sc1 ls0 ws0">笔记<span class="_ _5"> </span><span class="ff3">2<span class="_"> </span></span>词的向量表示<span class="_ _1"></span>：<span class="ff3">word2vec</span></div><div class="t m0 x20 h7 y48 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...............</div><div class="t m0 x9 h8 y47 ff3 fs4 fc1 sc1 ls0 ws0">34</div><div class="t m0 xa h6 y49 ff3 fs4 fc1 sc1 ls0 ws0">2.1<span class="_"> </span><span class="ff1">如何表示一个<span class="_ _1"></span>词语的意思</span></div><div class="t m0 x10 h7 y4a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.............</div><div class="t m0 x9 h8 y49 ff3 fs4 fc1 sc1 ls0 ws0">34</div><div class="t m0 xa h6 y4b ff3 fs4 fc1 sc1 ls0 ws0">2.2<span class="_"> </span><span class="ff1">计算机如何处<span class="_ _1"></span>理词语的意思</span></div><div class="t m0 x21 h7 y4c ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>........</div><div class="t m0 x9 h8 y4b ff3 fs4 fc1 sc1 ls0 ws0">34</div><div class="t m0 xa h6 y4d ff3 fs4 fc1 sc1 ls0 ws0">2.3<span class="_ _7"> </span>discrete<span class="_ _8"> </span>repre<span class="_ _6"></span>sentation<span class="_ _8"> </span><span class="ff1">的问<span class="_ _1"></span>题</span></div><div class="t m0 x22 h7 y4e ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....</div><div class="t m0 x9 h8 y4d ff3 fs4 fc1 sc1 ls0 ws0">34</div><div class="t m0 xa h6 y4f ff3 fs4 fc1 sc1 ls0 ws0">2.4<span class="_"> </span><span class="ff1">从<span class="_ _5"> </span></span>symbolic<span class="_ _8"> </span>represent<span class="_ _6"></span>ations<span class="_ _5"> </span><span class="ff1">到<span class="_ _8"> </span></span>di<span class="_ _1"></span>stributed<span class="_ _8"> </span>re<span class="_ _6"></span>presentations</div><div class="t m0 x23 h7 y50 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..</div><div class="t m0 x9 h8 y4f ff3 fs4 fc1 sc1 ls0 ws0">34</div><div class="t m0 xa h8 y51 ff3 fs4 fc1 sc1 ls0 ws0">2.5<span class="_ _7"> </span>Distributional<span class="_ _8"> </span>simil<span class="_ _1"></span>arity<span class="_ _8"> </span>based<span class="_ _8"> </span>representations</div><div class="t m0 x24 h7 y52 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y51 ff3 fs4 fc1 sc1 ls0 ws0">35</div><div class="t m0 xa h6 y53 ff3 fs4 fc1 sc1 ls0 ws0">2.6<span class="_"> </span><span class="ff1">通过向量定义<span class="_ _1"></span>词语的含义</span></div><div class="t m0 x10 h7 y54 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.............</div><div class="t m0 x9 h8 y53 ff3 fs4 fc1 sc1 ls0 ws0">35</div><div class="t m0 xa h6 y55 ff3 fs4 fc1 sc1 ls0 ws0">2.7<span class="_"> </span><span class="ff1">学习神经网络<span class="_ _5"> </span></span>word<span class="_ _8"> </span>embedding<span class="_ _1"></span>s<span class="_ _8"> </span><span class="ff1">的基<span class="_ _1"></span>本思路</span></div><div class="t m0 x25 h7 y56 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.</div><div class="t m0 x9 h8 y55 ff3 fs4 fc1 sc1 ls0 ws0">35</div><div class="t m0 xa h6 y57 ff3 fs4 fc1 sc1 ls0 ws0">2.8<span class="_"> </span><span class="ff1">直接学习低维<span class="_ _1"></span>词向量</span></div><div class="t m0 xd h7 y58 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y57 ff3 fs4 fc1 sc1 ls0 ws0">36</div><div class="t m0 xa h6 y59 ff3 fs4 fc1 sc1 ls0 ws0">2.9<span class="_ _7"> </span>word2vec<span class="_ _8"> </span><span class="ff1">的主<span class="_ _1"></span>要思路</span></div><div class="t m0 x26 h7 y5a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..................</div><div class="t m0 x9 h8 y59 ff3 fs4 fc1 sc1 ls0 ws0">36</div><div class="t m0 xa h6 y5b ff3 fs4 fc1 sc1 ls0 ws0">2.10<span class="_ _7"> </span>Skip-gram<span class="_ _5"> </span><span class="ff1">预测</span></div><div class="t m0 x27 h7 y5c ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>......</div><div class="t m0 x9 h8 y5b ff3 fs4 fc1 sc1 ls0 ws0">36</div><div class="t m0 xa h6 y5d ff3 fs4 fc1 sc1 ls0 ws0">2.11<span class="_ _7"> </span>word2vec<span class="_ _8"> </span><span class="ff1">细节</span></div><div class="t m0 x28 h7 y5e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y5d ff3 fs4 fc1 sc1 ls0 ws0">37</div><div class="t m0 xa h6 y5f ff3 fs4 fc1 sc1 ls0 ws0">2.12<span class="_"> </span><span class="ff1">目标函数<span class="_ _1"></span>细节</span></div><div class="t m0 x29 h7 y60 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..........</div><div class="t m0 x9 h8 y5f ff3 fs4 fc1 sc1 ls0 ws0">37</div><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a></div><div class="pi" data-data='{"ctm":[1.611830,0.000000,0.000000,1.611830,0.000000,0.000000]}'></div></div>

<div id="pf3" class="pf w0 h0" data-page-no="3"><div class="pc pc3 w0 h0"><img class="bi x0 y0 w1 h1" alt="" src="https://static.pudn.com/prod/directory_preview_static/624716ea54457c44d0393b40/bg3.jpg"><div class="t m0 xa h6 y61 ff3 fs4 fc1 sc1 ls0 ws0">2.13<span class="_ _7"> </span>Wo<span class="_ _6"></span>rd2V<span class="_ _6"></span>e<span class="_ _6"></span>c<span class="_ _8"> </span><span class="ff1">细节</span></div><div class="t m0 x2a h7 y62 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>......</div><div class="t m0 x9 h8 y61 ff3 fs4 fc1 sc1 ls0 ws0">37</div><div class="t m0 xa h6 y63 ff3 fs4 fc1 sc1 ls0 ws0">2.14<span class="_"> </span><span class="ff1">点积</span></div><div class="t m0 x2b h7 y64 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....</div><div class="t m0 x9 h8 y63 ff3 fs4 fc1 sc1 ls0 ws0">37</div><div class="t m0 xa h6 yd ff3 fs4 fc1 sc1 ls0 ws0">2.15<span class="_ _7"> </span>Softmax<span class="_ _8"> </span>function<span class="_ _1"></span><span class="ff1">：从实数空间到概<span class="_ _1"></span>率分布的标准映射<span class="_ _1"></span>方法</span></div><div class="t m0 x2c h7 ye ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>...............</div><div class="t m0 x9 h8 yd ff3 fs4 fc1 sc1 ls0 ws0">38</div><div class="t m0 xa h8 y10 ff3 fs4 fc1 sc1 ls0 ws0">2.16<span class="_ _7"> </span>Skipgram</div><div class="t m0 x2d h7 y65 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x9 h8 y10 ff3 fs4 fc1 sc1 ls0 ws0">38</div><div class="t m0 xa h6 y11 ff3 fs4 fc1 sc1 ls0 ws0">2.17<span class="_"> </span><span class="ff1">训练模型<span class="_ _1"></span>：计算参数向量的<span class="_ _1"></span>梯度</span></div><div class="t m0 x19 h7 y12 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>......................<span class="_ _6"></span>....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y11 ff3 fs4 fc1 sc1 ls0 ws0">40</div><div class="t m0 xa h6 y13 ff3 fs4 fc1 sc1 ls0 ws0">2.18<span class="_"> </span><span class="ff1">损失</span>/<span class="ff1">目标函数</span></div><div class="t m0 x2e h7 y14 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>........</div><div class="t m0 x9 h8 y13 ff3 fs4 fc1 sc1 ls0 ws0">43</div><div class="t m0 xa h6 y15 ff3 fs4 fc1 sc1 ls0 ws0">2.19<span class="_"> </span><span class="ff1">梯度下降<span class="_ _1"></span>、</span>SGD</div><div class="t m0 x28 h7 y16 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y15 ff3 fs4 fc1 sc1 ls0 ws0">43</div><div class="t m0 x6 h6 y17 ff1 fs4 fc1 sc1 ls0 ws0">研究热点<span class="_ _5"> </span><span class="ff3">2<span class="_"> </span></span>词语义项<span class="_ _1"></span>的线性代数结构与<span class="_ _1"></span>词义消歧</div><div class="t m0 x2f h7 y18 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y17 ff3 fs4 fc1 sc1 ls0 ws0">45</div><div class="t m0 xa h6 y19 ff3 fs4 fc1 sc1 ls0 ws0">2.1<span class="_"> </span><span class="ff1">复原</span></div><div class="t m0 x1f h7 y1a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y19 ff3 fs4 fc1 sc1 ls0 ws0">46</div><div class="t m0 xa h6 y1b ff3 fs4 fc1 sc1 ls0 ws0">2.2<span class="_"> </span><span class="ff1">复原结果</span></div><div class="t m0 x1c h7 y1c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y1b ff3 fs4 fc1 sc1 ls0 ws0">46</div><div class="t m0 xa h6 y1d ff3 fs4 fc1 sc1 ls0 ws0">2.3<span class="_"> </span><span class="ff1">量化评测</span></div><div class="t m0 x1c h7 y1e ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y1d ff3 fs4 fc1 sc1 ls0 ws0">46</div><div class="t m0 xa h6 y1f ff3 fs4 fc1 sc1 ls0 ws0">2.4<span class="_"> </span><span class="ff1">总结</span></div><div class="t m0 x1f h7 y20 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y1f ff3 fs4 fc1 sc1 ls0 ws0">47</div><div class="t m0 x6 h6 y21 ff1 fs4 fc1 sc1 ls0 ws0">笔记<span class="_ _5"> </span><span class="ff3">3<span class="_"> </span></span>高级词向量表<span class="_ _1"></span>示</div><div class="t m0 x29 h7 y22 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>..........</div><div class="t m0 x9 h8 y21 ff3 fs4 fc1 sc1 ls0 ws0">48</div><div class="t m0 xa h6 y23 ff3 fs4 fc1 sc1 ls0 ws0">3.1<span class="_"> </span><span class="ff1">复习：</span>word2vec<span class="_ _5"> </span><span class="ff1">的主要思路</span></div><div class="t m0 x30 h7 y24 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>........</div><div class="t m0 x9 h8 y23 ff3 fs4 fc1 sc1 ls0 ws0">48</div><div class="t m0 xa h6 y25 ff3 fs4 fc1 sc1 ls0 ws0">3.2<span class="_ _7"> </span>SGD<span class="_ _5"> </span><span class="ff1">与词向量</span></div><div class="t m0 x29 h7 y26 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..........</div><div class="t m0 x9 h8 y25 ff3 fs4 fc1 sc1 ls0 ws0">48</div><div class="t m0 xa h6 y66 ff3 fs4 fc1 sc1 ls0 ws0">3.3<span class="_"> </span><span class="ff1">近似：负采样</span></div><div class="t m0 x31 h7 y27 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>............</div><div class="t m0 x9 h8 y66 ff3 fs4 fc1 sc1 ls0 ws0">49</div><div class="t m0 xa h6 y67 ff3 fs4 fc1 sc1 ls0 ws0">3.4<span class="_ _7"> </span>negative<span class="_ _8"> </span>sampling<span class="_ _5"> </span><span class="ff1">和<span class="_ _8"> </span></span>skip<span class="_ _1"></span>-gram</div><div class="t m0 x32 h7 y29 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>...</div><div class="t m0 x9 h8 y67 ff3 fs4 fc1 sc1 ls0 ws0">49</div><div class="t m0 xa h6 y2b ff3 fs4 fc1 sc1 ls0 ws0">3.5<span class="_"> </span><span class="ff1">其他方法</span></div><div class="t m0 x1c h7 y2c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y2b ff3 fs4 fc1 sc1 ls0 ws0">50</div><div class="t m0 xa h6 y2d ff3 fs4 fc1 sc1 ls0 ws0">3.6<span class="_"> </span><span class="ff1">基于窗口的共<span class="_ _1"></span>现矩阵</span></div><div class="t m0 xd h7 y2e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y2d ff3 fs4 fc1 sc1 ls0 ws0">50</div><div class="t m0 xa h6 y2f ff3 fs4 fc1 sc1 ls0 ws0">3.7<span class="_"> </span><span class="ff1">朴素共现向量<span class="_ _1"></span>的问题</span></div><div class="t m0 xd h7 y30 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y2f ff3 fs4 fc1 sc1 ls0 ws0">51</div><div class="t m0 xa h6 y31 ff3 fs4 fc1 sc1 ls0 ws0">3.8<span class="_"> </span><span class="ff1">解决办法：低<span class="_ _1"></span>维向量</span></div><div class="t m0 xd h7 y32 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y31 ff3 fs4 fc1 sc1 ls0 ws0">51</div><div class="t m0 xa h6 y68 ff3 fs4 fc1 sc1 ls0 ws0">3.9<span class="_"> </span><span class="ff1">改进</span></div><div class="t m0 x1f h7 y33 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y68 ff3 fs4 fc1 sc1 ls0 ws0">52</div><div class="t m0 xa h6 y35 ff3 fs4 fc1 sc1 ls0 ws0">3.10<span class="_"> </span><span class="ff1">效果</span></div><div class="t m0 x2b h7 y36 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....</div><div class="t m0 x9 h8 y35 ff3 fs4 fc1 sc1 ls0 ws0">52</div><div class="t m0 xa h6 y37 ff3 fs4 fc1 sc1 ls0 ws0">3.11<span class="_ _7"> </span>SVD<span class="_ _5"> </span><span class="ff1">的问题</span></div><div class="t m0 x15 h7 y38 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>............</div><div class="t m0 x9 h8 y37 ff3 fs4 fc1 sc1 ls0 ws0">54</div><div class="t m0 xa h8 y3a ff3 fs4 fc1 sc1 ls0 ws0">3.12<span class="_ _7"> </span>Count<span class="_ _8"> </span>based<span class="_ _8"> </span>vs<span class="_ _8"> </span>direct<span class="_ _8"> </span>prediction</div><div class="t m0 x33 h7 y69 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y3a ff3 fs4 fc1 sc1 ls0 ws0">54</div><div class="t m0 xa h6 y3b ff3 fs4 fc1 sc1 ls0 ws0">3.13<span class="_"> </span><span class="ff1">综合两者<span class="_ _1"></span>优势：</span>GloVe</div><div class="t m0 x4 h7 y3c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.................</div><div class="t m0 x9 h8 y3b ff3 fs4 fc1 sc1 ls0 ws0">54</div><div class="t m0 xa h6 y3d ff3 fs4 fc1 sc1 ls0 ws0">3.14<span class="_"> </span><span class="ff1">评测方法</span></div><div class="t m0 x12 h7 y3e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..................</div><div class="t m0 x9 h8 y3d ff3 fs4 fc1 sc1 ls0 ws0">55</div><div class="t m0 xa h8 y40 ff3 fs4 fc1 sc1 ls0 ws0">3.15<span class="_ _7"> </span>Intrinsic<span class="_ _8"> </span>word<span class="_ _8"> </span>vector<span class="_ _8"> </span>evaluation</div><div class="t m0 x34 h7 y6a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.</div><div class="t m0 x9 h8 y40 ff3 fs4 fc1 sc1 ls0 ws0">55</div><div class="t m0 xa h6 y41 ff3 fs4 fc1 sc1 ls0 ws0">3.16<span class="_"> </span><span class="ff1">结果对比</span></div><div class="t m0 x12 h7 y42 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..................</div><div class="t m0 x9 h8 y41 ff3 fs4 fc1 sc1 ls0 ws0">57</div><div class="t m0 xa h6 y43 ff3 fs4 fc1 sc1 ls0 ws0">3.17<span class="_"> </span><span class="ff1">调参</span></div><div class="t m0 x2b h7 y44 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....</div><div class="t m0 x9 h8 y43 ff3 fs4 fc1 sc1 ls0 ws0">57</div><div class="t m0 xa h6 y45 ff3 fs4 fc1 sc1 ls0 ws0">3.18<span class="_"> </span><span class="ff1">另一个数<span class="_ _1"></span>据集</span></div><div class="t m0 x29 h7 y46 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..........</div><div class="t m0 x9 h8 y45 ff3 fs4 fc1 sc1 ls0 ws0">59</div><div class="t m0 xa h8 y48 ff3 fs4 fc1 sc1 ls0 ws0">3.19<span class="_ _7"> </span>Extrinsic<span class="_ _8"> </span>word<span class="_ _8"> </span>vector<span class="_ _8"> </span>evaluation</div><div class="t m0 x35 h7 y6b ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y48 ff3 fs4 fc1 sc1 ls0 ws0">60</div><div class="t m0 x6 h6 y49 ff1 fs4 fc1 sc1 ls0 ws0">笔记<span class="_ _5"> </span><span class="ff3">4<span class="_ _7"> </span>W<span class="_ _6"></span>or<span class="_ _6"></span>d<span class="_ _8"> </span>Window<span class="_ _5"> </span><span class="ff1">分类与神<span class="_ _1"></span>经网络</span></span></div><div class="t m0 x36 h7 y4a ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....</div><div class="t m0 x9 h8 y49 ff3 fs4 fc1 sc1 ls0 ws0">62</div><div class="t m0 xa h6 y4b ff3 fs4 fc1 sc1 ls0 ws0">4.1<span class="_"> </span><span class="ff1">分类问题</span></div><div class="t m0 x1c h7 y4c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y4b ff3 fs4 fc1 sc1 ls0 ws0">62</div><div class="t m0 xa h6 y4d ff3 fs4 fc1 sc1 ls0 ws0">4.2<span class="_ _7"> </span>softmax<span class="_ _5"> </span><span class="ff1">详细</span></div><div class="t m0 x31 h7 y4e ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...........</div><div class="t m0 x9 h8 y4d ff3 fs4 fc1 sc1 ls0 ws0">62</div><div class="t m0 xa h6 y4f ff3 fs4 fc1 sc1 ls0 ws0">4.3<span class="_ _7"> </span>softmax<span class="_ _5"> </span><span class="ff1">与交叉熵误差</span></div><div class="t m0 x4 h7 y50 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.................</div><div class="t m0 x9 h8 y4f ff3 fs4 fc1 sc1 ls0 ws0">62</div><div class="t m0 xa h6 y6c ff3 fs4 fc1 sc1 ls0 ws0">4.4<span class="_"> </span><span class="ff1">优化</span></div><div class="t m0 x1f h7 y51 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y6c ff3 fs4 fc1 sc1 ls0 ws0">63</div><div class="t m0 xa h6 y53 ff3 fs4 fc1 sc1 ls0 ws0">4.5<span class="_ _7"> </span>re-training<span class="_ _8"> </span><span class="ff1">词向<span class="_ _1"></span>量失去泛化效果</span></div><div class="t m0 x35 h7 y54 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y53 ff3 fs4 fc1 sc1 ls0 ws0">64</div><div class="t m0 xa h8 y56 ff3 fs4 fc1 sc1 ls0 ws0">4.6<span class="_ _7"> </span>Window<span class="_ _8"> </span>classif<span class="_ _1"></span>ication</div><div class="t m0 x37 h7 y6d ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y56 ff3 fs4 fc1 sc1 ls0 ws0">65</div><div class="t m0 xa h6 y57 ff3 fs4 fc1 sc1 ls0 ws0">4.6<span class="_"> </span><span class="ff1">最简单的分类<span class="_ _1"></span>器：</span>softmax</div><div class="t m0 x38 h7 y58 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>...........</div><div class="t m0 x9 h8 y57 ff3 fs4 fc1 sc1 ls0 ws0">65</div><div class="t m0 xa h6 y59 ff3 fs4 fc1 sc1 ls0 ws0">4.7<span class="_ _7"> </span>softmax<span class="ff1">（等价于<span class="_ _1"></span>逻辑斯谛回归）效<span class="_ _1"></span>果有限</span></div><div class="t m0 x25 h7 y5a ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.</div><div class="t m0 x9 h8 y59 ff3 fs4 fc1 sc1 ls0 ws0">66</div><div class="t m0 xa h6 y5b ff3 fs4 fc1 sc1 ls0 ws0">4.8<span class="_"> </span><span class="ff1">使用神经网络</span></div><div class="t m0 x31 h7 y5c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>............</div><div class="t m0 x9 h8 y5b ff3 fs4 fc1 sc1 ls0 ws0">67</div><div class="t m0 xa h6 y5d ff3 fs4 fc1 sc1 ls0 ws0">4.9<span class="_"> </span><span class="ff1">从逻辑斯谛回<span class="_ _1"></span>归到神经网络</span></div><div class="t m0 x21 h7 y5e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>........</div><div class="t m0 x9 h8 y5d ff3 fs4 fc1 sc1 ls0 ws0">67</div><div class="t m0 xa h6 y5f ff3 fs4 fc1 sc1 ls0 ws0">4.10<span class="_"> </span><span class="ff1">为什么需<span class="_ _1"></span>要非线性</span></div><div class="t m0 x39 h7 y60 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..</div><div class="t m0 x9 h8 y5f ff3 fs4 fc1 sc1 ls0 ws0">70</div><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a></div><div class="pi" data-data='{"ctm":[1.611830,0.000000,0.000000,1.611830,0.000000,0.000000]}'></div></div>

<div id="pf4" class="pf w0 h0" data-page-no="4"><div class="pc pc4 w0 h0"><img class="bi x0 y0 w1 h1" alt="" src="https://static.pudn.com/prod/directory_preview_static/624716ea54457c44d0393b40/bg4.jpg"><div class="t m0 xa h6 y61 ff3 fs4 fc1 sc1 ls0 ws0">4.11<span class="_"> </span><span class="ff1">前向传播<span class="_ _1"></span>网络</span></div><div class="t m0 x29 h7 y62 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..........</div><div class="t m0 x9 h8 y61 ff3 fs4 fc1 sc1 ls0 ws0">71</div><div class="t m0 xa h6 y63 ff3 fs4 fc1 sc1 ls0 ws0">4.12<span class="_"> </span><span class="ff1">间隔最大<span class="_ _1"></span>化目标函数</span></div><div class="t m0 x3a h7 y64 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y63 ff3 fs4 fc1 sc1 ls0 ws0">71</div><div class="t m0 xa h6 yd ff3 fs4 fc1 sc1 ls0 ws0">4.13<span class="_"> </span><span class="ff1">反向传播<span class="_ _1"></span>训练</span></div><div class="t m0 x29 h7 ye ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..........</div><div class="t m0 x9 h8 yd ff3 fs4 fc1 sc1 ls0 ws0">72</div><div class="t m0 x6 h6 yf ff1 fs4 fc1 sc1 ls0 ws0">研究热点<span class="_ _5"> </span><span class="ff3">3<span class="_"> </span></span>高效文本<span class="_ _1"></span>分类的锦囊妙计</div><div class="t m0 x8 h7 y10 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 yf ff3 fs4 fc1 sc1 ls0 ws0">74</div><div class="t m0 xa h6 y11 ff3 fs4 fc1 sc1 ls0 ws0">3.1<span class="_ _7"> </span>Facebook<span class="_ _8"> </span><span class="ff1">的<span class="_ _5"> </span></span>fastT<span class="_ _a"></span>ext</div><div class="t m0 x3b h7 y12 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................</div><div class="t m0 x9 h8 y11 ff3 fs4 fc1 sc1 ls0 ws0">74</div><div class="t m0 xa h6 y13 ff3 fs4 fc1 sc1 ls0 ws0">3.2<span class="_"> </span><span class="ff1">词袋模型</span></div><div class="t m0 x1c h7 y14 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y13 ff3 fs4 fc1 sc1 ls0 ws0">74</div><div class="t m0 xa h6 y15 ff3 fs4 fc1 sc1 ls0 ws0">3.3<span class="_"> </span><span class="ff1">简单的线性模<span class="_ _1"></span>型</span></div><div class="t m0 xb h7 y16 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>........</div><div class="t m0 x9 h8 y15 ff3 fs4 fc1 sc1 ls0 ws0">75</div><div class="t m0 xa h6 y17 ff3 fs4 fc1 sc1 ls0 ws0">3.4<span class="_"> </span><span class="ff1">训练</span></div><div class="t m0 x1f h7 y18 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y17 ff3 fs4 fc1 sc1 ls0 ws0">75</div><div class="t m0 xa h8 y1a ff3 fs4 fc1 sc1 ls0 ws0">3.5<span class="_ _7"> </span>Hierarchical<span class="_ _8"> </span>softmax</div><div class="t m0 x3c h7 y6e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y1a ff3 fs4 fc1 sc1 ls0 ws0">76</div><div class="t m0 xa h6 y1b ff3 fs4 fc1 sc1 ls0 ws0">3.6<span class="_"> </span><span class="ff1">效果与速度</span></div><div class="t m0 x1e h7 y1c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...............</div><div class="t m0 x9 h8 y1b ff3 fs4 fc1 sc1 ls0 ws0">76</div><div class="t m0 xa h6 y1d ff3 fs4 fc1 sc1 ls0 ws0">3.7<span class="_"> </span><span class="ff1">总结</span></div><div class="t m0 x1f h7 y1e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y1d ff3 fs4 fc1 sc1 ls0 ws0">77</div><div class="t m0 x6 h6 y1f ff1 fs4 fc1 sc1 ls0 ws0">笔记<span class="_ _5"> </span><span class="ff3">5<span class="_"> </span></span>反向传播与项<span class="_ _1"></span>目指导</div><div class="t m0 x39 h7 y20 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..</div><div class="t m0 x9 h8 y1f ff3 fs4 fc1 sc1 ls0 ws0">78</div><div class="t m0 xa h6 y21 ff3 fs4 fc1 sc1 ls0 ws0">5.1<span class="_"> </span><span class="ff1">任意层的通用<span class="_ _1"></span>公式</span></div><div class="t m0 xe h7 y22 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....</div><div class="t m0 x9 h8 y21 ff3 fs4 fc1 sc1 ls0 ws0">78</div><div class="t m0 xa h6 y23 ff3 fs4 fc1 sc1 ls0 ws0">5.2<span class="_"> </span><span class="ff1">反向传播的电<span class="_ _1"></span>路解释</span></div><div class="t m0 xd h7 y24 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y23 ff3 fs4 fc1 sc1 ls0 ws0">78</div><div class="t m0 xa h6 y25 ff3 fs4 fc1 sc1 ls0 ws0">5.3<span class="_"> </span><span class="ff1">第三种理解：<span class="_ _1"></span>流程图</span></div><div class="t m0 xd h7 y26 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y25 ff3 fs4 fc1 sc1 ls0 ws0">82</div><div class="t m0 xa h6 y66 ff3 fs4 fc1 sc1 ls0 ws0">5.4<span class="_"> </span><span class="ff1">第四种解释：<span class="_ _1"></span>实际神经网络中的<span class="_ _1"></span>误差信号</span></div><div class="t m0 x3d h7 y27 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....</div><div class="t m0 x9 h8 y66 ff3 fs4 fc1 sc1 ls0 ws0">86</div><div class="t m0 xa h6 y67 ff3 fs4 fc1 sc1 ls0 ws0">5.5<span class="_"> </span><span class="ff1">课程项目</span></div><div class="t m0 x1c h7 y29 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y67 ff3 fs4 fc1 sc1 ls0 ws0">87</div><div class="t m0 x6 h6 y2b ff1 fs4 fc1 sc1 ls0 ws0">研究热点<span class="_ _5"> </span><span class="ff3">4<span class="_"> </span></span>词嵌入对<span class="_ _1"></span>传统方法的启发</div><div class="t m0 x8 h7 y2c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y2b ff3 fs4 fc1 sc1 ls0 ws0">88</div><div class="t m0 xa h6 y2d ff3 fs4 fc1 sc1 ls0 ws0">4.1<span class="_"> </span><span class="ff1">词语表示方法</span></div><div class="t m0 x31 h7 y2e ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>............</div><div class="t m0 x9 h8 y2d ff3 fs4 fc1 sc1 ls0 ws0">88</div><div class="t m0 xa h6 y2f ff3 fs4 fc1 sc1 ls0 ws0">4.2<span class="_ _7"> </span>Skip-Gram<span class="_ _8"> </span><span class="ff1">中的<span class="_ _1"></span>超参数</span></div><div class="t m0 x4 h7 y30 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x9 h8 y2f ff3 fs4 fc1 sc1 ls0 ws0">89</div><div class="t m0 xa h6 y31 ff3 fs4 fc1 sc1 ls0 ws0">4.3<span class="_"> </span><span class="ff1">对<span class="_ _5"> </span></span>PMI<span class="_ _8"> </span><span class="ff1">的启<span class="_ _1"></span>发</span></div><div class="t m0 x3e h7 y32 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...........</div><div class="t m0 x9 h8 y31 ff3 fs4 fc1 sc1 ls0 ws0">89</div><div class="t m0 xa h6 y68 ff3 fs4 fc1 sc1 ls0 ws0">4.4<span class="_"> </span><span class="ff1">可调超参数一<span class="_ _1"></span>览表</span></div><div class="t m0 xe h7 y33 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....</div><div class="t m0 x9 h8 y68 ff3 fs4 fc1 sc1 ls0 ws0">90</div><div class="t m0 xa h6 y35 ff3 fs4 fc1 sc1 ls0 ws0">4.5<span class="_"> </span><span class="ff1">调参结果</span></div><div class="t m0 x1c h7 y36 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y35 ff3 fs4 fc1 sc1 ls0 ws0">90</div><div class="t m0 xa h6 y37 ff3 fs4 fc1 sc1 ls0 ws0">4.6<span class="_"> </span><span class="ff1">结论</span></div><div class="t m0 x1f h7 y38 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y37 ff3 fs4 fc1 sc1 ls0 ws0">91</div><div class="t m0 x6 h6 y39 ff1 fs4 fc1 sc1 ls0 ws0">笔记<span class="_ _5"> </span><span class="ff3">6<span class="_"> </span></span>句法分析</div><div class="t m0 x3f h7 y3a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.</div><div class="t m0 x9 h8 y39 ff3 fs4 fc1 sc1 ls0 ws0">92</div><div class="t m0 xa h6 y3b ff3 fs4 fc1 sc1 ls0 ws0">6.1<span class="_"> </span><span class="ff1">语言学的两种<span class="_ _1"></span>观点</span></div><div class="t m0 xe h7 y3c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....</div><div class="t m0 x9 h8 y3b ff3 fs4 fc1 sc1 ls0 ws0">92</div><div class="t m0 xa h6 y3d ff3 fs4 fc1 sc1 ls0 ws0">6.2<span class="_"> </span><span class="ff1">歧义</span></div><div class="t m0 x1f h7 y3e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y3d ff3 fs4 fc1 sc1 ls0 ws0">92</div><div class="t m0 xa h6 y3f ff3 fs4 fc1 sc1 ls0 ws0">6.3<span class="_"> </span><span class="ff1">依附歧义</span></div><div class="t m0 x1c h7 y40 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y3f ff3 fs4 fc1 sc1 ls0 ws0">93</div><div class="t m0 xa h6 y41 ff3 fs4 fc1 sc1 ls0 ws0">6.4<span class="_"> </span><span class="ff1">标注数据集的<span class="_ _1"></span>崛起：</span>Universal<span class="_ _8"> </span>Dependenc<span class="_ _1"></span>ies<span class="_ _8"> </span>6.5<span class="_ _8"> </span>treebanks</div><div class="t m0 x1a h7 y42 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y41 ff3 fs4 fc1 sc1 ls0 ws0">93</div><div class="t m0 xa h6 y43 ff3 fs4 fc1 sc1 ls0 ws0">6.6<span class="_"> </span><span class="ff1">依存文法与依<span class="_ _1"></span>存结构</span></div><div class="t m0 xd h7 y44 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y43 ff3 fs4 fc1 sc1 ls0 ws0">94</div><div class="t m0 xa h6 y45 ff3 fs4 fc1 sc1 ls0 ws0">6.7<span class="_"> </span><span class="ff1">起源</span></div><div class="t m0 x1f h7 y46 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x9 h8 y45 ff3 fs4 fc1 sc1 ls0 ws0">95</div><div class="t m0 xa h6 y47 ff3 fs4 fc1 sc1 ls0 ws0">6.8<span class="_"> </span><span class="ff1">一些细节</span></div><div class="t m0 x1c h7 y48 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y47 ff3 fs4 fc1 sc1 ls0 ws0">96</div><div class="t m0 xa h6 y49 ff3 fs4 fc1 sc1 ls0 ws0">6.9<span class="_"> </span><span class="ff1">句法分析可用<span class="_ _1"></span>的特征</span></div><div class="t m0 xd h7 y4a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y49 ff3 fs4 fc1 sc1 ls0 ws0">96</div><div class="t m0 xa h6 y4b ff3 fs4 fc1 sc1 ls0 ws0">6.10<span class="_"> </span><span class="ff1">依存句法<span class="_ _1"></span>分析</span></div><div class="t m0 x29 h7 y4c ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..........</div><div class="t m0 x9 h8 y4b ff3 fs4 fc1 sc1 ls0 ws0">96</div><div class="t m0 xa h8 y4e ff3 fs4 fc1 sc1 ls0 ws0">6.11<span class="_ _7"> </span>Arc-standard<span class="_ _8"> </span>t<span class="_ _6"></span>ransition</div><div class="t m0 x40 h7 y6f ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...............</div><div class="t m0 x9 h8 y4e ff3 fs4 fc1 sc1 ls0 ws0">96</div><div class="t m0 xa h8 y50 ff3 fs4 fc1 sc1 ls0 ws0">6.12<span class="_ _7"> </span>MaltParser</div><div class="t m0 x41 h7 y70 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.............</div><div class="t m0 x9 h8 y50 ff3 fs4 fc1 sc1 ls0 ws0">97</div><div class="t m0 xa h6 y6c ff3 fs4 fc1 sc1 ls0 ws0">6.13<span class="_"> </span><span class="ff1">传统特征<span class="_ _1"></span>表示</span></div><div class="t m0 x29 h7 y51 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..........</div><div class="t m0 x9 h8 y6c ff3 fs4 fc1 sc1 ls0 ws0">97</div><div class="t m0 xa h6 y53 ff3 fs4 fc1 sc1 ls0 ws0">6.14<span class="_"> </span><span class="ff1">效果评估</span></div><div class="t m0 x12 h7 y54 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..................</div><div class="t m0 x9 h8 y53 ff3 fs4 fc1 sc1 ls0 ws0">97</div><div class="t m0 xa h6 y55 ff3 fs4 fc1 sc1 ls0 ws0">6.15<span class="_"> </span><span class="ff1">投射性</span></div><div class="t m0 x3f h7 y56 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x9 h8 y55 ff3 fs4 fc1 sc1 ls0 ws0">98</div><div class="t m0 xa h6 y57 ff3 fs4 fc1 sc1 ls0 ws0">6.16<span class="_"> </span><span class="ff1">为什么需<span class="_ _1"></span>要神经网络句法分<span class="_ _1"></span>析器</span></div><div class="t m0 x19 h7 y58 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>......................<span class="_ _6"></span>....................<span class="_ _6"></span>...................</div><div class="t m0 x9 h8 y57 ff3 fs4 fc1 sc1 ls0 ws0">98</div><div class="t m0 xa h6 y59 ff3 fs4 fc1 sc1 ls0 ws0">6.17<span class="_"> </span><span class="ff1">神经网络<span class="_ _1"></span>依存句法分析器</span></div><div class="t m0 x11 h7 y5a ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>..........</div><div class="t m0 x9 h8 y59 ff3 fs4 fc1 sc1 ls0 ws0">99</div><div class="t m0 xa h6 y5b ff3 fs4 fc1 sc1 ls0 ws0">6.18<span class="_"> </span><span class="ff1">为何需要<span class="_ _1"></span>非线性</span></div><div class="t m0 xf h7 y5c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....</div><div class="t m0 x42 h8 y5b ff3 fs4 fc1 sc1 ls0 ws0">100</div><div class="t m0 xa h6 y5d ff3 fs4 fc1 sc1 ls0 ws0">6.19<span class="_"> </span><span class="ff1">未来工作</span></div><div class="t m0 x12 h7 y5e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>................</div><div class="t m0 x42 h8 y5d ff3 fs4 fc1 sc1 ls0 ws0">101</div><div class="t m0 x6 h8 y60 ff3 fs4 fc1 sc1 ls0 ws0">Assignment<span class="_ _8"> </span>1</div><div class="t m0 x43 h7 y71 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>......</div><div class="t m0 x42 h8 y60 ff3 fs4 fc1 sc1 ls0 ws0">102</div><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a></div><div class="pi" data-data='{"ctm":[1.611830,0.000000,0.000000,1.611830,0.000000,0.000000]}'></div></div>

<div id="pf5" class="pf w0 h0" data-page-no="5"><div class="pc pc5 w0 h0"><img class="bi x0 y0 w1 h1" alt="" src="https://static.pudn.com/prod/directory_preview_static/624716ea54457c44d0393b40/bg5.jpg"><div class="t m0 xa h8 y62 ff3 fs4 fc1 sc1 ls0 ws0">1.1<span class="_ _7"> </span>Softmax</div><div class="t m0 x44 h7 y72 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..................</div><div class="t m0 x42 h8 y62 ff3 fs4 fc1 sc1 ls0 ws0">102</div><div class="t m0 x45 h6 y63 ff3 fs4 fc1 sc1 ls0 ws0">1.1.1<span class="_ _7"> </span>softmax<span class="_ _5"> </span><span class="ff1">常数不变<span class="_ _1"></span>性</span></div><div class="t m0 x46 h7 y64 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x42 h8 y63 ff3 fs4 fc1 sc1 ls0 ws0">102</div><div class="t m0 x45 h6 yd ff3 fs4 fc1 sc1 ls0 ws0">1.1.2<span class="_ _7"> </span>Python<span class="_ _9"> </span><span class="ff1">实现</span></div><div class="t m0 x47 h7 ye ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................</div><div class="t m0 x42 h8 yd ff3 fs4 fc1 sc1 ls0 ws0">102</div><div class="t m0 xa h6 yf ff3 fs4 fc1 sc1 ls0 ws0">1.2<span class="_"> </span><span class="ff1">神经网络基础</span></div><div class="t m0 x31 h7 y10 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>..........</div><div class="t m0 x42 h8 yf ff3 fs4 fc1 sc1 ls0 ws0">103</div><div class="t m0 x45 h6 y11 ff3 fs4 fc1 sc1 ls0 ws0">1.2.1<span class="_ _7"> </span>sigmoid<span class="_ _5"> </span><span class="ff1">梯度</span></div><div class="t m0 x48 h7 y12 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................</div><div class="t m0 x42 h8 y11 ff3 fs4 fc1 sc1 ls0 ws0">103</div><div class="t m0 x45 h6 y13 ff3 fs4 fc1 sc1 ls0 ws0">1.2.2<span class="_"> </span><span class="ff1">交叉熵损<span class="_ _1"></span>失函数的梯度</span></div><div class="t m0 x49 h7 y14 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...</div><div class="t m0 x42 h8 y13 ff3 fs4 fc1 sc1 ls0 ws0">104</div><div class="t m0 x45 h6 y15 ff3 fs4 fc1 sc1 ls0 ws0">1.2.3<span class="_"> </span><span class="ff1">推导三层<span class="_ _1"></span>网络的梯度</span></div><div class="t m0 x46 h7 y16 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x42 h8 y15 ff3 fs4 fc1 sc1 ls0 ws0">105</div><div class="t m0 x45 h6 y17 ff3 fs4 fc1 sc1 ls0 ws0">1.2.4<span class="_"> </span><span class="ff1">参数数量</span></div><div class="t m0 x4a h7 y18 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.......</div><div class="t m0 x42 h8 y17 ff3 fs4 fc1 sc1 ls0 ws0">106</div><div class="t m0 x45 h6 y19 ff3 fs4 fc1 sc1 ls0 ws0">1.2.5<span class="_"> </span><span class="ff1">实现<span class="_ _5"> </span></span>sigmoid<span class="_ _5"> </span><span class="ff1">函数</span></div><div class="t m0 x20 h7 y1a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.............</div><div class="t m0 x42 h8 y19 ff3 fs4 fc1 sc1 ls0 ws0">106</div><div class="t m0 x45 h6 y1b ff3 fs4 fc1 sc1 ls0 ws0">1.2.6<span class="_"> </span><span class="ff1">实现梯度<span class="_ _1"></span>检查</span></div><div class="t m0 x3c h7 y1c ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................</div><div class="t m0 x42 h8 y1b ff3 fs4 fc1 sc1 ls0 ws0">107</div><div class="t m0 x45 h6 y1d ff3 fs4 fc1 sc1 ls0 ws0">1.2.7<span class="_"> </span><span class="ff1">实现前向<span class="_ _1"></span>传播和反向传播</span></div><div class="t m0 x3 h7 y1e ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>....................</div><div class="t m0 x42 h8 y1d ff3 fs4 fc1 sc1 ls0 ws0">108</div><div class="t m0 x6 h6 y1f ff1 fs4 fc1 sc1 ls0 ws0">研究热点<span class="_ _5"> </span><span class="ff3">5<span class="_"> </span></span>图像对话</div><div class="t m0 x41 h7 y20 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>............</div><div class="t m0 x42 h8 y1f ff3 fs4 fc1 sc1 ls0 ws0">110</div><div class="t m0 xa h6 y21 ff3 fs4 fc1 sc1 ls0 ws0">5.1<span class="_"> </span><span class="ff1">相关工作</span></div><div class="t m0 x1c h7 y22 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x42 h8 y21 ff3 fs4 fc1 sc1 ls0 ws0">110</div><div class="t m0 xa h6 y23 ff3 fs4 fc1 sc1 ls0 ws0">5.2<span class="_"> </span><span class="ff1">图像视频自动<span class="_ _1"></span>标题</span></div><div class="t m0 xe h7 y24 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..</div><div class="t m0 x42 h8 y23 ff3 fs4 fc1 sc1 ls0 ws0">110</div><div class="t m0 xa h6 y25 ff3 fs4 fc1 sc1 ls0 ws0">5.3<span class="_"> </span><span class="ff1">图像语义对齐</span></div><div class="t m0 x31 h7 y26 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>..........</div><div class="t m0 x42 h8 y25 ff3 fs4 fc1 sc1 ls0 ws0">111</div><div class="t m0 xa h6 y66 ff3 fs4 fc1 sc1 ls0 ws0">5.4<span class="_"> </span><span class="ff1">图像<span class="_ _5"> </span></span>QA</div><div class="t m0 x3f h7 y27 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...................</div><div class="t m0 x42 h8 y66 ff3 fs4 fc1 sc1 ls0 ws0">111</div><div class="t m0 xa h6 y67 ff3 fs4 fc1 sc1 ls0 ws0">5.5<span class="_"> </span><span class="ff1">贡献</span></div><div class="t m0 x1f h7 y29 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....</div><div class="t m0 x42 h8 y67 ff3 fs4 fc1 sc1 ls0 ws0">112</div><div class="t m0 xa h6 y2b ff3 fs4 fc1 sc1 ls0 ws0">5.6<span class="_"> </span><span class="ff1">技术细节</span></div><div class="t m0 x1c h7 y2c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x42 h8 y2b ff3 fs4 fc1 sc1 ls0 ws0">112</div><div class="t m0 xa h6 y2d ff3 fs4 fc1 sc1 ls0 ws0">5.7<span class="_"> </span><span class="ff1">数据集</span></div><div class="t m0 x1d h7 y2e ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x42 h8 y2d ff3 fs4 fc1 sc1 ls0 ws0">113</div><div class="t m0 xa h6 y2f ff3 fs4 fc1 sc1 ls0 ws0">5.8<span class="_"> </span><span class="ff1">结果</span></div><div class="t m0 x1f h7 y30 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....</div><div class="t m0 x42 h8 y2f ff3 fs4 fc1 sc1 ls0 ws0">113</div><div class="t m0 x6 h6 y31 ff1 fs4 fc1 sc1 ls0 ws0">笔记<span class="_ _5"> </span><span class="ff3">7<span class="_ _7"> </span>T<span class="_ _a"></span>ensorFlow<span class="_ _5"> </span><span class="ff1">入门</span></span></div><div class="t m0 x2e h7 y32 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>......</div><div class="t m0 x42 h8 y31 ff3 fs4 fc1 sc1 ls0 ws0">115</div><div class="t m0 xa h6 y68 ff3 fs4 fc1 sc1 ls0 ws0">7.1<span class="_"> </span><span class="ff1">深度学习框架<span class="_ _1"></span>简介</span></div><div class="t m0 xe h7 y33 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..</div><div class="t m0 x42 h8 y68 ff3 fs4 fc1 sc1 ls0 ws0">115</div><div class="t m0 xa h6 y35 ff3 fs4 fc1 sc1 ls0 ws0">7.2<span class="_ _7"> </span>TF<span class="_ _5"> </span><span class="ff1">是什么</span></div><div class="t m0 x2d h7 y36 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>...............</div><div class="t m0 x42 h8 y35 ff3 fs4 fc1 sc1 ls0 ws0">115</div><div class="t m0 xa h6 y37 ff3 fs4 fc1 sc1 ls0 ws0">7.3<span class="_"> </span><span class="ff1">图计算编程模<span class="_ _1"></span>型</span></div><div class="t m0 xb h7 y38 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>......</div><div class="t m0 x42 h8 y37 ff3 fs4 fc1 sc1 ls0 ws0">116</div><div class="t m0 xa h6 y39 ff3 fs4 fc1 sc1 ls0 ws0">7.4<span class="_"> </span><span class="ff1">图在哪里</span></div><div class="t m0 x1c h7 y3a ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x42 h8 y39 ff3 fs4 fc1 sc1 ls0 ws0">117</div><div class="t m0 xa h6 y3b ff3 fs4 fc1 sc1 ls0 ws0">7.5<span class="_"> </span><span class="ff1">如何运行</span></div><div class="t m0 x1c h7 y3c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x42 h8 y3b ff3 fs4 fc1 sc1 ls0 ws0">118</div><div class="t m0 xa h6 y3d ff3 fs4 fc1 sc1 ls0 ws0">7.6<span class="_"> </span><span class="ff1">训练</span></div><div class="t m0 x1f h7 y3e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....</div><div class="t m0 x42 h8 y3d ff3 fs4 fc1 sc1 ls0 ws0">118</div><div class="t m0 xa h6 y3f ff3 fs4 fc1 sc1 ls0 ws0">7.7<span class="_"> </span><span class="ff1">如何计算梯度</span></div><div class="t m0 x31 h7 y40 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>..........</div><div class="t m0 x42 h8 y3f ff3 fs4 fc1 sc1 ls0 ws0">118</div><div class="t m0 xa h6 y41 ff3 fs4 fc1 sc1 ls0 ws0">7.8<span class="_"> </span><span class="ff1">变量共享</span></div><div class="t m0 x1c h7 y42 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x42 h8 y41 ff3 fs4 fc1 sc1 ls0 ws0">119</div><div class="t m0 xa h6 y43 ff3 fs4 fc1 sc1 ls0 ws0">7.9<span class="_"> </span><span class="ff1">总结</span></div><div class="t m0 x1f h7 y44 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....</div><div class="t m0 x42 h8 y43 ff3 fs4 fc1 sc1 ls0 ws0">119</div><div class="t m0 xa h6 y45 ff3 fs4 fc1 sc1 ls0 ws0">7.10<span class="_"> </span><span class="ff1">现场演示</span></div><div class="t m0 x12 h7 y46 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>................</div><div class="t m0 x42 h8 y45 ff3 fs4 fc1 sc1 ls0 ws0">120</div><div class="t m0 x6 h6 y47 ff1 fs4 fc1 sc1 ls0 ws0">研究热点<span class="_ _5"> </span><span class="ff3">6<span class="_"> </span></span>基于转移<span class="_ _1"></span>的神经网络句法分<span class="_ _1"></span>析的结构化训<span class="_ _1"></span>练</div><div class="t m0 x4b h7 y48 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..............</div><div class="t m0 x42 h8 y47 ff3 fs4 fc1 sc1 ls0 ws0">121</div><div class="t m0 xa h6 y49 ff3 fs4 fc1 sc1 ls0 ws0">6.1<span class="_"> </span><span class="ff1">什么是<span class="_ _5"> </span></span>Synta<span class="_ _6"></span>xNet</div><div class="t m0 x27 h7 y4a ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....</div><div class="t m0 x42 h8 y49 ff3 fs4 fc1 sc1 ls0 ws0">121</div><div class="t m0 xa h6 y4b ff3 fs4 fc1 sc1 ls0 ws0">6.2<span class="_"> </span><span class="ff1">项贡献</span></div><div class="t m0 x1d h7 y4c ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................</div><div class="t m0 x42 h8 y4b ff3 fs4 fc1 sc1 ls0 ws0">121</div><div class="t m0 xa h6 y4d ff3 fs4 fc1 sc1 ls0 ws0">6.3<span class="_ _7"> </span>T<span class="_ _6"></span>r<span class="_ _6"></span>i-T<span class="_ _b"></span>raining<span class="ff1">：利用未标注数据</span></div><div class="t m0 x4c h7 y4e ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>..</div><div class="t m0 x42 h8 y4d ff3 fs4 fc1 sc1 ls0 ws0">121</div><div class="t m0 xa h6 y4f ff3 fs4 fc1 sc1 ls0 ws0">6.4<span class="_"> </span><span class="ff1">模型改进</span></div><div class="t m0 x1c h7 y50 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x42 h8 y4f ff3 fs4 fc1 sc1 ls0 ws0">122</div><div class="t m0 xa h6 y6c ff3 fs4 fc1 sc1 ls0 ws0">6.5<span class="_"> </span><span class="ff1">结构化感知机<span class="_ _1"></span>训练与柱搜索</span></div><div class="t m0 x21 h7 y51 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>......</div><div class="t m0 x42 h8 y6c ff3 fs4 fc1 sc1 ls0 ws0">122</div><div class="t m0 xa h6 y53 ff3 fs4 fc1 sc1 ls0 ws0">6.6<span class="_ _8"> </span><span class="ff1">结论</span></div><div class="t m0 x43 h7 y54 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>......</div><div class="t m0 x42 h8 y53 ff3 fs4 fc1 sc1 ls0 ws0">123</div><div class="t m0 x6 h6 y55 ff1 fs4 fc1 sc1 ls0 ws0">笔记<span class="_ _5"> </span><span class="ff3">8<span class="_ _7"> </span>RNN<span class="_ _5"> </span></span>和语言模型</div><div class="t m0 xb h7 y56 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....</div><div class="t m0 x42 h8 y55 ff3 fs4 fc1 sc1 ls0 ws0">125</div><div class="t m0 xa h6 y57 ff3 fs4 fc1 sc1 ls0 ws0">8.1<span class="_"> </span><span class="ff1">语言模型</span></div><div class="t m0 x1c h7 y58 ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x42 h8 y57 ff3 fs4 fc1 sc1 ls0 ws0">125</div><div class="t m0 xa h6 y59 ff3 fs4 fc1 sc1 ls0 ws0">8.2<span class="_"> </span><span class="ff1">传统语言模型</span></div><div class="t m0 x31 h7 y5a ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>....................<span class="_ _6"></span>..........</div><div class="t m0 x42 h8 y59 ff3 fs4 fc1 sc1 ls0 ws0">125</div><div class="t m0 xa h8 y5c ff3 fs4 fc1 sc1 ls0 ws0">8.3<span class="_ _7"> </span>Recurrent<span class="_ _8"> </span>Neural<span class="_ _8"> </span>Net<span class="_ _6"></span>works</div><div class="t m0 x11 h7 y73 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>........</div><div class="t m0 x42 h8 y5c ff3 fs4 fc1 sc1 ls0 ws0">126</div><div class="t m0 xa h6 y5d ff3 fs4 fc1 sc1 ls0 ws0">8.4<span class="_"> </span><span class="ff1">损失函数</span></div><div class="t m0 x1c h7 y5e ff4 fs4 fc1 sc1 ls0 ws0">.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.................</div><div class="t m0 x42 h8 y5d ff3 fs4 fc1 sc1 ls0 ws0">128</div><div class="t m0 xa h6 y5f ff3 fs4 fc1 sc1 ls0 ws0">8.5<span class="_"> </span><span class="ff1">训练<span class="_ _5"> </span></span>RNN<span class="_ _5"> </span><span class="ff1">很难</span></div><div class="t m0 x4d h7 y60 ff4 fs4 fc1 sc1 ls0 ws0">....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>.....................<span class="_ _6"></span>........</div><div class="t m0 x42 h8 y5f ff3 fs4 fc1 sc1 ls0 ws0">128</div><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a><a class="l" rel='nofollow' onclick='return false;'><div class="d m1"></div></a></div><div class="pi" data-data='{"ctm":[1.611830,0.000000,0.000000,1.611830,0.000000,0.000000]}'></div></div>