鏈€鏂?绡嘔CLR2021绡囧浘绁炵粡缃戠粶璁烘枃鎺ㄨ崘

Posted 2021-04-03 涓撶煡

tags:

篇首语：本文由小常识网(cha138.com)小编为大家整理，主要介绍了鏈€鏂?绡嘔CLR2021绡囧浘绁炵粡缃戠粶璁烘枃鎺ㄨ崘相关的知识，希望对你有一定的参考价值。

CCF-S绾т細璁甀CLR鍒氬垰鏀炬~(灏忕紪瑕佹槸涓簡ICLR鑳藉惞涓€骞答煒别煒别煒?/p>

杩欓噷鎺ㄨ崘鍑犵瘒ICLR 2021鎺ユ敹鐨勬渶鏂癎NN璁烘枃~

1.鏃跺簭缃戠粶涓殑鍒╃敤鍥犳灉鍖垮悕娓歌蛋鐨?/span>褰掔撼琛ㄧず瀛︿範

2.鍏锋湁鑷洃鐫ｈ兘鍔涚殑鍥炬敞鎰忓姏鏈哄埗

3.鍥剧缁忕綉缁滅殑鐡堕鍙婂叾瀹炶返鎰忎箟

4.ADAGCN锛氬皢鍥惧嵎绉綉缁滆浆鎹负娣卞眰妯″瀷

5.閫氳繃鍥惧灞傛睜鍖栧噯纭涔犲浘琛ㄧず

6.鍩轰簬绁炵粡缃戠粶鐨勫浘绮楀寲

1.INDUCTIVE REPRESENTATION LEARNING IN TEMPORAL NETWORKS VIA CAUSAL ANONYMOUS WALKS

https://arxiv.org/pdf/2101.05974.pdf

鏃跺簭缃戠粶鏄幇瀹炰笘鐣屼腑鍔ㄦ€佺郴缁熺殑鎶借薄銆傝繖浜涚綉缁滈€氬父鏍规嵁鏌愪簺瀹氬緥鍙戝睍锛屼緥濡?span class="mq-37">绀句氦缃戠粶涓緢鏅亶鐨勪笁鍏冮棴鍖呭畾寰嬨€傚綊绾宠〃绀哄涔犳椂闂寸綉缁滃簲璇ヨ兘澶熸崟鑾锋绫诲畾寰嬶紝骞惰繘涓€姝ュ皢閬靛惊鐩稿悓瀹氬緥搴旂敤浜庢湭鍦ㄨ缁冭繃绋嬩腑瑙佽繃鐨勬暟鎹?鍗砳nductive鐨勮兘鍔涖€備互鍓嶇殑宸ヤ綔涓昏渚濊禆浜庣綉缁滆妭鐐硅韩浠芥垨涓板瘜杈瑰睘鎬э紝閫氬父鏃犳硶鎻愬彇杩欎簺瀹氬緥銆傚洜姝?鏈枃鎻愬嚭浜?/span>鍥犳灉鍏崇郴鍖垮悕娓歌蛋锛圕ausal Anonymous Walks, CAW锛?/strong>鏉?span class="mq-39">inductively鐨勮繘琛屾椂搴忕綉缁滅殑琛ㄧず瀛︿範銆?/span>

鍏蜂綋鏉ヨ锛?/span>CAW鏄€氳繃鏃堕棿闅忔満娓歌蛋鎻愬彇绫讳技motif鐨勭粨鏋勬潵鎹曡幏鍥剧殑鍔ㄦ€佹€э紝杩欓伩鍏嶄簡motif璁＄畻澶嶆潅鐨勯棶棰樸€傚悓鏃?CAW閲囩敤鏂伴鐨勫尶鍚嶅寲绛栫暐锛岀敤涓€缁勮妭鐐圭殑鍛戒腑璁?/span>鏁版潵鏇挎崲鑺傜偣韬唤浠ヤ繚鎸佹ā鍨媔nductive鐨勮兘鍔涳紝鍚屾椂涔熷缓绔嬩簡motif涔嬮棿鐨勭浉鍏虫€?span class="mq-45">锛?/span>杩欏浜庢煇浜涘浘鎸栨帢浠诲姟(濡傞摼璺娴?鏄潪甯稿叧閿殑銆傝繘涓€姝ョ殑锛?/span>鏈枃杩涗竴姝ユ彁鍑轰簡涓€涓缁忕綉缁滄ā鍨婥AW-N鏉ョ紪鐮丆AW銆傛渶鍚庯紝鍦?涓湡瀹炴椂搴忕綉缁滄暟鎹泦涓?span class="mq-47">锛?/span>CAW-N鍧囧彇寰椾簡澶у箙搴︾殑鎻愬崌锛?/span>渚嬪AUC鎻愬崌浜?5%!

妯″瀷鍥?/span>

鏈€鏂?绡嘔CLR2021绡囧浘绁炵粡缃戠粶璁烘枃鎺ㄨ崘

鍥犳灉鍏崇郴鎻愬彇鍜屽熀浜庨泦鍚堢殑鍖垮悕

瀹為獙缁撴灉

鏈€鏂?绡嘔CLR2021绡囧浘绁炵粡缃戠粶璁烘枃鎺ㄨ崘

鍙互鐪嬪埌CAW妯″瀷鏄庢樉浼樹簬鍏朵粬妯″瀷銆?span class="mq-62">

2.HOW TO FIND YOUR FRIENDLY NEIGHBORHOOD:GRAPH ATTENTION DESIGN WITH SELF-SUPERVISION

https://openreview.net/pdf?id=Wi5KUNlqWty

鍥剧缁忕綉缁滀腑鐨勬敞鎰忓姏鏈哄埗鏃ㄥ湪鍒嗛厤鏇村ぇ鐨勬潈閲嶇粰閲嶈鐨勯偦灞呰妭鐐癸紝浠ヨ繘琛屾洿濂藉湴琛ㄧず銆備絾鏄紝鍥剧缁忕綉缁滃鍒扮殑涓滆タ涓嶆槸閭ｄ箞瀹规槗鐞嗚В鐨勶紝灏ゅ叾鏄湪鏈夊櫔澹扮殑鍥句笂銆傝€屾湰鏂囨彁鍑虹殑鑷洃鐫ｇ殑鍥炬敞鎰忓姏缃戠粶锛圫uperGAT锛?/strong>灏辨槸鐢ㄦ潵瑙ｅ喅杩欎竴闂鐨勩€?/span>

妯″瀷鍥?/span>

鍥?

鍘熷GAT涓嶴uperGAT瀵规瘮锛?span class="mq-87">鍘熷鐨凣AT濡傜煩褰㈠浘涓墍绀恒€係uperGAT閫氳繃涓€瀵硅妭鐐逛腑鏄惁瀛樺湪杈规潵寮曞娉ㄦ剰鍔涖€傜敤 $a_{phi}$ 鍜?nbsp; $sigma$ 琛ㄧず鑺傜偣 $i$ 鍜岃妭鐐?nbsp; $j$ 涔嬮棿鏈夎竟鐨勬鐜?nbsp; $phi_{ij}$ ,鍗?/span>

$a_{phi}: mathbb{R}^{F} imes mathbb{R}^{F} ightarrow mathbb{R} quad ext { and } quad phi_{i j}=P((j, i) in E)=sigmaleft(a_{phi}left(oldsymbol{W} oldsymbol{h}_{i}, oldsymbol{W} oldsymbol{h}_{j} ight) ight)$

瀹為獙缁撴灉

鍥?

3.ON THE BOTTLENECK OF GRAPH NEURAL NETWORKSAND ITS PRACTICAL IMPLICATIONS

https://openreview.net/pdf?id=i80OPhOCVH2

鑷粠Gori绛変汉鎻愬嚭鍥剧缁忕綉缁滐紙GNN锛変互鏉ワ紝璁粌GNN鐨勪富瑕侀棶棰樹箣涓€鏄湪鍥句腑鐨勮繙璺濈鑺傜偣涔嬮棿浼犳挱淇℃伅銆傛湰鏂囨彁鍑篏NN鍦ㄨ緝闀胯矾寰勪腑鑱氶泦淇℃伅鏃朵細鍑虹幇鐡堕銆傝繖涓摱棰堝鑷?span class="mq-131">over-squarshing銆傝繖鏍稧NN灏?span class="mq-133">鏃犳硶浼犳挱婧愯嚜杩滅▼鑺傜偣鐨勬秷鎭?/span>锛屾墽琛屾晥鏋滀篃涓嶅ソ銆傛湰鏂囦腑璋冩暣浜嗚繙绋婫NN妯″瀷闂锛屾棤闇€浠讳綍璋冩暣鎴栭澶栫殑鏉冮噸鍗冲彲绐佺牬鐡堕寰楀埌鏀瑰杽鍚庣殑缁撴灉銆?/p>

妯″瀷鍥?/p>

鍥?

浠庡浘涓彲浠ョ湅鍑猴紝鐩稿RNN鑰岃█锛孏NN涓殑鐡堕瀵圭粨鏋滅殑褰卞搷鏇村ぇ銆?/p>

杩欓」宸ヤ綔骞堕潪鏃ㄥ湪鎻愬嚭鏂扮殑GNN鍙樹綋銆傜浉鍙嶏紝杩欓」宸ヤ綔鐨勪富瑕佽础鐚槸锛氬己璋僄NN鍥烘湁鐨勭摱棰堥棶棰橈紝骞惰鏄庣摱棰堥棶棰樻槸鏈夊鐨勩€?/p>

瀹為獙缁撴灉

鍥?

浠庡浘涓彲浠ョ湅鍑猴紝鍦ㄩ偦灞呭尮閰嶉棶棰樹腑锛岄殢鐫€GNN娣卞害鐨勫鍔狅紝妯″瀷鐨勭簿纭害鍦ㄤ笅闄嶃€?/p>

4.ADAGCN: ADABOOSTING GRAPH CONVOLUTIONALNETWORKS INTO DEEP MODELS

https://openreview.net/pdf?id=QkRbdiiEjM

娣卞浘妯″瀷鐨勮璁′粛鏈夊緟鐮旂┒锛屽叾涓嚦鍏抽噸瑕侀儴鍒嗘槸濡備綍浠ユ湁鏁堢殑鏂瑰紡鎺㈢储鍜屽埄鐢ㄦ潵鑷偦灞呯殑璺冭縼銆傚湪鏈枃涓紝閫氳繃灏咥daBoost闆嗘垚鍒扮綉缁滆绠椾腑锛屾彁鍑轰簡涓€绉嶆柊棰栫殑绫籖NN娣卞害鍥剧缁忕綉缁滄灦鏋?/span>銆傛彁鍑虹殑鍥惧嵎绉綉缁淎daGCN锛圓daboosting鍥惧嵎绉綉缁滐級鍏锋湁鏈夋晥鎻愬彇鏉ヨ嚜褰撳墠鑺傜偣鐨勯珮闃堕偦灞呯煡璇嗙殑鑳藉姏銆?/p>

涓嶅悓浜庡叾浠栫洿鎺ュ爢鍙犲浘鍗风Н灞傜殑鍥剧缁忕綉缁滐紝AdaGCN鍦ㄦ墍鏈夆€滃眰鈥濅箣闂村叡浜浉鍚岀殑鍩虹绁炵粡缃戠粶鏋舵瀯骞惰繘琛岄€掑綊浼樺寲澶勭悊锛岀被浼间簬RNN銆?/span>

姝ゅ锛屾湰鏂囪繕鍦ㄧ悊璁轰笂寤虹珛浜咥daGCN涓庣幇鏈夊浘鍗风Н鏂规硶涔嬮棿鐨勮仈绯伙紝浠庤€屽睍绀轰簡妯″瀷鐨勪紭鍔裤€傛渶鍚庯紝鐢ㄥ疄楠岃瘉鏄庝簡AdaGCN鐨勮绠椾紭鍔裤€?/p>

妯″瀷鍥?/p>

鍥?

瀹為獙缁撴灉

鍥?

琛ㄦ牸涓樉绀轰簡涓嶅悓妯″瀷鐨勭簿搴﹀姣斻€傚彲浠ョ湅鍒癆daGCN姣斿叾浠栨ā鍨嬭〃鐜版洿濂姐€?/p>

5.ACCURATE LEARNING OF GRAPH REPRESENTATIONSWITH GRAPH MULTISET POOLING

https://openreview.net/pdf?id=JHcqXGaqiGn

娑堟伅浼犻€掑浘绁炵粡缃戠粶宸插箍娉涚敤浜庡缓妯″浘鏁版嵁锛屽湪璁稿鍥惧舰鍒嗙被鍜岄摼璺娴嬩换鍔′笂鍙栧緱浜嗗緢濂界殑鏁堟灉銆傜劧鑰岋紝涓轰簡鑾峰緱鍥惧舰鐨勫噯纭〃绀鸿繕闇€瑕佸畾涔夎壇濂界殑姹犲寲鍔熻兘锛屽嵆鍦ㄤ笉涓㈠け鍗曚釜鑺傜偣鐗瑰緛鍜屽叏灞€鍥剧粨鏋勭殑鍓嶆彁涓嬪皢鑺傜偣琛ㄧず闆嗘槧灏勫埌绱у噾鐨勫舰寮忋€?/p>

涓轰簡瑙ｅ喅鐜版湁鐨勫浘姹犲寲鐨勯檺鍒讹紝鏈枃灏嗗浘姹犲寲闂琛ㄨ堪涓哄甫鏈夊叧浜庡浘缁撴瀯鐨勮緟鍔╀俊鎭殑澶氶泦缂栫爜闂锛屽苟鎻愬嚭浜?span class="mq-207">鍥惧舰澶氶泦杞崲鍣紙GMT锛?/span>銆傝鏂规硶鍙互杞绘澗鎵╁睍鍒颁互鍓嶇殑鑺傜偣鑱氱被鏂规硶锛屾潵杩涜鍒嗗眰鍥炬睜鍖栥€傚疄楠岀粨鏋滆〃鏄庯紝GMT鏄庢樉浼樹簬鍏朵粬鍥惧舰姹犲寲鏂规硶锛屽苟鍦ㄥ浘閲嶆瀯鍜岀敓鎴愪换鍔′笂鑾峰緱寰堝ぇ鐨勬€ц兘鎻愬崌銆?/p>

妯″瀷鍥?/p>

鍥?

瀹為獙缁撴灉

鍥?

浠庡疄楠岀粨鏋滃彲浠ョ湅鍑篏MT姣斿叾浠栨ā鍨嬫晥鏋滄洿濂?/p>

6.GRAPH COARSENING WITH NEURAL NETWORKS

https://openreview.net/pdf?id=uxpzitPEooJ

闅忕潃澶ц妯″浘鐨勬棩鐩婃祦琛岋紝澶勭悊锛屾彁鍙栧拰鍒嗘瀽澶у瀷鍥惧舰鏁版嵁鐨勮绠楅毦棰樻湁鐫€瓒婃潵瓒婇噸瑕佹剰涔夈€?span class="mq-238">鍥剧矖鍖?/span>鏄竴绉嶅湪淇濇寔鍩烘湰灞炴€х殑鍚屾椂鍑忓皬鍥惧昂瀵哥殑鎶€鏈€傚敖绠℃湁涓板瘜鐨勫浘绮楀寲鏂囩尞锛屼絾鍙湁鏈夐檺鐨勬暟鎹┍鍔ㄦ柟娉曘€?/p>

鏈枃鍒╃敤鍥炬繁搴﹀涔犵殑鏈€鏂拌繘灞曟潵杩涜鍥剧矖鍖栥€傞鍏堟彁鍑烘祴閲忕矖鍖栫畻娉曡川閲忕殑妗嗘灦骞惰鏄庢垜浠渶瑕佹牴鎹洰鏍囦粩缁嗛€夋嫨鍥剧矖鍖栫殑Laplace杩愮畻绗﹀拰鐩稿叧鐨勬姇褰?鎻愬崌杩愮畻绗︺€傜敱浜庣矖鍖栧浘鐨勫綋鍓嶈竟鏉冨彲鑳戒笉鏄渶浼樼殑閫夋嫨锛岀敤鍥剧缁忕綉缁滃鏉冮噸鍒嗛厤鍥捐繘琛屽弬鏁板寲骞跺鍏惰繘琛岃缁冿紝浠ユ棤鐩戠潱鐨勬柟寮忔彁楂樼矖鍖栬川閲忋€傞€氳繃鍦ㄥ悎鎴愮綉缁滃拰鐪熷疄缃戠粶涓婅繘琛岀殑骞挎硾瀹為獙锛岃瘉鏄庝簡璇ユ柟娉曟樉鐫€鏀瑰杽浜嗗悇绉嶆潯浠朵笅鐨勫父鐢ㄥ浘绮楀寲鏂规硶鎸囨爣锛岀缉灏忕巼锛屽浘灏哄鍜屽浘绫诲瀷銆傚畠姒傛嫭涓鸿緝澶х殑灏哄锛堣缁冨浘鐨?5鍊嶏級锛屽彲閫傚簲涓嶅悓鐨勬崯鑰楋紙鍙井鍒嗗拰涓嶅彲寰垎锛夛紝骞朵笖鍙互缂╂斁鍒版瘮浠ュ墠澶у緱澶氱殑鍥俱€?/p>

妯″瀷鍥?/p>