Posted 2021-04-29 鏈哄櫒瀛︿範AI绠楁硶宸ョ▼

鍚慉I杞瀷鐨勭▼搴忓憳閮藉叧娉ㄤ簡杩欎釜鍙?/span>馃憞馃憞馃憞

鍏充簬鎺ㄨ崘绯荤粺锛屽鏋滃湪蹇樻帀鎵€鏈夌殑鍏紡鍜屼唬鐮侊紝蹇樿鎵€鏈夌殑璇█鎻忚堪锛岃剳娴烽噷灏卞墿涓嬪嚑寮犲浘鏅紝浼氭槸浠€涔堬紵涓€寮?/span>浜岀淮琛ㄦ牸锛屼竴涓?/span>鎷撴墤鍥?/span>锛屼竴鏉?/span>鏃堕棿绾?/span>銆傝繖涓夊箙鍥炬櫙锛屾槸鎴戠湅寰呮帹鑽愮畻娉曠殑涓夌瑙嗚銆?/span>

瑙嗚涓€锛氱煩闃佃瑙?/h3>

鍦ㄨ剳涓兂璞′竴涓簩缁寸殑琛ㄦ牸锛屾瘡涓€琛屼唬琛ㄤ竴涓敤鎴凤紝姣忎竴鍒椾唬琛ㄤ竴涓墿鍝侊紝琛ㄦ牸閲岀殑姣忎竴涓偣浠ｈ〃鐢ㄦ埛瀵圭墿鍝佺殑鎿嶄綔锛岃繖涓搷浣滃彲浠ユ槸璇勫垎锛岀偣鍑伙紝鐐硅禐銆傚叾涓紝鏈変簺鏍煎瓙璁板綍浜嗚涓猴紝鏈変簺鏍煎瓙鏄┖鐨勩€傚埌杩欓噷锛屾垜浠氨寤虹珛浜嗗熀鏈殑鐭╅樀瑙嗚锛?span class="mq-16">鎺ㄨ崘闂杞寲鎴愪簡濡備綍琛ヤ笂閭ｄ簺绌烘牸瀛愩€?/span>

鐢ㄦ埛瀵圭墿鍝佺殑璇勫垎绛変簬鐩镐技鐢ㄦ埛瀵硅鐗╁搧璇勫垎鐨勫姞鏉冨钩鍧囧€硷紝杩欏氨鏄?span class="mq-20">user-base鐨勫崗鍚岃繃婊?/span>浜嗐€傛崲涓€涓柟鍚戯紝鐢ㄦ埛瀵圭墿鍝佺殑璇勫垎绛変簬璇ョ敤鎴峰鍏朵粬鐗╁搧鐨勮瘎鍒嗘寜鐗╁搧鐩镐技鍔犳潈骞冲潎鍊硷紝杩欏氨鏄?span class="mq-21">item-base鐨勫崗鍚岃繃婊?/span>銆傚害閲忕敤鎴蜂箣闂寸殑鐩镐技搴︼紝鎶婄煩闃电殑涓€琛屸€斺€斿鐗╁搧鐨勮瘎鍒嗗悜閲忎綔涓鸿鐢ㄦ埛鐨勮〃绀哄悜閲忥紝閭ｄ箞鐢ㄦ埛涔嬮棿鍙互璁＄畻鍚戦噺鐨勮窛绂伙紝鍙互閫夋嫨浠讳綍璺濈鍏紡锛屽浣欏鸡璺濈锛岀毊灏旀．璺濈銆傚浜庣墿鍝佷箣闂寸殑鐩镐技搴︼紝鎹竴涓柟鍚戝嵆鍙€?/p>

瀵逛簬浠讳綍涓や釜鐗╁搧锛屽彲浠ヨ绠楀畠浠殑璇勫垎宸€笺€傚叿浣撴潵璇达紝涓や釜鐗╁搧鏈変竴鎵瑰叡鍚岀殑鍘嗗彶璇勫垎鐢ㄦ埛锛屼篃灏辨槸鐭╅樀閲屼袱鍒楁湁浜ら泦鐨勮锛屾瘡涓€琛屽彲浠ヨ绠椾竴涓樊鍊硷紝灏嗗樊鍊煎钩鍧囪捣鏉ワ紝浣滀负涓や釜鐗╁搧鐨勮窛绂汇€傚拰涓婇潰鐨勮窛绂讳笉鍚岀殑锛岃繖涓樊鍊煎彲浠ユ兂璞℃垚鐗╃悊涓殑浣嶇Щ锛屽甫鐫€绗﹀彿鐨勩€傛帹鑽愭椂锛屾煇鐢ㄦ埛瀵逛簬鏌愪釜鐗╁搧鐨勮瘎鍒嗭紝绛変簬鏌愮敤鎴峰鍏朵粬鐗╁搧璇勫垎鍔犱笂杩欎釜浣嶇Щ锛屽啀杩涜骞冲潎寰楀埌鐨勫钩鍧囪瘎鍒嗐€傚拰涓婇潰鐨刬tem-base涓€鏍风殑锛岄兘鏄垪鍚戦噺璁＄畻鐩镐技搴︼紝鍙笉杩囩浉浼煎害鐢辫窛绂诲彉鎴愪簡浣嶇Щ銆傝繖灏辨槸钁楀悕鐨?span class="mq-23">Slope-One绠楁硶銆?/span>

鍦?span class="mq-33">MF鐨勫熀纭€涓婏紝鑰冭檻鎺ㄨ崘涓殑side information锛屽鐢ㄦ埛鐨勫勾榫勬€у埆锛岀墿鍝佺殑绫荤洰浠锋牸銆傜敤鎴峰拰鐗╁搧鑷韩鎴栧睘鎬хО浣滀竴涓猣ield锛宖ield涔嬮棿鍙互涓や袱杩涜鐭╅樀鍒嗚В锛岃繖涓绉颁綔浜岄樁椤癸紝绫讳技BiasSVD鑰冭檻姣忎竴涓猣ield閮芥湁涓€涓猙ias锛岃繖涓绉颁綔涓€闃堕」锛屽啀鍔犱笂涓€涓叏灞€鐨刡ias椤广€傝繖灏辨槸钁楀悕鐨?span class="mq-35">Factorization Machines锛團M锛夈€?/span>

瑙嗚浜岋細鍥捐瑙?/h3>

鎶婄敤鎴峰拰鐗╁搧鐪嬩綔椤剁偣锛岀敤鎴风殑璇勫垎鍦ㄧ敤鎴峰拰鐗╁搧涔嬮棿寤虹珛璧?span class="mq-42">杈?/span>锛屽氨寰楀埌浜嗕竴涓?span class="mq-43">浜岄儴鍥?/span>锛涘湪浜岄儴鍥剧殑鍩虹涓婃坊鍔犳洿澶氱殑椤剁偣鍜岃竟锛屽舰鎴愪竴涓洿涓哄鏉傜殑鍥撅紝杈呭姪浜岄儴鍥剧殑璁＄畻銆?span class="mq-44">鍦ㄥ浘鐨勮瑙掍笅锛屾帹鑽愰棶棰樿浆鍖栨垚浜嗗湪鍥句笂瀵绘壘楂樻晥鐨勯摼鎺ユā寮忋€?/span>

鎴戜滑璁や负鍦ㄥ悓涓€涓敤鎴风殑鍘嗗彶琛屼负涓紝閭ｄ箞涓や釜鐗╁搧涔嬮棿鏈変竴鏉¤竟锛岀幇鍦ㄨ璁＄畻涓や釜鐗╁搧涔嬮棿鐨勭浉浼煎害锛屾渶鏈寸礌鐨勬€濇兂灏辨槸鏁颁竴鏁颁粬浠箣闂存湁澶氬皯鏉¤竟銆傝€冭檻姣忎竴鏉¤竟鏉冮噸涓嶄竴鏍凤紝杈规槸閫氳繃鐢ㄦ埛寤虹珛鐨勶紝鐢ㄦ埛鐨勭偣鍑荤殑鐗╁搧瓒婂锛屽搴旇竟鐨勬潈閲嶅氨瓒婂皬銆傝繖灏辨槸Adamic/Adar绠楁硶鐨勬€濇兂銆?/p>

闃块噷钁楀悕鐨勫崗鍚岃繃婊ゆ帹鑽愮畻娉?span class="mq-50">swing锛屽鎵惧浘涓洿鍔犵ǔ鍥虹殑褰㈢姸锛屽叡鍚岃瘎鍒嗚繃涓や釜鐗╁搧鐨勭敤鎴烽泦鍚堜腑锛屾瘡涓や釜鐢ㄦ埛鍜岃繖涓袱涓墿鍝佸舰鎴愪簡涓€涓洓杈瑰舰(涓嬪浘绾㈣竟涓轰竴涓猻wing缁撴瀯)锛岀粺璁℃湁澶氬皯涓繖鏍风殑缁撴瀯锛屾瘡涓€涓粨鏋勭殑鏉冮噸鏄笉鍚岀殑锛岃繖涓粨鏋勯噷涓や釜鐢ㄦ埛鍏卞悓璇勫垎杩囩殑鐗╁搧鐨勬暟閲忚秺澶氭潈閲嶅氨瓒婂皬銆?/p>

浠庣敤鎴峰拰鐗╁搧鐨勪簩閮ㄥ浘鍑哄彂杩涜鏋勫浘锛屽啀缁撳悎闅愬洜瀛愭ā鍨?Latent Factor Model)锛屽氨杩涘叆浜?/span>Graph-Embedding鐨勯鍩熴€?/span>DeepWalk绠楁硶鍦ㄥ浘涓婇殢鏈烘父璧版繁搴︿紭鍏堥亶鍘嗗緱鍒板簭鍒楋紝鐒跺悗鍜?/span>word2vec绫讳技鍦颁娇鐢?/span>Skip-Gram锛圓鍜孊搴忓垪涓浉閭伙紝鐢ˋ鐨別mbedding浣滀负鐗瑰緛鏈€澶у寲B鐨勯€変腑姒傜巼锛夎繘琛岃缁冦€?/span>Node2Vec绠楁硶鍦?/span>DeepWalk鐨勫熀纭€涓婏紝鑰冭檻闅忔満娓歌蛋鐨勬柟寮忥紝寮曞叆娣卞害浼樺厛鍜屽箍搴︿紭鍏堢殑鏉冭　锛岃兘澶熷緱鍒版洿濂界殑鏇寸伒娲荤殑椤剁偣闅愬紡琛ㄧず銆?/span>LINE绠楁硶鑰冭檻椤剁偣鐨勪簩闃剁浉浼硷紝涓や釜椤剁偣鏈夎竟涓轰竴闃剁浉浼硷紝涓や釜椤剁偣鏈夊叡鍚岀殑閭诲眳椤剁偣涓轰簩闃剁浉浼硷紝瀹冭櫧涓嶅仛闅忔満娓歌蛋锛屼絾鍙互鐪嬩綔鏄箍搴︿紭鍏堢殑閲囨牱銆?/span>Graph-Embedding鍙栧緱浜嗛《鐐圭殑embedding锛岃绠楃浉浼煎害鍙互寰楀埌鐢ㄦ埛鐗╁搧璺濈锛岀墿鍝佺墿鍝佽窛绂伙紝鐢ㄤ簬鎺ㄨ崘銆?/span>

GCN锛堝浘鍗风Н锛?/span>鎺ユ敹鎷撴墤鍥句綔涓虹綉缁滆緭鍏ワ紝鍙互璁＄畻姣忎竴涓《鐐规洿濂界殑琛ㄧず锛岀浉姣?span class="mq-76">graph-embedding鍙互鏈夌洃鐫ｅ湴涓烘帹鑽愮洰鏍囪€岃缁冦€備絾GCN鍦ㄨ繍绠楁椂锛屾瘡涓€灞傞兘瑕佽緭鍏ユ暣涓浘锛屽湪鎺ㄨ崘绯荤粺閲岋紝鐗╁搧鍜岀敤鎴烽兘鍙互鏄櫨涓囩骇鍒互涓婏紝瀹為檯涓棤娉曚娇鐢ㄣ€?span class="mq-78">GraphSAGE閫氳繃RandomWalk閲囨牱锛岃В鍐充簡杩欎釜闂锛岀敤鍦ㄦ帹鑽愰鍩熷氨鏄?span class="mq-79">PinSage绠楁硶銆備粠鏌愰《鐐瑰嚭鍙戯紝娣卞害浼樺厛璧発姝ワ紝寰楀埌澶氫釜瀛愬浘锛岀粍鎴愪竴涓猙atch杩涜璁粌锛屻€傜劧鍚庢寜鐓ч噰鏍风殑鍙嶆柟鍚戝仛鍓嶅悜浼犳挱锛岃繖灏辨槸涓€涓猭灞傜殑鍥剧綉缁滐紝涓嬪浘鏄竴涓猭涓?鐨勪緥瀛愩€?/p>

鍦ㄧ敤鎴峰拰鐗╁搧鐨勪簩閮ㄥ浘鍩虹涓婏紝澧炲姞鐗╁搧鐨勫睘鎬т綔涓洪《鐐癸紝寤虹珛鏂扮殑杈癸紝灏卞緱鍒颁簡涓€涓?span class="mq-83">寮傝川淇℃伅缃戠粶銆傛瘮濡備竴涓數褰辨帹鑽愮郴缁燂紝闄や簡鐢ㄦ埛鍜岀數褰卞锛岃繕鏈夊婕旓紝婕斿憳锛岀數褰辩被鍨嬶紝瀵兼紨鎷嶆憚鐢靛奖锛岀數褰卞睘浜庢煇绉嶇被鍨嬶紝婕斿憳鍑烘紨鐢靛奖锛屽婕斾笌婕斿憳鍚堜綔锛岃濡傛绫诲氨鑳藉缓绔嬪緢澶氳竟銆傚叾涓竴绫绘帹鑽愮畻娉曞彨鍋?span class="mq-84">meta-path锛岄€氳繃涓撳缁忛獙浜哄伐鎸戦€夊嚭涓€浜涘浘涓矾寰勶紝濡傜敤鎴?>婕斿憳->鐢靛奖锛岀敤鎴?>瀵兼紨->鐢靛奖锛岃繖鏍风殑璺緞绉颁箣涓簃eta-path锛岃绠楁瘡涓€鏉eta-path鐨勬潈閲嶏紝灏嗙敤鎴峰拰鐗╁搧闂寸殑鎵€鏈塵eta-path鑱斿悎璁＄畻璇勫垎銆?/p>

瑙嗚涓夛細鏃堕棿绾?/h3>

鎶婄敤鎴峰鐗╁搧鐨勮涓烘兂璞℃垚涓€鏉℃椂闂寸嚎锛屾垜浠凡鐭ュ綋鍓嶆椂鍒诲墠鐢ㄦ埛鐨勭墿鍝佽涓哄簭鍒楋紝鎺ㄨ崘闂琚浆鍖栨垚浜嗛娴嬩笅涓€涓椂鍒荤敤鎴峰彂鐢熻涓虹殑鐗╁搧銆?/span>

鍋囪搴忓垪涓笅涓€涓墿鍝佸彧涓庝笂涓€涓墿鍝佹湁鍏筹紝鍙互浣跨敤椹皵绉戝か妯″瀷MC锛圡arkov Chains锛?/span>锛屽簭鍒椾腑鐩搁偦鐨勭墿鍝侀棿杩涜鐭╅樀鍒嗚В銆傜粨鍚堜笂鏂囨彁鍒扮殑鐢ㄦ埛鍜岀墿鍝侀棿鐭╅樀鍒嗚ВMF锛岀敤鎴凤紝褰撳墠琛屼负鐗╁搧鍜屼笅涓€涓墿鍝佷笁鑰呬箣闂翠袱涓よ繘琛岀煩闃靛垎瑙ｏ紝灏嗕笁涓€煎姞璧锋潵鎷熷悎璇勫垎锛屽氨寰楀埌浜?/span>FPMC锛團actorizing Personalized Markov Chains锛夌畻娉?/span>銆?/span>

浠ュ墠妯″瀷鐨勮緭鍏ュ舰寮忔湁闄愶紝浜轰滑閫氳繃鐗瑰緛澶勭悊灏嗘暟鎹粍缁囨垚妯″瀷鍙互鎺ュ彈鐨勫舰寮忥紱闅忕潃娣卞害瀛︿範鐨勫彂灞曪紝鏁版嵁瓒婃潵瓒婂€惧悜浜庝繚瀛樺叾鍘熸湁鐨勫舰寮忥紝浜轰滑閫氳繃妯″瀷璁捐鏉ュ涔犳湁鏁堢殑妯″紡銆傚湪鏃堕棿绾跨殑瑙嗚涓嬶紝鐩存帴鐢ㄦ繁搴︽ā鍨嬬粨鏋勫缓妯″簭鍒楋紝棰勬祴涓嬩竴鐗╁搧锛屽舰鎴愪簡涓€涓彲浠ュ彂鎸ユ兂璞″姏鍜岀噧鐑х畻鍔涚殑棰嗗煙鈥斺€?/span>Sequential/Session-base鎺ㄨ崘銆傚湪2016骞寸殑鏃跺€欙紝RNN鏄鐞嗗簭鍒楅棶棰樼殑鏍囬厤锛屽畠浠嶯LP棰嗗煙璧版潵锛岃癁鐢熶簡GRU4Rec绠楁硶銆傚彈鍒癗LP棰嗗煙Char-CNN鍚彂锛孋NN鐨勭粨鏋勪篃閫愭笎鐢ㄤ簬寤烘ā搴忓垪缁撴瀯锛孉ttention鏈哄埗澶х伀涔嬪悗锛孯NN+Attention锛孋NN+Attention锛孯NN+CNN+Attention琚灇涓句簡涓€閬嶃€傞殢鐫€google鑰佸笀鐨?/span>BERT鍙栧緱NLP棰嗗煙宸ㄥぇ鎴愬氨锛孲elf-Attention浠ュ強澶氬眰鐨凾ransformer缁撴瀯寮€濮嬫垚涓哄簭鍒楀缓妯＄殑甯歌閰嶇疆銆傛渶杩戠殑鏂囩珷閲岋紝鍥剧缁忕綉缁?GNN),Memory networks,鍙樺垎鑷紪鐮佸櫒(VAE)涔熸垚涓轰簡搴忓垪鎺ㄨ崘棰嗗煙鐨勬繁搴︿箰楂樼Н鏈ㄣ€?/span>

鍦–TR棰勪及棰嗗煙锛岃秺鏉ヨ秺澶氱殑妯″瀷鐩存帴灏嗙敤鎴峰巻鍙茶涓哄簭鍒楁寜鐓ф椂闂撮『搴忔帓鍒楋紝浣跨敤娣卞害妯″瀷缁撴瀯鐩存帴寤烘ā銆?/p>

鎬荤粨

鍏跺疄濡傛灉瑕佺粏鏁帮紝杩樻湁涓€涓瑙掑彨鍋?span class="mq-122">楂樼淮绌洪棿瑙嗚銆傜敤鎴峰拰鐗╁搧閮芥槸涓€涓珮缁村害绌洪棿閲岀殑鐐癸紝绌洪棿閲岀偣涔嬮棿鐨勮窛绂昏秺杩戯紝浠ｈ〃鐫€鐗╁搧鍜岀墿鍝佽秺鐩稿叧锛岀敤鎴峰鐗╁搧瓒婂亸濂斤紝鎺ㄨ崘闂杞寲鎴愪簡濡備綍灏嗙敤鎴峰拰鐗╁搧宓屽叆鍒伴珮缁寸┖闂撮噷銆?/span>鍏稿瀷鐨勪富棰樺Metric Learning銆?/span>涓嶈繃杩欎釜瑙嗚鐨勬浜ゆ€т笉濂斤紝娣卞害瀛︿範甯嵎鎺ㄨ崘绯荤粺鍚庯紝embedding鏄釜澶父瑙佺殑鎬濊矾锛屽墠闈㈠緢澶氱殑鏂规硶涔熼兘鏄渶缁堟妸闂杞寲鎴愪簡楂樼淮绌洪棿宓屽叆锛屽graph-embedding锛?span class="mq-127">Transition-base鎺ㄨ崘銆備负浜嗛伩鍏嶅綊绫讳笂鐨勭籂缁擄紱鍐嶅姞涓婁换浣曚竴涓繁搴︾綉缁滀綔涓篍ncoder鎶婄敤鎴峰拰鐗╁搧embedding锛岄兘鍙互褰掑湪杩欎釜瑙嗚锛屾病鏈夐偅涔堝浠や汉鍗拌薄娣卞埢鐨勫吀鍨嬫柟娉曪紝灏变笉鍋氬崟鐙⒊鐞嗕簡銆?/p>

To My Best Knowledge锛屾垜鎶婅嚜宸辫涓烘帹鑽愮郴缁熼噷缁忓吀涓斾护浜哄嵃璞℃繁鍒荤殑鏂规硶褰掑湪涓夌瑙嗚涓€斺€?span class="mq-129">鐭╅樀锛?span class="mq-130">鍥?/span>锛?span class="mq-131">鏃堕棿绾?/span>銆傚鏋滃浣犱粠鍋忕畻娉曠殑瑙掑害鐞嗚В鎺ㄨ崘绯荤粺鏈夋墍鍔╃泭锛屾垜灏卞緢寮€蹇冧簡銆?/p>

---

闃呰杩囨湰鏂囩殑浜鸿繕鐪嬩簡浠ヤ笅鏂囩珷锛?/strong>

涓嶆柇鏇存柊璧勬簮

娣卞害瀛︿範銆佹満鍣ㄥ涔犮€佹暟鎹垎鏋愩€乸ython

鏈哄櫒瀛︿範绠楁硶璧勬簮绀剧兢

涓嶆柇涓婁紶鐢靛瓙鐗圥DF璧勬枡

鎶€鏈棶棰樻眰瑙?br class="mq-301">

---

娴锋窐缇庡