浜戞爾骞茶揣鍥為 | 琛屼笟椤剁骇NoSQL鎴愬憳鍧愰晣锛孨oSQL鏁版嵁搴撲笓鍦洪噸鐐硅В鏋愶紒

Posted 2021-05-01 闃块噷浜戞暟鎹簱

NoSQL鏁版嵁搴撲綔涓烘暟鎹簱甯傚満鏈€閲嶈鐨勭粍鎴愪箣涓€锛屽畠鐨勪竴涓句竴鍔ㄩ兘褰卞搷鐫€鎴愬崈涓婁竾鐨勪紒涓氥€?/span>

鏈笓鍦洪個璇蜂簡琛屼笟椤剁骇鐨凬oSQL鏍稿績鎴愬憳涓庡ぇ瀹跺叡鍚屽睍鏈汵oSQL鏁版嵁搴撶殑鏈潵锛?/span> 闃块噷宸村反銆丮ongoDB銆丷edisson銆佹枟楸肩瓑 鍏徃鐨勬妧鏈ぇ鍜栦笌澶у鍏卞悓鍒嗕韩浜嗛樋閲屼簯NoSQL鏁版嵁搴撶殑浼佷笟绾х壒鎬у強琛屼笟瑙ｅ喅鏂规銆?/span>

1

Redis & MongoDB浜戞暟鎹簱鎶€鏈墫鏋?/span>

馃敹 闃块噷浜戞暟鎹簱浜у搧浜嬩笟閮ㄦ妧鏈€荤洃锛孧ongoDB涓浗鐢ㄦ埛缁勬澀宸炵敤鎴蜂細涓诲腑鏉ㄦ垚铏?鍙剁繑) 涓哄ぇ瀹舵繁搴﹀墫鏋愪簡Redis鍜孧ongoDB浜戞暟鎹簱鐨勬妧鏈€?/span>

Redis浼佷笟绾ф暟鎹簱鏈嶅姟

Redis浣滀负浼佷笟绾ф暟鎹簱闇€瑕佸叧娉ㄥ洓涓柟闈細

鍒嗗竷寮忥細 闇€瑕佹弧瓒充紒涓氬揩閫熸垚闀垮拰闄嶄綆鎴愭湰鐨勯渶瑕侊紝瀹炵幇寮规€ф墿瀹癸紝浠ュ強浠庝富浠庢ā寮忓彉涓洪泦缇ゆā寮忋€?/span>

鍏煎鎬э細 鍏煎鎬ф槸姘告亽鐨勮瘽棰橈紝鍗充娇鏃犳硶鍋氬埌100%涓€鑷达紝浣嗛渶瑕佹棤闄愭帴杩戙€?/span>

瀹夊叏瀹¤锛?/span> 瀹夊叏鍦ㄤ簯鐜涓秺鏉ヨ秺閲嶈锛孯edis寮€婧愮増鐨勫畨鍏ㄥ璁¤兘鍔涙瘮杈冭杽寮憋紝闃块噷浜慠edis瀵逛簬杩欎竴鐐硅繘琛屼簡鍔犲己銆?/span>

鏁版嵁鍚屾锛?/span> 闇€瑕佽兘澶熸敮鎸佹贩鍚堜簯閮ㄧ讲锛屼娇寰楃涓夋柟浜戝巶鍟嗐€両DC涓庨樋閲屼簯瀹炵幇浜掗€氾紝浠ュ強鏁版嵁杩佺Щ鍜岃浆鎹紝婊¤冻瀹㈡埛涓婁簯鎴栬€呬笅浜戠殑鐏垫椿鍐崇瓥銆?/span>

Redis鍘熺敓鐨凜luster鏋舵瀯閲囩敤浜咷ossip鍗忚瀹炵幇璺敱琛ㄧ殑鍚屾锛屼絾杩欑鏋舵瀯鍦ㄧぞ鍖轰互鍙婁紒涓氫腑骞舵病鏈夊揩閫熸祦琛岃捣鏉ャ€?/span> 铏界劧鍏舵湁鏃犱腑蹇冩灦鏋勩€佺粍浠朵緷璧栧皯绛変紭鐐癸紝浣嗕篃瀛樺湪寰堝闂锛屽杩愮淮鍥伴毦锛岃矾鐢卞瓨鍦ㄤ笉纭畾鎬э紝闇€瑕佷緷璧朣mart Client锛屽苟涓斾笉鏀寔Multi-Key浠ュ強浠庝富浠庢ā寮忚縼绉诲埌闆嗙兢妯″紡锛岃繘鑰岄€犳垚鍗囩骇鍥伴毦銆?/span>

涓轰簡瑙ｅ喅涓婅堪闂锛岄樋閲屼簯Redis鏁版嵁搴撴病鏈夐噰鐢℅ossip鍗忚锛岃€屾槸寮曞叆浜嗘柊鐨勪袱涓粍浠讹細 Proxy鍜孋onfig Server銆?/span> 闃块噷浜慠edis閲囩敤浜嗛厤缃腑蹇冨浜庤矾鐢辫〃淇℃伅杩涜绠＄悊锛屽彲浠ラ€氳繃Config Server杩涜鏅鸿兘鍖栬皟搴︼紝Proxy鍒欒兘澶熷吋瀹归潪Smart Client锛屾敮鎸丮ulti-Key锛屽苟鑳藉瀹炵幇娴侀噺绠＄悊浠ュ強璇诲啓鍒嗙绛夈€?/span>

Proxy鍜孋onfig Server铏界劧甯︽潵浜嗘灦鏋勭殑澶嶆潅鎬э紝浣嗙鐞嗗ぇ瑙勬ā澶嶆潅鏋舵瀯姝ｆ槸浜戝巶鍟嗘墍鎿呴暱鐨勩€?/span> 姝ゅ锛岃繖涓や釜鏂扮粍浠舵墍閫犳垚鐨勯澶栨垚鏈篃浼氳鍓婂钩銆?/span> 閫氳繃杩欐牱鐨勪簯鏈嶅姟鏋舵瀯浣垮緱鐢ㄦ埛鑳藉灏哛edis浠庝富浠庢灦鏋勬棤缂濊縼绉诲埌闆嗙兢鐗堟湰銆?/span>

闅忕潃Redis Cluster浜戞湇鍔℃灦鏋勭殑寤朵几锛屽嚭鐜颁簡涓€涓柊姒傚康鈥斺€?/span> Redis浜戞暟鎹簱浼佷笟鍒嗗竷寮忕煩闃?/strong> 銆傝繖涓煩闃佃兘浠庣旱鍚戝拰妯悜杩涜鎵╁睍锛岀旱鍚戣兘澶熼殢鐫€Shard鐨勬坊鍔犺繘琛屽垎鐗囷紝浠庤€屽疄鐜板脊鎬ф墿灞曪紱妯悜鍒欒兘澶熷疄鐜拌鍐欏垎绂伙紝骞朵笖鍋氫簡Group鍒嗙粍闅旂銆傚叏灞€鏉ョ湅锛岃繕鏀寔Memcache鍜孯edis鍙屽崗璁紝骞朵笖鑳藉疄鐜伴泦缇ゃ€佷富澶囦箣闂寸殑骞虫粦鍒囨崲銆?/span>

闃块噷浜慠edis鐨凱roxy寮曞叆浜咰onnection Session鐨勬蹇碉紝鑳藉瀵逛簬Connection瀹炵幇鏇寸粏绮掑害鐨勭鐞嗭紝骞朵笖閫氳繃杩炴帴姹犲疄鐜颁簡闀胯繛鎺ュ鐢紝涓嶄粎鑳藉鍏煎澶氱鍗忚锛屽苟閫氳繃C璇█楂樻€ц兘浠ｇ爜涔熸彁鍗囦簡鐭繛鎺ョ殑鎬ц兘銆?/span> 闃块噷浜慠edis鐨凱roxy杩樺叿鏈夌儹鍗囩骇鑳藉姏锛岃兘淇濊瘉鍦ㄦ湇鍔′笉闂存柇鐨勬儏鍐典笅鍗囩骇鐗堟湰銆?/span>

闃块噷浜慠edis鍦ㄦ暣涓暟鎹摼璺笂杩涜浜嗛€愬眰鍔犲瘑澶勭悊锛屾敮鎸佷簡SSL銆佺櫧鍚嶅崟銆佹潈闄愮鐞嗕互鍙婂叧閿懡浠ょ殑绂佺敤鍜屽璁＄瓑锛屽寮轰簡Redis鐨勫畨鍏ㄥ璁¤兘鍔涖€?/span> Redis杩樻彁渚涗簡涓€浜涘厤璐圭殑寮€婧愬伐鍏凤紝濡傚悓姝ュ伐鍏稲edisShake浠ュ強鏁版嵁鏍￠獙宸ュ叿RedisFullCheck绛夈€?/span>

鑰孯edis浣滀负鍐呭瓨鍨嬬殑缂撳瓨鏈嶅姟涔熷瓨鍦ㄥ緢澶氭寫鎴橈紝姣斿瀹归噺鍙楅檺锛屾垚鏈緝楂樹互鍙婃寔涔呭寲鑳藉姏寮辩瓑銆?/span> 鍩轰簬浠ヤ笂闂锛岄樋閲屼簯鎻愪緵浜嗘贩鍚堝瓨鍌ㄧ殑Redis鐗堟湰锛屽叾鐩殑鍦ㄤ簬涓虹敤鎴锋彁渚涙寔涔呭寲銆佸彲瀹夊叏瀛樺偍鐨凴edis鏈嶅姟銆?/span> 鍏跺疄鐜颁緷璧栦簬搴曞眰鐨凴ocksDB锛岄€氳繃涓嶆柇鍚屾鍐风儹Key锛屼娇寰楀唴瀛樺浜庡彲鎺ц寖鍥翠箣鍐呫€?/span>

MongoDB浼佷笟绾ф暟鎹簱鏈嶅姟

MongoDB浣滀负浼佷笟绾ф暟鎹簱闇€瑕佸叧娉ㄥ洓涓柟闈紝鍗?/span> 瀹夊叏瀹¤銆佸浠芥仮澶嶃€佹暟鎹悓姝ヤ互鍙婂脊鎬т几缂?/strong> 銆侻ongoDB鐨勫畨鍏ㄥ璁′笌Redis鍩烘湰涓€鑷达紝杩涗竴姝ュ鍔犱簡TDE鍔犲瘑銆侻ongoDB澧炲姞浜嗙墿鐞嗗浠斤紝浣垮緱澶囦唤鍜屾仮澶嶆晥鐜囬兘鏈変簡澶у箙搴︽彁鍗囷紝骞朵笖閫氳繃澧為噺澶囦唤鑳藉姏浣垮緱鏁版嵁鑳藉鎭㈠鍒颁换鎰忔椂闂寸偣銆?/span>

姝ゅ锛屽湪澶囦唤鐨勫熀纭€涔嬩笂锛岄樋閲屼簯MongoDB杩樻彁渚涗簡澶囦唤楠岃瘉鑳藉姏銆?/span>

闃块噷浜慚ongoDB杩樻彁渚涗簡璇婃柇鍒嗘瀽鑳藉姏锛屽苟鎻愪緵浜哅ongoShake宸ュ叿瀵规暟鎹繘琛屽悓姝ャ€?/span> 闃块噷浜慚ongoDB鍩轰簬RocksDB寮曟搸瀹炵幇浜嗗叡浜瓨鍌ㄨВ鍐虫柟妗堬紝鍙互瀹炵幇瀛樺偍寮规€т几缂╋紝绉掔骇娣诲姞鍙鑺傜偣锛屽苟瑙ｅ喅浜唎plog鍏ㄥ眬閿侀棶棰樸€?/span> 褰撶劧锛岃繖鏍风殑鏂规涔熼潰瀵圭潃鍑犵偣鎸戞垬锛屽涓嶹iredTiger鐨勫吋瀹规€ч棶棰橈紱 Compaction甯︽潵鐨勬€ц兘鎶栧姩锛?/span> 浠ュ強鍏变韩瀛樺偍寤惰繜绋冲畾鎬с€?/span>

2

鍩轰簬MongoDB鐨勬暟鎹腑鍙版妧鏈疄鐜?/span>

馃敹 MongoDB澶т腑鍥藉尯棣栧腑鏋舵瀯甯堝攼寤烘硶 涓哄ぇ瀹朵粙缁嶄簡鍩轰簬MongoDB鐨勬暟鎹腑鍙版妧鏈疄鐜般€?/span>

濡傛灉浼佷笟涓氬姟闇€瑕佸鎺ヤ笉鍚岀殑瀹㈡埛鏁版嵁锛岃€岃繖浜涙暟鎹殑缁撴瀯銆佺被鍨嬪悇涓嶇浉鍚岋紝鍙兘闇€瑕佽姳璐规暟鍛ㄧ敋鑷虫暟鏈堛€?/span> 寰堝宸叉湁鐨勮В鍐虫柟妗堝氨鏄疄鐜版暟鎹粺涓€骞冲彴锛屽皢鎵€鏈夋暟鎹€氳繃ETL鎶藉彇鍒版暟鎹钩鍙颁笂锛岃繖绉嶆柟寮忕殑鍏辨€ф槸鈥淭+1鈥濈殑鏂瑰紡鎵归噺閲囬泦姹囨€伙紝鍋氭垚鏁版嵁闆嗭紝浠ヤ氦浜掓柟寮忔彁渚涗笅杞姐€?/span> 浣嗚繖绉嶆柟寮忓瓨鍦ㄧ潃骞冲彴鏁版嵁婊炲悗銆佸搷搴旈€熷害鎱€佷氦浜掓柟寮忕矖绯欑瓑闂銆?/span>

鏁版嵁涓彴浠庢妧鏈殑瑙掑害杩涜瀹氫箟灏辨槸 鈥滄暟鎹粺涓€骞冲彴+鏁版嵁鍗虫湇鍔¤兘鍔涒€?/span> 銆傛暟鎹潵婧愪簬涓氬姟锛岄渶瑕佹寜鐓р€淭+0鈥濇柟寮忛噰闆嗭紝鎻愪緵鍙婃椂鐨勬暟鎹€傛暟鎹渶瑕佷互API鐨勬湇鍔″寲鏂瑰紡浜や粯鍑哄幓锛岃€岄潪鎵撳寘銆傝繖浣垮緱鏁版嵁涓彴鑳藉瀵逛紒涓氳禆浠ョ敓瀛樼殑鎿嶄綔鍨嬬郴缁熸彁渚涙敮鎸侊紝鐩告瘮浜庡垎鏋愬瀷涓氬姟锛屾搷浣滃瀷涓氬姟鏇村姞鏍稿績锛屾洿鍔犺兘澶熸彁楂樹紒涓氱珵浜夊姏锛岃繖涔熸槸鏁版嵁涓彴鐏垎鐨勫師鍥犮€?/span>

鏁版嵁涓彴鐨勫畾涔?/span> 灏辨槸鍖呭惈浼佷笟瀹炴椂鍏ㄥ煙鏁版嵁鐨勶紝涓昏闈㈠悜鎿嶄綔鍨嬩笟鍔″簲鐢ㄤ负涓荤殑鏁版嵁鏈嶅姟鎶€鏈钩鍙般€?/span> 鍏舵蹇佃捣婧愯嚜鍥藉唴锛屽瓨鍦ㄤ紬澶氭祦娲撅紝浼楄绾风涵銆?/span> 鍜ㄨ鍏徃璇存暟鎹腑鍙版槸涓€绉嶇粍缁囨灦鏋勭殑杞彉锛屾柟妗堟彁渚涘晢鍒欒鏁版嵁涓彴鏄儚Hadoop涓€鏍风殑鎶€鏈钩鍙颁骇鍝侊紝涓嶅悓鐨勭粍缁囨湁涓嶅悓鐨勫嚭鍙戠偣銆?/span>

涓浗97%灏忓井浼佷笟涓庢暟鎹腑鍙板熀鏈笉鐩稿叧銆?/span> 鑵伴儴鍗?%鐨?20涓囧澶т腑鍨嬩紒涓氾紝鍙兘鏈夊緢澶氱殑寮€鍙戜汉鍛樹絾娌℃湁鏁版嵁涓撳锛屽彟澶栬繕鏈夊皯閮ㄥ垎澶撮儴浼佷笟銆?/span> 瀵逛簬鑵伴儴鐨勫ぇ涓紒涓氳€岃█锛岀郴缁熷彲鑳戒笉澶氾紝鑰屾暟鎹洟闃熷熀鏈病鏈夛紝鏃犳硶蹇€熸瀯寤哄畬鍠勭殑鏁版嵁涓彴锛屼絾鏄暟鎹宀涚殑鐥涚偣銆佹暟鎹墦閫氫互鍙婂揩閫熷紑鍙戠殑闇€姹傚嵈鏄湡瀹炲瓨鍦ㄧ殑銆?/span>

杩欎簺浼佷笟鍙互閫夌敤鎶€鏈瀷鏋舵瀯锛屽叿浣撻渶瑕佽€冭檻鐨勮兘鍔涘寘鎷暟鎹眹鑱氥€佹暟鎹不鐞嗕互鍙婂缓妯°€佹暟鎹瓵PI鏈嶅姟锛屼互鍙婃渶鍏抽敭鐨勫瓨鍌ㄣ€佹捣閲忋€佸妯″拰楂樻€ц兘銆?/span>

RDBMS銆丮PP銆丠adoop銆丯oSQL浠ュ強NewSQL鏁版嵁鎶€鏈悇鏈夐暱鐭澘锛屽湪鏋勫缓涓彴鏃朵篃鍙互鍋氫竴浜涘弬鑰冿紝浼佷笟闇€瑕佹牴鎹嚜韬疄闄呮儏鍐佃繘琛岃€冮噺銆?/span>

涔嬪墠锛孧ongoDB鐢ㄤ簬澶ф暟鎹绾垮垎鏋愬苟涓嶆槸寰堝ソ鐨勯€夋嫨锛屾洿澶氬湴鏄皢鍏剁敤浜庝笟鍔″満鏅€?/span> 鑰屾暟鎹腑鍙伴潰鍚戠殑灏辨槸涓氬姟搴旂敤鍦烘櫙锛屽洜姝ongoDB鎴愪负浜嗕竴涓笉閿欑殑閫夋嫨锛屽叾鍏锋湁杈冨己鐨勬í鍚戣嚜鍔ㄦ墿灞曡兘鍔涳紝鏀寔澶氭ā澶氭€侊紝骞朵笖API鍙嬪ソ銆?/span> 姝ゅ锛屽熀浜嶮ongoDB瀹炵幇寤烘ā鎵€闇€瑕佺殑宸ヤ綔杩滃皯浜庝紶缁熸柟寮忥紝鑳藉闄嶄綆鎴愭湰銆?/span>

姝ゅ锛孧ongoDB杩樺叿鏈夋暟鎹噰闆嗐€佸彲瑙嗗寲寤烘ā銆佹棤浠ｇ爜鍖朅PI銆佹暟鎹彲瑙嗗寲绛夋暟鎹腑鍙版瀯寤烘墍蹇呴』鐨勮兘鍔涖€?/span>

濡備笅鍥炬墍绀虹殑鏄緝涓哄畬鏁寸殑MongoDB鏁版嵁涓彴瑙ｅ喅鏂规鍙傝€冩灦鏋勶紝浠庝笅鍒颁笂渚濇鏄噰闆嗐€佸瓨鍌ㄥ鐞嗕互鍙婃暟鎹湇鍔′笁灞傘€?/span>

鍩轰簬MongoDB鏋勫缓鏁版嵁涓彴鍏锋湁杩欐牱鍑犱釜鏍稿績浼樺娍锛屽嵆鏃犵紳妯悜鎵╁睍鑳藉姏銆佸绫诲瀷缁撴瀯鏁版嵁妯″瀷銆侀€昏緫妯″瀷鍗冲瓨鍌ㄦā鍨嬨€佸紓鏋勫疄鏃舵暟鎹簱鍚屾鑳藉姏銆佹棤浠ｇ爜蹇€烝PI鍙戝竷鑳藉姏浠ュ強绠€鍗曘€佽交閲忓拰蹇€熴€?/span>

3

鍥炬暟鎹簱GDB鐨勮璁′笌瀹炶返

馃敹 闃块噷浜戣祫娣辨妧鏈笓瀹舵湵鍥戒簯(瀹楀脖) 涓哄ぇ瀹跺垎浜簡闃块噷宸村反鍥炬暟鎹簱GDB鐨勮璁′笌瀹炶返銆?/span>

浠€涔堟槸鍥炬暟鎹簱

鍥炬暟鎹簱鏄拡瀵逛簬鍥剧粨鏋勮璁＄殑鏁版嵁搴擄紝鑰岄潪鍥剧墖鏁版嵁搴撱€?/span> 浠€涔堟槸鍥剧粨鏋勫憿锛?/span> 杩欐槸浠ョぞ浜ょ綉缁滄ā鍨嬩负渚嬩粙缁嶏紝璇ユā鍨嬩腑瀛樺湪浜轰笌浜恒€佷汉涓庤鍧涖€佷汉涓庡笘瀛愩€佸笘瀛愪笌璁哄潧涔嬮棿鐨勫叧绯伙紝浜恒€佽鍧涖€佸笘瀛愬氨灞炰簬鍥句腑鐨勭偣锛堝嵆Vertex锛夛紝鐐逛箣闂寸殑鍏崇郴灏辩О涔嬩负杈癸紙鍗矱dge锛夛紝鍦ㄧ偣鍜岃竟涓婁細鏈変竴浜涘睘鎬э紙鍗砅roperty锛夈€?/span>

濡備粖锛屼竴浜涗紭绉€鐨勭ぞ浜ゅ簲鐢ㄤ細灏嗗缁存暟鎹瓨鍌ㄥ埌缁熶竴鐨勫浘绌洪棿涓潵锛岃繘琛屽瓨鍌ㄣ€佹煡璇㈠拰鍒嗘瀽锛屼负鐢ㄦ埛甯︽潵鏇村ソ鐨勪綋楠屻€?/span> 杩戝勾鏉ワ紝鏁版嵁閲忚秺鏉ヨ秺澶х殑鍚屾椂锛屾暟鎹淮搴︿篃閫愭笎澧炲锛屽浘鏁版嵁搴撳氨鏄湪杩欑鑳屾櫙涓嬭癁鐢熺殑銆?/span>

鍥炬暟鎹簱浣滀负杩戝勾鏉ユ暟鎹簱棰嗗煙涓彂灞曟渶蹇殑涓€绫伙紝涓庡叧绯诲瀷鏁版嵁搴撳瓨鍦ㄥ摢浜涘樊鍒憿锛?/span> 閫氬父鎯呭喌涓嬶紝鍏崇郴鍨嬫暟鎹簱涓渶瑕侀€氳繃寤轰竷鍏紶琛ㄦ墠鑳藉仛鍒扮殑妯″瀷锛屽浘鏁版嵁搴撹兘澶熸洿鍔犵洿瑙傘€佽嚜鐒跺湴琛ㄧ幇鍑烘潵銆?/span> 姝ゅ锛屽浘鏁版嵁搴撳仛鍏宠仈鏌ヨ鐨勯€熷害鏇村揩锛岃繕鑳藉鎻愪緵鏇村鎺㈢储鍙戠幇鐨勮兘鍔涖€?/span>

鍓嶉潰鎻愬埌鐨勬槸灞炴€у浘妯″瀷锛屽湪鍥炬暟鎹鍩熻繕鏈変竴绉峈DF妯″瀷銆?/span> 涓よ€呯殑涓昏鍖哄埆鍦ㄤ簬RDF鐨勭偣鍜岃竟涓婁笉鍙互鏈夊睘鎬с€?/span>

鍥炬暟鎹簱鍙戝睍閫熷害寰堝揩锛屽洜姝ょ绫讳篃鏄壒鍒锛屼富瑕佸彲浠ュ垎鎴愬洓绫伙紝鍗?/span> 鐭ヨ瘑鍥?RDF銆佸垎鏋愬浘銆佸浘鏁版嵁搴撱€佸妯″瀷鍥炬暟鎹簱 銆傝繖浜涘浘鏁版嵁搴撶郴缁熶娇鐢ㄧ殑涓绘祦鏌ヨ璇█澶ц嚧鏈変笁绫伙紝鍗砃eo4j涓绘帹鐨勬渶鏃╀娇鐢ㄧ被SQL鏌ヨ璇█鐨凜ypher銆佺敤浜嶳DF涓婄殑鎻忚堪璇█SPARQL鍜岀洰鍓嶆敮鎸佹渶骞挎硾鐨勫熀浜庡睘鎬у浘鐨勬煡璇㈣瑷€Gremlin銆?/span>

浠€涔堟槸鍥炬暟鎹簱GDB

GDB鏄竴绉嶅浘鏁版嵁搴擄紝鍏朵富瑕佸鐞嗛珮搴﹁繛鎺ユ暟鎹殑瀛樺偍鍜屾煡璇紝鍏舵敮鎸佷簡灞炴€у浘妯″瀷鍜屽紑婧愮殑TinkerPop Gremlin鏌ヨ璇█銆?/span> 涓庡叾浠栨暟鎹簱涓嶅悓鐨勬槸锛?/span> GDB鏄簯鍘熺敓鏁版嵁搴擄紝浠庝竴寮€濮嬪氨寤鸿鍦ㄩ樋閲屼簯鍩虹璁炬柦涔嬩笂锛屽洜姝よ兘澶熷仛鍒板脊鎬с€佸疄鏃跺拰楂樺彲闈犮€?/span>

GDB鑴辫儙浜嶵air Service涓殑TairGraph 瀛愮郴缁燂紝鍚庢潵鍏跺鍖栧嚭鏉ワ紝骞舵斁鍒伴樋閲屼簯涓婃潵涓撴敞鍦拌В鍐抽珮搴﹁繛鎺ユ暟鎹満鏅腑鐨勯棶棰樸€?/span> 鍩轰簬Tair 10骞寸殑鎶€鏈熀纭€锛孏DB瀹炵幇浜嗛珮搴︿紭鍖栫殑鑷爺寮曟搸锛岃兘澶熷疄鐜板疄鏃舵洿鏂板拰绉掔骇鏌ヨ锛屽苟涓斿畬鏁村湴鏀寔ACID浜嬪姟锛屽苟閫氳繃澶氬壇鏈繚闅滈珮鍙潬銆?/span>

姝ゅ锛岃繕鍋氬埌浜嗘湇鍔￠珮鍙敤锛岃兘澶熷疄鐜拌妭鐐规晠闅滆繀閫熻浆绉伙紱 鏄撹繍缁达紝鎻愪緵浜嗗紑绠卞嵆鐢ㄧ殑鑳藉姏锛?/span> 鍙鍖栵紝鏇村埄浜庡垎鏋愭暟鎹殑鍐呭湪鍏崇郴銆?/span>

鍦ㄦ灦鏋勫眰闈紝GDB涓哄鎴锋彁渚涚殑鏄嫭浜笓灞炲疄渚嬶紝杩欐剰鍛崇潃璧勬簮鐙珛锛屾棤椤绘媴蹇冩姠鍗犻棶棰樸€?/span> HA鏂归潰閲囩敤浜嗘渶缁忓吀涓诲鏋舵瀯锛屽苟鎻愪緵鍙鑺傜偣鏉ユ彁鍗囧疄鏃舵煡璇㈣兘鍔涖€?/span> GDB鏀寔浜咷remlin寮€婧愮殑TinkerPop SDK锛屼负浜嗗疄鐜版瘡绉掔櫨涓囩骇鐐硅竟杩囨护锛孏DB瀹氬埗浜嗕笓灞炵殑鍥惧弸濂芥暟鎹簱寮曟搸锛屽苟鍦ㄦ煡璇紭鍖栧拰骞惰鎵ц绛夋柟闈㈠仛浜嗗ぇ閲忎紭鍖栵紝杩樻敮鎸佷簡浜嬪姟鍜岃嚜鍔ㄧ储寮曘€?/span>

鍦ㄦ暟鎹€氶亾閮ㄥ垎锛孏DB杩樻彁渚涗簡澶氱鏁版嵁婧愮殑楂樻晥瀵煎叆鏀寔銆?/span>

GDB鐨勫満鏅拰妗堜緥

濡備粖锛孏DB鍦?/span> 绀句氦缃戠粶銆侀噾铻嶆璇堟娴嬨€佸疄鏃舵帹鑽愬紩鎿庛€佺煡璇嗗浘璋变互鍙婄綉缁?IT杩愯惀绛?/strong> 鍦烘櫙涓緱鍒板箍娉涘簲鐢紝鑰屼笖杩欎簺鍦烘櫙寰€寰€浜ょ粐鍦ㄤ竴璧枫€備娇鐢℅DB鑳藉灏嗕箣鍓嶅亸绂荤嚎鐨勫満鏅仛鍒板疄鏃舵垨鑰呭噯瀹炴椂銆?/span>

鎬荤粨 锛氬湪鏁版嵁缁村害瓒婃潵瓒婂銆佹暟鎹浉浜掑叧鑱旇秺鏉ヨ秺绱у瘑鐨勪粖澶╋紝GDB鎻愪緵浜嗕竴绉嶆湁鏁堢殑鍥惧瓨鍌ㄦ柟寮忥紝鑳藉灏嗗缁存暟鎹緢濂藉湴杩炴帴璧锋潵锛屽苟閫氳繃鍥炬煡璇€佸浘绠楁硶鎶婃暟鎹殣钘忕殑浠峰€煎疄鏃跺湴銆佹櫤鑳藉湴鎸栨帢鍑烘潵銆?/span>

4

浠嶫ava璧板悜浜戝師鐢燂紝Redisson涓嶅仠鍦版帰绱?/span>

馃敹 Redisson鑱斿悎鍒涘浜洪【鐫?/strong> 涓哄ぇ瀹跺垎浜簡Redisson浠嶫ava璧板悜浜戝師鐢熺殑鎺㈢储涔嬭矾銆?/span>

Redisson鏄灦璁惧湪Redis鍩虹涓婄殑涓€涓狫ava椹诲唴瀛樻暟鎹綉鏍笺€?/span> Redisson浠ava鎺ュ彛鏂瑰紡鑰岄潪鍛戒护鐨勫舰寮忔彁渚涚粰澶у锛屼娇鐢ㄩ潪甯哥畝鍗曘€?/span> 鍏朵紭鍔垮湪浜庝笂鎵嬪鏄擄紝鍙鑳藉浣跨敤Java鍩烘湰灏辫兘澶熶娇鐢≧edisson銆?/span> 姝ゅ锛孯edisson鍦ㄨ璁℃椂瑙勯伩浜嗗绾跨▼鐨勯棶棰橈紝閲囩敤浜嗙嚎绋嬪畨鍏ㄧ殑璁捐锛屽悓鏃跺紩鍏ヤ簡绾跨▼姹犲拰杩炴帴姹犵殑绠＄悊锛屽湪鍚屾鍜屽紓姝ョ殑鍦烘櫙涓兘鑳介€夊埌閫傚悎鐨勬柟寮忋€?/span>

闄や簡浣跨敤绠€鍗曞锛孯edisson鍦ㄥ姛鑳戒笂涔熸彁渚涗簡澶氱閫夋嫨锛岃兘澶熸敮鎸?1绉嶅垎甯冨紡闆嗗悎銆?4绉嶅垎甯冨紡瀵硅薄銆?绉嶅垎甯冨紡閿佸拰鍒嗗竷寮忓悓姝ュ櫒浠ュ強5绉嶅垎甯冨紡鏈嶅姟銆?/span>

Redisson鐨勬灦鏋勪富瑕佸垎涓轰袱澶у潡锛屽寘鍚玆edisson瀹㈡埛绔殑杩炴帴绠＄悊銆佸崗璁В鏋愬湪鍐呯殑鍩烘湰鍔熻兘鍜屽寘鎷垎甯冨紡缁撴瀯銆佸垎甯冨紡涓棿浠朵互鍙婄涓夋柟鍔熻兘鏀寔鍦ㄥ唴鐨勯珮绾у姛鑳姐€?/span>

浠嶳edisson鏋舵瀯瑙掑害鏉ョ湅锛屼技涔庡拰Redis鐨勭悊蹇电浉鍐茬獊銆?/span> Redis璁捐鐞嗗康寮鸿皟绠€鍗曪紝鑰孯edisson璁捐鍗存瘮杈冨鏉傦紱 Redis鎻愪緵浜?绉嶆暟鎹粨鏋勶紝鐣岄檺娓呮櫚锛岃€孯edisson鎻愪緵浜嗙害60绉嶏紝鐣岄檺姣旇緝妯＄硦锛?/span> Redis浠ュ懡浠ゅ舰寮忛潰鍚戠敤鎴凤紝鑰孯edisson鍗翠互Java API褰㈠紡闈㈠悜鐢ㄦ埛銆?/span> 鐪嬩技鍒嗛亾鎵暢锛屽疄鍒欐畩閫斿悓褰掞紝閮芥槸涓轰簡灏嗗鏉傞殣钘忚捣鏉ワ紝灏嗙畝鍗曠殑浣跨敤鏂瑰紡鎻愪緵缁欑敤鎴枫€?/span>

鍙敮鎸丣ava鏄疪edisson鐨勪紭鐐癸紝涔熸槸缂虹偣銆?/span> Java鏄疪edisson鐨勪竴涓墷绗硷紝杩欏浜庡簲鐢ㄧ▼搴忓紑鍙戣€呰€岃█鏄紭鍔匡紝鑰屽浜庣▼搴忓簱寮€鍙戣€呰€岃█灏辨槸鍔ｅ娍銆?/span> 鍥犳锛孯edisson涓€鐩村湪鎬濊€冨浣曡蛋鍑哄洶澧冿紝鎷ユ姳鍏朵粬鐨勭敓鎬併€?/span>

2016骞达紝Redisson棣栧厛灏濊瘯浜嗕娇鐢╒ert.x妗嗘灦锛孷ert.x鐨勭壒鐐规槸闆嗙兢杩愯鐜銆佸璇█浜や簰鎬у拰鍩轰簬鎴愮啛鎶€鏈紝骞朵笖Vert.x瀵瑰紑鍙戣€呯殑闄愬埗姣旇緝灏戙€?/span> 鍥犳锛孯edisson鍋氫簡鐩稿叧鐨勫疄楠岋紝瀹炵幇浜哛edisson鍦ㄥ叾浠栬瑷€涓殑杩愯銆?/span> 浣嗘槸杩欑鏂规瀛︿範鎴愭湰闈炲父澶э紝鑰屽疄闄呮敹鐩婂嵈涓嶉珮銆?/span>

2018骞达紝Redisson娉ㄦ剰鍒癘RACLE Labs鎺ㄥ嚭鐨凣raalVM锛孏raalVM鐨勫簳灞傛槸Java杩愯灞傦紝鍖呮嫭GraalVM鍜孲ubstrateVM锛屽彲浠ヨ鍏朵粬璇█閮借兘澶熺紪璇戣瀺鍚堝苟鏀惧叆JVM涓墽琛岋紝鍚屾椂淇濊瘉鐩镐簰娌熼€氱殑妗ユ銆?/span> SubstrateVM鏄渶鍚稿紩Redisson鐨勭偣锛屽畠鍙互鐞嗚В涓虹敤Java缂栧啓鐨勫祵鍏ュ紡铏氭嫙鏈猴紝浣垮緱鐪熸鐨勮法骞冲彴鍜岃法璇█鎴愪负鍙兘銆?/span>
浜庢槸锛孯edisson寮€濮嬩簡 鈥滈€冭窇涔嬭矾鈥?/span> 锛屽疄鐜颁簡redisson-native銆傚浜嶫ava銆丣ava+Warm UP浠ュ強Native涓夌鏂瑰紡鐨勬€ц兘杩涜瀵规瘮锛岃兘澶熺湅鍑簉edisson-native鐨勬€ц兘鍏锋湁鏄庢樉鐨勪紭鍔裤€?/span>

鍥犳锛岃繖璇存槑鍊熷姪SubstrateVM閫冪Java鏄潪甯稿ソ鐨勮В鍐虫柟妗堬紝鏃犻渶鑰冭檻JNI绛夌浉鍏抽棶棰橈紝澶ч儴鍒嗘搷浣滃彧闇€瑕丣ava鍗冲彲瀹屾垚锛屽涔犳垚鏈緝浣庯紝骞朵笖鏃犻渶瀹夎鐙珛鐨凧VM锛岀敓鎴愭枃浠朵篃杈冨皬锛屼簯鍘熺敓鎯呭喌涓嬫€ц兘杈冮珮锛屽苟涓擟璋冪敤闈炲父绠€鍗曘€?/span> 寤朵几寮€鍘伙紝鍙互灏哛edisson甯﹀叆鍒板師鐢熺殑浜岃繘鍒剁姸鎬佸苟杩涜浜屾灏佽锛屽疄鐜伴亶鍦板紑鑺便€?/span>

5

鍩轰簬浼佷笟绾Base鐨勫ぇ鏁版嵁瀛樺偍涓庡鐞?/span>

馃敹 闃块噷浜戞櫤鑳戒簨涓氱兢鏁版嵁搴撲骇鍝佷簨涓氶儴鎶€鏈€荤洃锛孉pache HBase PMC娌堟槬杈?澶╂ⅶ) 涓哄ぇ瀹跺垎浜簡鍩轰簬浼佷笟绾Base鐨勫ぇ鏁版嵁瀛樺偍涓庡鐞嗐€?/span>

杩涘叆澶ф暟鎹椂浠ｏ紝鏁版嵁閲忚秺鏉ヨ秺澶氾紝鏁版嵁绉嶇被涔熻秺鏉ヨ秺涓板瘜銆?/span> 鏁版嵁閲忓杩欎竴鐐瑰鏄撶悊瑙ｏ紝鑰屾暟鎹绫讳赴瀵屽垯鍙互浠庝笁涓淮搴︽潵鐪嬶細 浠庨潤鎬佺淮搴︼紝濡備粖鑳藉鐢ㄦ暟瀛楀寲璁惧瓒婃潵瓒婂锛?/span> 浠庡姩鎬佺淮搴︼紝璁惧銆佹湇鍔＄殑杩愯鐘舵€佽秺鏉ヨ秺澶氾紱

姝ゅ锛岃繕鏈夋暟鎹啀鍔犲伐鍙堜骇鐢熶簡鏂版暟鎹紝浣垮緱鏁版嵁鍙樺緱鏃犵┓鏃犲敖銆?/span> 闈㈠杩欎箞澶氭暟閲忓拰绉嶇被鐨勬暟鎹紝濡傛灉娌℃湁浠峰€煎氨閮芥槸搴熷銆?/span> 鍥為【杩欏崄骞达紝澶у瀵规暟鎹环鍊煎眰闈㈢殑璁ょ煡瓒婃潵瓒婂己鐑堬紝鏁版嵁涔熻秺鏉ヨ秺澶氬湴搴旂敤鍒扮敓娲讳腑鐨勫悇涓満鏅€?/span>

闅忕潃瀵规暟鎹殑搴旂敤锛岀郴缁熶細闈复寰堝鎸戞垬銆傚ぇ鏁版嵁鎻愬嚭浜?/span> 鈥?V鈥濄€?/strong> 鍏蜂綋瀵逛簬寮€鍙戣€呰€岃█锛屾暟鎹綋閲忛潪甯稿ぇ鎰忓懗鐫€绯荤粺闇€瑕侀珮鎵╁睍鎬э紱

鏁版嵁绉嶇被闈炲父涓板瘜鎰忓懗鐫€绯荤粺闇€瑕佸叿鏈夐珮鐏垫椿鎬э紝鑳藉寰堝ソ鎵胯浇闅忔椂闅忓湴浜х敓鐨勬柊鏁版嵁绉嶇被锛?/span>

鏁版嵁鏃舵晥鎬ф剰鍛崇潃绯荤粺鍏锋湁楂樺疄鏃舵€э紝鍏锋湁鏁版嵁鍦ㄧ嚎鍖栬兘鍔涳紱

鏁版嵁浠峰€煎垯鎰忓懗鐫€闇€瑕佽兘澶熷晢涓氬寲锛岀郴缁熼渶瑕侀檷浣庢暟鎹殑瀛樺偍鍜岃绠楁垚鏈€?/span>

鍗佸骞村墠锛孏oogle棣栧厛閬囧埌澶ф暟鎹棶棰橈紝鍥犳鍙戣〃浜咮ig Table璁烘枃銆?/span> 鑰孒Base鍒欐槸鍩轰簬璇ヨ鏂囪璁＄殑楂樺彲闈犮€侀珮鎬ц兘銆佸彲浼哥缉鐨勫紑婧愬ぇ鏁版嵁NoSQL绯荤粺銆?/span> HBase鏀惧純浜嗗浜庡叧绯诲瀷鏁版嵁搴撲簨鍔＄殑鏀寔锛岄噸鐐规瀯寤烘墿灞曟€ц兘鍔涖€佺伒娲绘€ц兘鍔涖€佸疄鏃跺搷搴旇兘鍔涗互鍙婂澶т綋閲忔暟鎹瓨鍌ㄤ綆鎴愭湰鐨勮兘鍔涖€?/span>

闃块噷宸村反浠?010骞村紑濮嬭皟鐮擧Base锛屽浠婂凡缁忚蛋杩囦簡杩戝崄涓勾澶淬€?/span> 闅忕潃杩欏崄骞寸殑閫愭鎺㈢储锛岄樋閲屽反宸翠篃涓板瘜浜咹Base鐨勪娇鐢ㄥ満鏅紝濡傛秷鎭紝璁㈠崟锛孎eed娴侊紝鐩戞帶锛屽ぇ灞忥紝杞ㄨ抗锛岃澶囩姸鎬侊紝AI瀛樺偍锛屾帹鑽愶紝鎼滅储锛孊I鎶ヨ〃绛夈€?/span>

闃块噷宸村反鑷繁浣跨敤HBase宸茬粡杈惧埌浜嗛潪甯稿ぇ鐨勪綋閲忓拰瑙勬ā锛屼篃鍦ㄤ骇鍝佷笂鏈変簡寰堝绉疮鍜屾矇娣€锛屽舰鎴愪簡濡備粖浜慔Base+X-Pack鐨勬灦鏋勩€?/span> 鍗曠嫭渚濋潬HBase鏁版嵁搴撴棤娉曡В鍐充笟鍔″満鏅笅鐨勫鏉傞棶棰橈紝鍥犳X-Pack鍩轰簬浜慔Base鍦ㄨ绠椼€佹绱€佸妯″瀷涓婅繘琛屼簡鎵╁睍锛屽寘鍚簡Spark銆丳hoenix銆丼olr浠ュ強OpenTSDB绛夛紝褰㈡垚浜嗙ǔ瀹氥€佹槗鐢ㄣ€佷綆鎴愭湰鐨勪竴绔欏紡澶ф暟鎹甆oSQL骞冲彴銆?/span>

浜慔Base+X-Pack鏋舵瀯瀹炵幇浜嗕綆鎴愭湰鐨勬暟鎹瓨鍌紝灏咹Base杩愯鍦∣SS涓婇潰锛屽苟涓旇鏁翠綋鎺ュ彛妯″瀷澶嶇敤HDFS鑳藉姏銆?/span> 骞朵笖鍚屾椂鍏嬫湇浜哋SS鍦ㄩ潰鍚戞枃浠跺満鏅笅鐨勯棶棰橈紝灏嗗師鏈潰鍚戝璞＄殑瀛樺偍绯荤粺褰撳仛绫讳技浜戠洏鏉ヤ娇鐢紝浣垮緱瀛樺偍鎴愭湰闄嶄綆3鍒?鍊嶃€?/span> 姝ゅ锛岃繕鍩轰簬HBase鍋氬埌浜嗕竴浣撳寲鍐风儹鍒嗙锛屽苟浣垮緱涓氬姟鏃犳劅鐭ャ€?/span>

闄や簡浣庢垚鏈瓨鍌ㄤ箣澶栵紝闃块噷浜慔Base杩樻姇鍏ヤ簡澶ч噺鐨勭簿鍔涙潵浼樺寲鎬ц兘銆?/span> 鐩告瘮寮€婧愮増鏈紝闃块噷浜慔Base鍦ㄥ悇涓€ц兘鎸囨爣涓婇兘鏈夎緝澶х殑鎻愬崌銆?/span> 鍦ㄨ繖鑳屽悗鏄笉鏂殑浼樺寲锛屽鍘熸湰灏嗗熀浜嶩DFS Pipeline鏃ュ織涓夊壇鏈浆鍙樺悜LLC鏈哄埗锛屽苟灏嗕覆琛屾敼涓哄苟琛岋紱 灏嗗師鏈覆琛岃幏鍙栭攣鐨勬柟寮忓彉涓哄苟琛岋紱 骞朵笖瀹炵幇浜?0鍊嶇殑Java GC浼樺寲銆?/span>

鏈€鍚庝竴鐐癸紝HBase灞炰簬澶ф暟鎹鍩燂紝蹇呴』缁撳悎寰堝缁勪欢锛屽洜姝ゆ槗鐢ㄦ€т篃鏄ぇ瀹舵渶涓鸿揩鍒囬渶瑕佺殑銆?/span> 闃块噷浜慔Base瀹炵幇浜咹Base鍜孲park鐨勬暟鎹仈鍔ㄤ互鍙婂湪绾垮拰绂荤嚎鐨勯珮鏁堣瀺鍚堛€?/span> 姝ゅ锛岄樋閲屽唴閮ㄤ篃鎻愪緵浜嗕竴濂楁槗鐢ㄧ殑鏁版嵁杩佺Щ绯荤粺锛岃兘澶熷疄鐜板钩婊戝湪绾挎惉杩併€?/span>

鏃犺鏄粠绋冲畾鎬с€佹槗鐢ㄦ€ц繕鏄€ц兘鍜屾垚鏈笂鏉ヨ锛岄樋閲屼簯HBase閮芥湁寰堝ぇ鐨勬彁鍗囥€?/span> 鏈潵锛岄樋閲屼簯HBase杩樹細閫氳繃鍏变韩鍧楀瓨鍌ㄧ瓑鎶€鏈繘涓€姝ラ檷浣庢垚鏈紝涔熷皢浼氭帹鍑篠erverless鑳藉姏锛屽苟涓斾細閫氳繃鏂扮‖浠舵潵鍔犻€熻绠楋紝闄嶄綆鎴愭湰銆?/span>

6

鏂楅奔鐩存挱浠?鍒?娣峰悎浜戞灦鏋勬紨杩?/span>

馃敹 鏂楅奔鎶€鏈€荤洃椹媷 涓哄ぇ瀹跺垎浜簡鏂楅奔鐩存挱鐨勬贩鍚堜簯鏋舵瀯婕旇繘涔嬭矾銆?/span>

鏂楅奔鐩存挱鎴愮珛浜?014骞达紝鏄互娓告垙璧涗簨涓轰富鐨勭洿鎾钩鍙帮紝骞冲彴绛剧害鍥藉唴Top100涓绘挱绾?0浣嶏紝瑕嗙洊娓告垙涓绘挱Top10涓?浣嶏紝鏈堟椿杈?.5浜匡紝2019骞碤1浠樿垂鐢ㄦ埛绾?00涓囥€?/span> 鏂楅奔涓昏鏈変笁鏉′笟鍔＄壒鐐癸細 澶撮儴涓绘挱鐑偣鏁堝簲锛屾祦閲忔按浣嶆尝鍔ㄨ緝澶э紝浠ュ強鍦ㄧ嚎浜掑姩鍦烘櫙杈冨銆?/span>

鐩墠鐨勬妧鏈幇鐘舵槸姣忓ぉ涓氬姟璋冪敤閲忓湪鍗冧嚎宸﹀彸锛孯edis瀹炰緥闆嗙兢杈?000浠ヤ笂锛屽崟涓帴鍙PS杈?0涓囦互涓娿€?/span>

鏂楅奔鐩存挱浠?016骞村紑濮嬩繚鎸佹瘡骞?5%浠ヤ笂鐨勬湀娲诲闀匡紝鐩墠闈㈠鐨勬妧鏈洶澧冧富瑕佹湁涓夌偣锛?/span>

(1)鈥滅偢楸尖€濓紝澶撮儴娴侀噺鎷栨鍏ㄧ珯鎴块棿锛?/span>

(2)鏈嶅姟鍣ㄨ祫婧愬埄鐢ㄧ巼浣庯紝鏃ュ父姘翠綅澶ч噺鏈嶅姟鍣ㄩ棽缃紱

(3)Redis缁存姢鍜屽鐏炬垚鏈珮銆?/span>

鏂楅奔娣峰悎浜戞灦鏋勫巻绋嬩富瑕佸垎涓轰笁涓樁娈碉紝鍦ㄦ帰绱㈡湡鍋氫簡鐙珛涓氬姟涓婁簯鐨勫皾璇曪紱 鍦ㄦ垚闀挎湡閫氳繃IDC+浜戠殑鏂瑰紡瀹炵幇浜嗘í鍚戞祦閲忔墿瀹癸紱 鍦ㄦ垚鐔熸湡瀹屾垚妯悜鎵╁涔嬪悗瀹炵幇瀵硅祫婧愮殑鏈€澶у寲鍒╃敤銆?/span>

鎺㈢储鏈?/span> 鐨勪富瑕佽儗鏅槸IDC纭欢璧勬簮鍛堢幇涓洪暱鏈熺揣缂虹姸鎬侊紝鐮斿彂鏀拺璺熶笉涓婁笟鍔″彂灞曪紝鑰屽叕鏈変簯閫愭鎴愮啛銆傚洜姝ゅ湪杩欎竴闃舵锛屾枟楸煎皾璇曟€ч€夊彇浜嗗箍鍛婁笟鍔′綔涓轰笂浜戣瘯鐐癸紝骞朵笖鍙栧緱浜嗚緝澶ф敹鐩婏紝绯荤粺鐨勫悶鍚愰噺鐩寸嚎涓婂崌锛屼緷璧栫ǔ瀹氭€ф樉钁楁彁鍗囷紝璁＄畻鎴愭湰涔熷ぇ骞呬笅闄嶃€?/span>

浣嗘槸杩欎竴妯″紡鐨勯€傜敤鑼冨洿杈冪獎锛屾棤娉曠洿鎺ュ鍒跺埌鍏朵粬涓氬姟鍦烘櫙锛岃€屼笖杩欎竴妯″紡鍙€傜敤浜庡崟涓€鏁版嵁涓績鐨勬儏鍐碉紝浜庢槸灏辫繘鍏ヤ簡鎴愰暱鏈熴€?/span>

鎴愰暱鏈?/span> 鐨勮儗鏅槸闇€瑕佽В鍐矷DC鍒板叕鏈変簯鐨勬暟鎹€氶亾鏋勫缓闂銆傞拡瀵硅繖涓€闂锛屾枟楸煎拰闃块噷浜戝叡鍚屾瀯寤轰簡RedisShake鏁版嵁鍚屾宸ュ叿锛屾敮鎸佷簡Redis鍏ㄩ噺銆佸閲忔暟鎹悓姝ャ€佹敮鎸佷簯涓娿€佷簯涓嬩笉鍚屾暟鎹腑蹇冪殑鍚屾锛岃繕鏀寔绉掔骇鏁版嵁鐩戞帶銆?/span>

閫氳繃RedisFullCheck瀹炵幇浜嗘暟鎹缁村害瀵规瘮锛屽熀鏈兘淇濊瘉鏁版嵁閫氳矾鐨勬暟鎹竴鑷存€ч棶棰樸€傝繖涓€闃舵鐨勬敹鐩婂湪浜庡疄鐜颁簡鍗曚竴鏈烘埧鍒板鏈烘埧鐨勬暟鎹墿灞曡繃绋嬨€傝繖涓樁娈靛瓨鍦ㄥ瓨鍦ㄤ袱鐐规湁寰呮敼杩涳紝鍗宠祫婧愯皟搴︽垚鏈瘮杈冮珮鍜岃祫婧愮己涔忕簿缁嗗寲杩愯惀銆?/span>

鎴愮啛鏈?/span> 鐨勪富瑕佷紭鍖栨柟鍚戞槸鑱岃矗鍒嗙鍜屽脊鎬т几缂╋紝浼樺寲鏂规鍖呮嫭鍥涗釜鏂归潰锛屽嵆娴侀噺鍒嗙骇銆佹暟鎹喎鐑垎绂汇€佸脊鎬т几缂╁拰娴侀噺璋冨害銆傚叾涓皟搴︾瓥鐣ュ寘鎷簡鎵嬪姩璋冨害銆佸畾鏃惰皟搴︺€佽祫婧愭秷鑰楄皟搴﹀拰Hook璋冨害銆?/span>

瀵逛簬娣峰悎浜戞灦鏋勮€岃█锛屾枟楸间篃鎬荤粨浜嗕笁鐐圭粡楠岋細

鍏呭垎鍚堢悊璇勪及锛?/span> 浜戜笂璁＄畻缃戠粶涓嶪DC宸紓杈冨ぇ锛岄渶瑕佺粨鍚堜笟鍔″疄闄呮儏鍐佃繘琛屾祴璇曪紝閬垮厤浜х敓褰卞搷銆?/span>
鎶曞叆浜у嚭姣旓細 娣峰悎浜戞灦鏋勫璧勬簮鍐椾綑瀛樺湪涓€瀹氳姹傛垨鑰呭甫鏉ヤ竴瀹氳礋闈㈠奖鍝嶃€?/span>
寤舵椂闂锛?/span> 浼佷笟搴旈€氳繃璇勪及涓氬姟鐨勯噸瑕佹€у喅瀹氭槸鍚﹀仛娣峰悎浜戯紝铏界劧浠庢暟鎹腑蹇冨埌浜戞湁涓撶嚎锛屼絾涔熷瓨鍦ㄤ竴瀹氬欢鏃躲€?/span>

7

Cassandra&X-Pack Spark浜戞暟鎹簱鎶€鏈墫鏋?/span>

馃敹 闃块噷浜戞櫤鑳介珮绾ф妧鏈笓瀹舵浌榫?灏佺) 涓哄ぇ瀹跺墫鏋愪簡Cassandra涓嶺-Pack Spark浜戞暟鎹簱鎶€鏈€?/span>

涓轰粈涔堥€夋嫨Cassandra鍛紵 Cassandra鏄竴绉嶅畬鍏ㄦ病鏈変腑蹇冪殑鏁版嵁搴擄紝鍏舵瘡涓妭鐐归兘鏄富鑺傜偣锛屽鏋淜ill鎺夊叾涓换浣曚竴涓妭鐐归兘涓嶄細褰卞搷闆嗙兢鐨凲PS浠ュ強寤舵椂銆?/span>

闄や簡Cassandra浣跨敤鐨凱2P-QUORUM鏈哄埗涔嬪锛岃繕鏈塇A鏈哄埗銆丷aft浠ュ強鍗曞唴瀛樺壇鏈?鍏变韩瀛樺偍绛夋満鍒讹紝鑰屽彧鏈塁assandra鑳藉鍋氬埌鍑犱箮娌℃湁鎰熺煡鏃堕棿锛屽洜姝assandra鐨凷logan灏辨槸鈥淎lways Online鈥濄€?/span>

Cassandra鑳藉瀹炵幇骞虫粦鎵╁睍锛屼竴鏂归潰鍙互澧炲姞鑺傜偣鏁版嵁閲忥紝鐢氳嚦鎵╁睍澶氫釜DC銆?/span> 鍙︿竴鏂归潰鍦ㄤ簯涓婅繕鍙互澧炲姞鍐呭瓨绛夈€?/span> 骞虫粦鎵╁睍鏄疌assandra鐨勯噸瑕佺壒鎬э紝鍏朵粬鏁版嵁搴撳線寰€闅句互鍋氬埌銆?/span> Cassandra杩樺彲浠ュ疄鐜板叏鐞冨DC锛屾灦鏋勫笀鍙互鏍规嵁涓氬姟鑷敱閫傞厤銆?/span>

瀵逛簬瀛︿範鎴愭湰鑰岃█锛孋assandra鎻愪緵绫讳技浜嶴QL璇彞鐨凜QL锛屼細MySQL鐨凞BA鎴栬€呭紑鍙戜汉鍛樺熀鏈笂涓€澶╀箣鍐呭氨鑳藉浼欳assandra銆?/span> 鍦ㄥ畨鍏ㄦ柟闈紝Cassandra鍜屼富娴佹暟鎹簱涓€鏍锋彁渚涗簡瀹屽杽鐨勮璇佷互鍙婇壌鏉冧綋绯汇€?/span>

鍦ㄥ璇█鏂归潰锛孋assandra閲囩敤浜嗛潪Thrift鏂瑰紡锛岄噰鐢ㄥ鎴风鍜屾湇鍔＄鐩磋繛鏂瑰紡锛屽苟涓旀敮鎸佷富娴佺殑璇█锛屽苟涓斿叿鏈夎壇濂界殑鎬ц兘銆?/span>

鏈€鍚庝竴鐐癸紝灏辨槸杩愮淮绠€鍗曪紝Cassandra鏁翠綋鍙湁涓€涓繘绋嬶紝娌℃湁Proxy銆丠A浠K绛夎鑹茶妭鐐广€?/span>

Cassandra鍏锋湁寰堝鍔熻兘锛屾瘮杈冪壒鍒殑灏辨槸鍏剁储寮曟敮鎸佺墿鍖栬鍥俱€佽繕鏀寔SASI鍏ㄦ枃绱㈠紩锛屽苟涓旈泦鎴愪簡Lucene鍋氭洿寮虹殑鍏ㄦ枃绱㈠紩锛屼互鍙婃敮鎸丆DC瀵规帴娴佸紡绯荤粺銆?/span>

Cassandra鐨勫姛鑳藉拰鐢熸€佹瘮杈冧赴瀵岋紝鍏跺彲浠ュ拰鍏朵粬缁勪欢杩涜鎼厤锛屾瘮濡係park銆並afka銆丒S銆丩ucene銆丷ocksDB绛夈€?/span>

Cassandra鍦ㄥ琛ㄩ鍩熸帓鍚嶅叏鐞冪涓€ 锛屽嵆浣垮湪鍥藉唴缂轰箯瀹ｄ紶鐨勬儏鍐典笅鎺掑悕涔熸槸闈犲墠鐨勩€侰assandra鐨勫彂灞曠洰鍓嶅凡缁忕粡杩囦簡鍗佸勾锛屽叾灏咥WS鐨凞ynamoDB鍜孏oogle鐨凚igTable涓よ€呯殑闀垮铻嶅悎鍦ㄤ竴璧峰舰鎴愮殑銆?/span>

闃块噷宸村反涔熷湪2019骞村叕娴嬪苟鍙戝竷浜?/span> 闃块噷浜慍assandra鏁版嵁搴撴湇鍔?/span> 锛屽苟涓斿鍘熺敓鐨凜assandra杩涜浜嗗鏂归潰鎻愬崌锛屾瘮濡傚疄鐜颁簡鑷姩鍖栬繍缁淬€佸吋瀹笵ynamoDB銆佸叏閾捐矾浼樺寲鎬ц兘鎻愬崌100%绛夈€?/span>

闃块噷浜慍assandra鐗?span class="mq-473">浜戞暟鎹簱鏄湪绾垮彲闈犵殑NoSQL鍙皟涓€鑷存€х殑鍒嗗竷寮忔暟鎹簱鏈嶅姟锛屾敮鎸佺被SQL璇硶CQL锛屾彁渚涘己澶х殑鍒嗗竷寮忕储寮曡兘鍔涳紝鎻愪緵瀹夊叏銆佸娲诲鐏俱€佺洃鎺с€佸浠芥仮澶嶇瓑浼佷笟绾ц兘鍔涳紝鍏煎DynamoDB鍗忚銆?/span>

X-Pack Spark涓嶄粎浠呮敮鎸丆assandra锛岃繕鑳藉鏀寔HBase銆丳hoenix銆丷DS鍜孧ongoDB銆?/span> X-Pack Spark涓嶄粎鍏锋湁寮哄ぇ鐨勮繛鎺ヨ兘鍔涘拰褰掓。鑳藉姏锛岃繕鑳藉閫氳繃ElasticNode闄嶄綆璁＄畻鍜屽瓨鍌ㄦ垚鏈€?/span>

Cassandra+Spark鑳藉搴旂敤浜庨潪甯稿箍娉涚殑涓氬姟鍦烘櫙涓紝姣斿鐢ㄦ埛鐢诲儚銆丗eed銆佸皬瀵硅薄瀛樺偍浠ュ強鎺ㄨ崘骞冲彴绛夈€?/span>

灏哠park涓嶤assandra鐨勪紭鐐圭粨鍚堝湪涓€璧疯兘澶熸弧瓒冲绉嶄笟鍔″満鏅殑闇€姹傦紝鑳藉瀹炵幇Always Online銆佹墿灞曟€у己銆佸ソ鐢ㄣ€佸姛鑳藉拰鐢熸€佷赴瀵屼互鍙奡park鏁版嵁闂幆銆?/span>

10鏈?3鏃?/span> 锛堟槑澶╋級  15:00-16:30

RDS MySQL涓夎妭鐐逛紒涓氱増

鏂板搧鍙戝竷浼?/span>

閲婃斁寮€婧愮増鎶€鏈孩鍒?/strong>

閭€鎮ㄤ竴鍚?span>瑙ｉ攣鏍稿績鎶€鏈?/strong>锛?/span>

鐐瑰嚮 闃呰鍘熸枃  棰勭害瑙傜湅

闃块噷宸村反鏁版嵁搴撴妧鏈?/span>

寰俊锛歛libabadba

鍒嗕韩鏁版嵁搴撳墠娌?nbsp;

瑙ｆ瀯瀹炴垬骞茶揣

闀挎寜浜岀淮鐮佸叧娉?/strong>