2018 10-708 (CMU) Probabilistic Graphical Models {Lecture 5} [Algorithms for Exact Inference]

Posted ecoflex

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了2018 10-708 (CMU) Probabilistic Graphical Models {Lecture 5} [Algorithms for Exact Inference]相关的知识,希望对你有一定的参考价值。

技术分享图片

 

 Not in the frontier of research, but the results are used commonly now.

 

技术分享图片

X_{k+1} - X_n are known,

to calculate the joint probability, we have to do inference

 

 技术分享图片

 

技术分享图片

 

技术分享图片

 

技术分享图片

 

 Recent research: on the approximate inference teches

 

技术分享图片

approx:

1) optimization-based

2) sampling-based

 

 技术分享图片

技术分享图片

 

Compare the computational complexity:

    NAIVE way: K^n

    Chain rule:  n*K^2

    n=4

 技术分享图片

 

Chain rule derivation:

 技术分享图片

 

 技术分享图片

 

技术分享图片

 

 技术分享图片

 

 技术分享图片

 

技术分享图片

 

 

技术分享图片

 

 技术分享图片

 

 技术分享图片

 

 技术分享图片

 

marginalizing out the rest 

 

 P(a) P(b) P(c|b) ...... P(h|e,f) => a,b,c,d,e,f,g,h (elimation sequence)

 技术分享图片

introduce a term m_h(e,f) to make e and f dependent

 

技术分享图片

not introducing any dependency here

 

技术分享图片

 

Different elimination sequence will lead to different computational complexity.

It‘s dependent on how large the new clique is

In one step, if you connect every vertex, then you are in trouble.

 

技术分享图片

 

 技术分享图片

技术分享图片

 

技术分享图片

 

 技术分享图片 

 

技术分享图片

 

if there‘s a loop in graph, you can‘t view message passing as a variable to another variable, but clique to clique.

 

以上是关于2018 10-708 (CMU) Probabilistic Graphical Models {Lecture 5} [Algorithms for Exact Inference]的主要内容,如果未能解决你的问题,请参考以下文章

2018 10-708 (CMU) Probabilistic Graphical Models {Lecture 5} [Algorithms for Exact Inference]

2018 10-708 (CMU) Probabilistic Graphical Models {Lecture 15} [Mean field Approximation]

2018 10-708 (CMU) Probabilistic Graphical Models {Lecture 21} [A Hybrid: Deep Learning and Graphical

Probabilistic Graphical Models 10-708, Spring 2017

CMU Deep Learning 2018 by Bhiksha Raj 学习记录(10)

CMU Deep Learning 2018 by Bhiksha Raj 学习记录