
Topic  Reading/Assignments  Due Date 
Bayes Nets and CRFs (Lectures L1L7) 
[GT] Chapters 2, 4;
[RN] Chapter 14; [RN 1st edition] Chapter 15
Slides: Introduction to Bayes Networks Slides: Inference part I (slides from [RN]) Slides: Inference part II Slides: Markov Random Fields Slides: Learning Paper: Loopy beliefpropagation for approximate inference: An empirical study. K. Murphy, Y. Weiss, and M. I. Jordan. in UAI 1999. 

Additional Sources 
Belief propagation:
Pearl's algorithm for multiplexer nodes,
Kevin Murphy, 1999.
Belief Propagation: Alan Fern's class notes Inference for undirected graphs (plus more): Graphical models M. I. Jordan, Statistical Science, 19, 140155, 2004. Overview of many topics: Appendix of Kevin Murphy's Thesis 

Review Questions  Review Questions  
Assignment 1 
Assignment 1
Input files (netwroks and queries) 
February 3 
(First Order) Logic, Logic Programming and ILP (Lectures L8L11)  [RN] Chapters 7, 8; [GT] Chapter 3  
Assignment 2  Assignment 2  March 10 
Relational BNs 
L12: PRM: [GT] Chapter 5.
Presentation Slides (local access)
L13: RMN: [GT] Chapter 6 Presentation Slides (local access) L14: RBN: Complex Probabilistic Modeling with Recursive Relational Bayesian Networks Manfred Jaeger, Annals of Mathematics and Artificial Intelligence 32 (2001), pp. 179  220. Presentation Slides (local access) L15: RDN: [GT] Chapter 8 Presentation Slides (local access) 

Logic plus Probabilities 
L16: BLP: [GT] Chapter 9
L17: MLN: [GT] Chapter 12 Presentation Slides (local access) L18: BLOG: [GT] Chapter 13 

L19: Recap and Comparison of Models  Using examples from: Comparative Study of Probabilistic Logic Languages and Systems  
Relational MDPs 
L20: API: [GT] Chapter 18.
Presentation Slides
MDPs ,
API ,
(local access)
L21: First Order Decision Diagrams for Relational MDPs C. Wang, S. Joshi and R. Khardon, Journal of AI Research , Vol 31, pp431472, 2008 Stochastic Planning with First Order Decision Diagrams, S. Joshi and R. Khardon, Proceedings of the International Conference on Automated Planning and Scheduling, 2008 

FO Probabilitic Inference 
L22: FOPI: [GT] Chapter 15.
Presentation Slides (local access)
Lifted Probabilistic Inference with Counting Formulas B. Milch, L. Zettlemoyer, K. Kersting, M. Haimes, L. Pack Kaelbling. Proceedings of the TwentyThird AAAI Conference on Artificial Intelligence (AAAI2008) Lifted FirstOrder Belief Propagation Pedro domingos and Parag Singla. Proceedings of the TwentyThird AAAI Conference on Artificial Intelligence (pp. 10941099), 2008. Exploiting Shared Correlations in Probabilistic Databases Prithviraj Sen, Amol Deshpande, Lise Getoor International Conference on Very Large Data Bases  2008. 

Techniques and Applications for NLP 
L23: [GT] Chapter 19
L24: [GT] Chapter 20. Presentation Slides (local access) 

Project Presentations (L25L26)  Project Presentations 