A tutorial on non-parametric methods
October 30, 2014Right now, probably the best general purpose methods for what Frank Wood and Yee Whye Teh called the Graphical Pitman-Yor Process (see their AI&Stats 2009 paper) are ours using table indicators. I gave a tutorial on the hierarchical Dirichlet Process, and the hierarchical Pitman-Yor Process at Monash last week, and the slides are here. Still developing these, so they will be improved. Haven’t made the extension from hierarchical to graphical yet but its in Lan Du‘s PhD thesis. The examples given in the tutorial are about topic models and n-gram models.
Bayesian Models 
[…] Hutter and I review it in Section 8 of an ArXiv paper, and its worked through for this case in my recent tutorial in the section “Working the n-gram Model”. The posterior distribution for the case with […]
[…] mixture model” to the notion of an “hierarchical prior”. I cover this in my tutorial slides discussing n-grams. I consider the hierarchical Pitman-Yor language model to be one of the most […]