Hierarchical Dirichlet Scaling Process

Abstract

We present the heirarchical Dirichlet scaling process (HDSP), a Bayesian nonparametric mixed membership model for multi-labeled data. We construct the HDSP based on the gamma representation of the hierarchical Dirichlet process (HDP) which allows scaling the micture components. With such construction, HDSP allocates a latent location to each label and micture component in a space, and uses the distance between them to guide membership probabilities. We develop a variational Bayes algorithm for the approximate posterior inference of the HDSP. Though experiments on synthetic datasets as well as datasets of newswire, medical journal articles and Wikipedia, we show that the HDSP results in better predictive performance that HDP, labeled LDA and partially labeled LDA. Show more