Weighted Latent Dirichlet Allocation, an Optimized and Generalized Probabilistic Topic Model

Authors

  • Muzafar Rasool Bhat University of Kashmir, J&K, India
  • M. Arif Wani University of Kashmir, J&K, India

Keywords:

Dirichlet distribution, LDA, Weighted Dirichlet Distribution (WLDA), Probablistic Topic modelling, Mixture Weighted Dirichlet Disribution (MWDD), MWDD Topic Model.

Abstract

In this study, we have introduced a new distribution named as Mixture Weighted Dirichlet Distribution (MWDD) which acts as generalization to other distributions viz. Dirichlet Distribution, Length or Size-Biased Dirichlet, Area Biased and Volume Biased Dirichlet distributions. Aim of this research is to introduce and implement MWDD for Probabilistic Topic Modeling of Corpus of textual data as an optimized as well as generalized probabilistic topic model. Various statistical and structural properties which include moments (1st, 2nd and rth) moment about origin, Variance and Standard deviation of the proposed distribution are thoroughly studied. Cora, a dataset of 2410 scientific documents in LDA format conforming to probabilistic topic modeling experimentations has been used in this study.  Generative process of new probabilistic topic modeling technique using MWDD is also elaborated in this manuscript. For comparing the efficiency of existing as well as various special cases of the proposed model, AIC’s, AICC’s, BIC’s and log likelihood measures have been utilized.  This study concludes that special case of the proposed model namely Mixture Volume Biased Weighted Dirichlet distribution (MVBWDD) is efficient as it has least AIC, AICC and BIC values with p, a mixture parameter varying from 0 to 1 on probabilistic topic modeling of the Dataset. 

Downloads

Published

2018-02-15

Issue

Vol. 5 No. 1 (2018)

Section

Research Articles

License

Declaration and Copyright Transfer Form

(to be completed by authors)

I/ We, the undersigned author(s) of the submitted manuscript, hereby declare, that the above manuscript which is submitted for publication in the STM Journals(s), is not published already in part or whole (except in the form of abstract) in any journal or magazine for private or public circulation, and, is not under consideration of publication elsewhere.

  • I/We will not withdraw the manuscript after 1 week of submission as I have read the Author Guidelines and will adhere to the guidelines.
  • I/We Author(s ) have niether given nor will give this manuscript elsewhere for publishing after submitting in STM Journal(s).
  • I/ We have read the original version of the manuscript and am/ are responsible for the thought contents embodied in it. The work dealt in the manuscript is my/ our own, and my/ our individual contribution to this work is significant enough to qualify for authorship.
  •  I/We also agree to the authorship of the article in the following order:

Author’s name                                    

 

1. ________________

2. ________________

3. ________________

4. ________________

 

We  Author(s) tick this box and would request you to consider it as our signature as we agree to the terms of this Copyright Notice, which will apply to this submission if and when it is published by this journal.