RedLDA

Redundancy-Aware Topic Modeling

Copy Paste Redundancy or Data Duplication are prevalent in many corpora.This redundancy has a negative impact on the quality of text mining and topic modeling in particular. This is a software package of a novel variant of Latent Dirichlet Allocation (LDA)
topic modeling, Red-LDA, which takes into account the inherent redundancy of corpora when
modeling content.

My site: http://www.cs.bgu.ac.il/~cohenrap/
Lab site: http://www.cs.bgu.ac.il/~nlpproj/

Sister project: http://sourceforge.net/projects/corpusredundanc/