Topic Modeling - Optimizing Alpha and Beta

This workflow demonstrates how to compute the Chi-Square Statistics to address the goodness of fit in topic modeling. It tests the multinomial assumptions behind the LDA model and examines whether the observed and estimated word vectors are statistically indistinguishable.

In this workflow, the objective functions we aim to optimize are alpha and beta.

Lewis, C. M., & Grossetti, F. "A Statistical Approach for Optimal Topic Model Identification" (Journal of Machine Learning, 23(58), 1−20, 2022).

External resources

• Say hi to Chi-square (χ²) for Optimal Topic Modeling
• A Statistical Approach for Optimal Topic Model Identification