Hub
Pricing About
ComponentComponent

Topic Model Goodness of Fit (χ²)

Topic modelingLDAChi square
francescots profile image
Versionv.1.0 (Experimental)Latest, created on 
Apr 10, 2024 6:49 AM
Drag & drop
Like
Use or download
The Topic Model Goodness of Fit (χ2) component calculates the χ2 statistic to assess the goodness of fit of a topic model. It operates on the output of an LDA or any other similar model that outputs the Topic Word Weight (TWW) and Document Topic Weight (DTW) matrices. It exclusively utilizes KNIME Nodes, eliminating the necessity for installing or configuring external scripting languages This component follows the methodology implemented in the R library "OpTop" (Optimal Topic Modeling), available at GitHub - Optop (https://github.com/contefranz/OpTop). However, it's important to note that due to potential technical differences in implementation, results may vary slightly. The theoretical framework for this component is based on the statistical test described in the paper: Lewis, C. M., & Grossetti, F. "A Statistical Approach for Optimal Topic Model Identification" (Journal of Machine Learning, 23(58), 1−20, 2022). This paper outlines the first statistical test used for optimal topic model identification, providing the theoretical foundation for the χ2 statistic computation.

Component details

Input ports
  1. Type: Table
    DTW
    Document Topic Weight
  2. Type: Table
    TTW
    Topic Term Weight
Output ports
  1. Type: Table
    Model fit
    χ2 for the entire LDA model
  2. Type: Table
    Document fit
    χ2 for each document

External resources

  • Say hi to Chi-square (χ²) for Optimal Topic Modeling
  • A Statistical Approach for Optimal Topic Model Identification (Journal of Machine Learning Research 23)
  • OpTop Project

Used extensions & nodes

Created with KNIME Analytics Platform version 5.2.3
  • Go to item
    KNIME Base nodesTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.2.2

    knime
  • Go to item
    KNIME Data GenerationTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.2.0

    knime
  • Go to item
    KNIME JavasnippetTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.2.0

    knime
  • Go to item
    KNIME Math Expression (JEP)Trusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.2.0

    knime
  • Go to item
    KNIME Quick FormsTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.2.2

    knime
  • Go to item
    KNIME TextprocessingTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.2.0

    knime
  • Go to item
    KNIME Timeseries nodesTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.2.0

    knime

This component does not have nodes, extensions, nested components and related workflows

Legal

By using or downloading the component, you agree to our terms and conditions.

KNIME
Open for Innovation

KNIME AG
Talacker 50
8001 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • Courses + Certification
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more about KNIME Business Hub
© 2025 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Data Processing Agreement
  • Credits