Unique Term Extractor

This node creates a global set of terms over all documents. Optionally, it is possible to filter the top-k words in terms of frequencies. There are three different frequencies to choose from for filtering: the term frequency, the document frequency and the inverse document frequency.

• Term Frequency ( TF ): Overall count of a term in all documents.
• Document Frequency ( DF ): Number of documents in which a term occurs.
• Inverse Document Frequency ( IDF ): The logarithm of the total number of documents divided by the DF .

More information about term frequencies can be found here .

Input ports

1. Type: Table
   Documents input table
   The input table containing the documents.

Output ports

1. Type: Table
   Terms output table
   An output table containing a unique term column, frequency columns and an index column.