Hub
NodeNode / Manipulator

Unique Term Extractor

Other Data Types Text Processing Transformation
Drag & drop
Like
Copy short link

This node creates a global set of terms over all documents. Optionally, it is possible to filter the top-k words in terms of frequencies. There are three different frequencies to choose from for filtering: the term frequency, the document frequency and the inverse document frequency.

  • Term Frequency ( TF ): Overall count of a term in all documents.
  • Document Frequency ( DF ): Number of documents in which a term occurs.
  • Inverse Document Frequency ( IDF ): The logarithm of the total number of documents divided by the DF .
More information about term frequencies can be found here .

Node details

Input ports
  1. Type: Table
    Documents input table
    The input table containing the documents.
Output ports
  1. Type: Table
    Terms output table
    An output table containing a unique term column, frequency columns and an index column.

Extension

The Unique Term Extractor node is part of this extension:

Related workflows & nodes

  1. Get a listing of all unique characters present in a text file
    arddashti > Public > Get a listing of all unique characters present in a text file
  2. Will they blend? MS Word meets Web Crawling.
    NLP Natural Language Processing
    On one side we have a list of cookie recipes saved in a Word Document on the local machin…
    sameerb > Public > 10_Discover_Secret_IngredientSB
  3. Will they blend? MS Word meets Web Crawling.
    NLP Natural Language Processing Will they blend
    +1
    On one side we have a list of cookie recipes saved in a Word Document on the local machin…
    knime > Examples > 08_Other_Analytics_Types > 01_Text_Processing > 10_Discover_Secret_Ingredient
  4. 01_caption_preprocessing
    Image processing Image analysis Image captioning
    +5
    In this workflow we use simple textprocessing techniques to reduce the complexity of the …
    davek > Public > DL_Workshop_ImgAna_2020 > ImageCaptioning > 01_caption_preprocessing
  5. 01_caption_preprocessing
    Image processing Image analysis Image captioning
    +5
    In this workflow we use simple textprocessing techniques to reduce the complexity of the …
    bwilhelm > Public > I2K_2022_Workshop_DL_with_KNIME > ImageCaptioning > 01_caption_preprocessing
  6. Generate Mountain Names (Training)
    Deep learning Keras Text generation
    +7
    The workflow builds, trains, and saves an RNN with an LSTM layer to generate new fictive …
    knime > Examples > 04_Analytics > 14_Deep_Learning > 02_Keras > 10_Generate_Product_Names_With_LSTM > 01_Training
  7. Generate Mountain Namesn (Training)
    Deep learning Keras Text generation
    +6
    The workflow builds, trains, and saves an RNN with an LSTM layer to generate new fictive …
    kathrin > Public > Forum_Questions > Forum_Question_How_to_Generate_Product_Names_with_my_own_list > 01_Training
  8. Generate Mountain Namesn (Training)
    Deep learning Keras Text generation
    +6
    The workflow builds, trains, and saves an RNN with an LSTM layer to generate new fictive …
    knimeoutjie > Public > 10_Generate_Product_Names_With_LSTM > 01_Training
  9. Deploying a Deep Learning Model to Classify Reviews in a Database
    Deep learning Keras Text classification
    +9
    This workflow shows how a trained deep learning model can be used to classify new movie r…
    kathrin > Codeless Deep Learning with KNIME > Chapter_10 > Simple_Deployment_Database > Sentiment_Analysis_Deployment
  10. Sentiment Prediction
    kathrin > Codeless Deep Learning with KNIME > Chapter_10 > Integrated_Deployment > data > Created_workflows > Sentiment Prediction