Hub
  • Software
  • Blog
  • Forum
  • Events
  • Documentation
  • About KNIME
Sign in
  • KNIME Hub
  • knime
  • Spaces
  • Examples
  • 08_Other_Analytics_Types
  • 01_Text_Processing
  • 11_Lemmatizer_Preprocessing
WorkflowWorkflow

Stanford Lemmatizer Example

NLP Natural Language Processing lemmatize

Last edited: 

Drag Workflow
Workflow preview
A lemmatizer removes inflections, e.g in case of plurals, pronoun case, and verb endings of a word to revert it back to its base form (a lemma). To use the Lemmatizer node, a POS (Part-of-Speech) tagger, e.g Stanford tagger node, or POS tagger node, has to be applied beforehand, because the lemmatization process relies heavily on the POS tag of each term. This workflows shows a simple example on how to lemmatize terms in documents using the Stanford Lemmatizer node and also to show what exactly the Lemmatizer does to the input document terms, in comparison to other preprocessing nodes, for example the Snowball Stemmer. Stemmer and lemmatizer are both commonly used natural language processing techniques in the field of Information Retrieval. Let's look at the example below and assume the result is an index of a search engine. If we now query the word "mouse", only the first document will be returned using the stemmedTerms. However, if we use the lemmatizedTerms the second document will also be returned, because the word "mice" is a plural form of "mouse".

Used extensions & nodes

Created with KNIME Analytics Platform version 4.1.0
  • KNIME Core Trusted extension

    KNIME AG, Zurich, Switzerland

    Version 4.1.0

  • KNIME Textprocessing Trusted extension

    KNIME AG, Zurich, Switzerland

    Version 4.1.0

Legal

By downloading the workflow, you agree to our terms and conditions.

License (CC-BY-4.0)
Discussion
Discussions are currently not available, please try again later.

KNIME
Open for Innovation

KNIME AG
Hardturmstrasse 66
8005 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • E-Learning course
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • KNIME Open Source Story
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more on KNIME Server
© 2021 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Credits