Hub
Pricing About
WorkflowWorkflow

01_caption_preprocessing

Image processingImage analysisImage captioningDeep learningNeural networks
+3
bwilhelm profile image
Draft Latest edits on 
Apr 17, 2020 11:57 AM
Drag & drop
Like
Download workflow
Workflow preview
In the last workflow of this series, we predict the captions of the images in our test sample. This can be done using a similar iterative approach, meaning predicting the captions word by word. First, we create a seed by creating a partial caption only containing the special start token. This can then be input into the network to predict the first word of the caption. Using the predicted word, a new partial caption is created, and the process is repeated until the special end toke is predicted. In KNIME, this is implemented in a Recursive Loop. In each loop iteration we check if the end token has been predicted. If this is the case, we exclude the corresponding row from further iteration as the full caption has already been predicted. All other rows are used for the next loop iteration. This is done until the end token has been predicted for all examples.

External resources

  • COCO Dataset Homepage
  • COCO 2014 Data Download
  • Image Captioning
Loading deploymentsLoading ad hoc jobs

Used extensions & nodes

Created with KNIME Analytics Platform version 4.5.2
  • Go to item
    KNIME Base nodesTrusted extension

    KNIME AG, Zurich, Switzerland

    Versions 4.1.2, 4.5.2

    knime
  • Go to item
    KNIME Deep Learning - Keras IntegrationTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 4.1.0

    knime
  • Go to item
    KNIME ExpressionsTrusted extension

    KNIME AG, Zurich, Switzerland

    Versions 4.1.0, 4.5.1

    knime
  • Go to item
    KNIME Image ProcessingTrusted extension

    University of Konstanz / KNIME

    Version 1.8.1

    bioml-konstanz
  • Go to item
    KNIME Python Integration

    KNIME AG, Zurich, Switzerland

    Version 4.1.1

    knime
  • Go to item
    KNIME TextprocessingTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 4.1.0

    knime

Legal

By using or downloading the workflow, you agree to our terms and conditions.

KNIME
Open for Innovation

KNIME AG
Talacker 50
8001 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • Courses + Certification
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more about KNIME Business Hub
© 2025 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Data Processing Agreement
  • Credits