Hub
  • Software
  • Blog
  • Forum
  • Events
  • Documentation
  • About KNIME
  • KNIME Hub
  • Nodes
  • Parameter Optimization Loop Start
NodeNode / LoopStart

Parameter Optimization Loop Start

Analytics Mining Optimization
Drag & drop
Like
Copy short link

This loop starts a parameter optimization loop. In the dialog you can enter several parameters with an interval and a step size. The loop will vary these parameters following a certain search strategy. Each parameter is output as a flow variable. The parameters can then be used inside the loop body either directly or by converting them with a Variable to Table node into a data table.
Currently four search strategies are available:

  • Brute Force: All possible parameter combination (given the intervals and the step sizes) are checked and the best is returned.
  • Hillclimbing: A random start combination is created and the direct neighbors (respecting the given intervals and step sizes) are evaluated. The best combination among the neighbors is the start point for the next iteration. If no neighbor improves the objective function the loop terminates.
  • Random Search: Parameter combinations are randomly chosen and evaluated. The specified start and stop values define the parameter space from which a parameter combination is randomly drawn. Additionally, an optional step size can be defined to restrict the possible parameter values. The loop terminates after a specified number of iterations or, if early stopping is activated, when for a specified number of rounds the objective value has not improved. Note, that it is drawn with replacement. While duplicate parameter combinations will be processed just once, each of them still counts as an iteration. Due to that, it may happen that actually less loop iterations are processed than defined.
  • Bayesian Optimization (TPE): This strategy consists of two phases. The first one is the warm-up in which parameter combinations are randomly chosen and evaluated. Based on the scores of the warm-up rounds, the second phase tries to find promising parameter combinations which are then evaluated. The algorithm used by this strategy is based on an algorithm published by Bergstra et al. (see link further down) and uses Tree-structured Parzen Estimation (TPE) in the second phase to find good parameter combinations. The specified start and stop values define the parameter space from which a parameter combination is randomly drawn. Additionally, an optional step size can be defined to restrict the possible parameter values. The loop terminates after a specified number of iterations. Note, that it is drawn with replacement. While duplicate parameter combinations will be processed just once, each of them still counts as an iteration. Due to that, it may happen that actually less loop iterations are processed than defined.
See also for Bayesian optimization: Algorithms for Hyper-Parameter Optimization by Bergstra et al.

Node details

Output ports
  1. Type: Flow Variable
    Parameters
    A parameter combination as flow variables

Extension

The Parameter Optimization Loop Start node is part of this extension:

  1. Go to item

Related workflows & nodes

  1. Go to item
    optimierung
    d_haupt > Public > optimierung
  2. Go to item
    Installing_Extensions
    knime > Education > Courses > L4-ML Introduction to Machine Learning Algorithms > Installing_Extensions
  3. Go to item
    00. Installing Extensions
    There has been no description set for this workflow's metadata.
    knime > Education > Courses > L2-DS KNIME Analytics Platform for Data Scientists - Advanced > Installing Extensions
  4. Go to item
    00. Installing Extensions
    There has been no description set for this workflow's metadata.
    tenalf > Public > L2-DS KNIME Analytics Platform for Data Scientists - Advanced > Installing Extensions
  5. Go to item
    00.1_Extensions_setup
    Education Data engineering Data engineer
    +1
    Open this workflow and install suggested extensions. Restart KNIME Analytics Platform. Af…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > 00.1_Extensions_setup
  6. Go to item
    SVM Exercise with Parameter Optimization
    SVM Support vector machine Classification
    +4
    Exercise for SVM. Classification of 2D silhouette attributes with SVM classifier. Oprimiz…
    knime > Academic Alliance > Guide to Intelligent Data Science > Exercises > Chapter9_SVM > SVM_Solution
  7. Go to item
    00_Setup workflow
    knime > Education > Courses > L4-CA Machine Learning for Chemical Applications > Exercises > 00_Setup workflow
  8. Go to item
    SVM Exercise with Parameter Optimization
    SVM Support vector machine Classification
    Exercise for SVM. Classification of 2D silhouette attributes with SVM classifier. Oprimiz…
    hayasaka > Public > SVM
  9. Go to item
    Parameter Optimization Loop on Decision Tree Classification
    Parameter optimization Optimization Machine learning
    +3
    This workflow shows an example of parameter optimization in a decision tree. In the decis…
    k10shetty1 > Parameter Optimization for Classification > 01_Parameter_Optimization_with_Nodes > 01_Parameter_Optimization_Loop_on_Decision_Tree
  10. Go to item
    Challange 24
    Transfer-Solutions Justknimeit-24
    Here is a solution for the "Just KNIME it" challange 24.
    rubendg > Just KNIME IT > Challange 24
  1. Go to item
  2. Go to item
  3. Go to item
  4. Go to item
  5. Go to item
  6. Go to item

KNIME
Open for Innovation

KNIME AG
Hardturmstrasse 66
8005 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • E-Learning course
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • KNIME Open Source Story
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more on KNIME Server
© 2022 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Credits