A meta collection about KNIME and performance and performance tuning and some problems

A meta collection about KNIME and performance and performance tuning and some problems

External resources

• Start with the official blog about KNIME performance
• Additional thread about performance and collection of links
• If you are stuck and KNIME is not responding or behaving strangely try a clean restart *once*
• Write table to disk and check Java heap space as options to deal with performance issues
• Check your virus scanner if it hinders performance
• Think about using the Cache node at certain points and you might run the Java Garbage Collector to free meomory
• Tweak the internal storage (format) of KNIME workflows
• Be aware that some configurations of MS OneDrive might not support all the spacial chacaters like hash (#) that KNIME workflows need
• Also sometimes there are problems with these 'snappy' files. Switching the internal storage option might help
• You can also try out the new "Columnar Table Backend" (based on Parquet) for internal storage
• On MacOS make sure that KNIME has all the necessary access rights
• KNIME and Spark 1
• KNIME and Spark 2
• Streaming data in KNIME
• Save and don't save data in a workflow
• Create your own backup system with KNIME and ZIP
• Column rename node is not good to change the column type (sorry)
• KNIME and Backup - think about protecting your work(flows)
• Long entry and thread about performance and KNIME "Process 900+ CSV files"
• Check your installation (on a Windows machine use the .ZIP file if in doubt) - share debug log with the community or support
• To speed up large data processing think about 'streaming' or using Parquet or ORC files (partitioned files)
• Find the KNIME temporary files and folders
• Create path variables in KNIME