A meta collection about KNIME and performance and performance tuning and some problems
Workflow
A meta collection about KNIME and performance and performance tuning and some problems
External resources
- Start with the official blog about KNIME performance
- Additional thread about performance and collection of links
- If you are stuck and KNIME is not responding or behaving strangely try a clean restart *once*
- Write table to disk and check Java heap space as options to deal with performance issues
- Check your virus scanner if it hinders performance
- Think about using the Cache node at certain points and you might run the Java Garbage Collector to free meomory
- Tweak the internal storage (format) of KNIME workflows
- Be aware that some configurations of MS OneDrive might not support all the spacial chacaters like hash (#) that KNIME workflows need
- Also sometimes there are problems with these 'snappy' files. Switching the internal storage option might help
- You can also try out the new "Columnar Table Backend" (based on Parquet) for internal storage
- On MacOS make sure that KNIME has all the necessary access rights
- KNIME and Spark 1
- KNIME and Spark 2
- Streaming data in KNIME
- Save and don't save data in a workflow
- Create your own backup system with KNIME and ZIP
- Column rename node is not good to change the column type (sorry)
- KNIME and Backup - think about protecting your work(flows)
- Long entry and thread about performance and KNIME "Process 900+ CSV files"
- Check your installation (on a Windows machine use the .ZIP file if in doubt) - share debug log with the community or support
- To speed up large data processing think about 'streaming' or using Parquet or ORC files (partitioned files)
- Find the KNIME temporary files and folders
- Create path variables in KNIME
Used extensions & nodes
All required extensions are part of the default installation of KNIME Analytics Platform version 4.6.3
No known nodes available
Loading deployments
Loading ad hoc executions
Legal
By using or downloading the workflow, you agree to our terms and conditions.
Discussion
Discussions are currently not available, please try again later.