2.3 - ChatModel Temperature

You can easily download and run the workflow directly in your KNIME installation. We recommend that you use the latest version of the KNIME Analytics Platform for optimal performance.

In the context of language models like ChatGPT (which is an example of a large language models), temperature is a parameter that affects the randomness and creativity of the model's output. When generating text, the temperature determines how much the model prioritizes high-probability words and how much it explores less likely options.

A higher temperature, such as 1.0, makes the model more random and creative. It increases the likelihood of generating diverse and unexpected responses. On the other hand, a lower temperature, such as 0.5, makes the model more focused and conservative, favoring more probable and safe responses.

In order to run the workflow you need an OpenAI API key. If you don't have one already, register with OpenAI and create a new API key under https://platform.openai.com/account/api-keys

External resources

• OpenAI API Keys