This node prompts a chat model using the provided user message, with an existing conversation history as context.
If you want to reduce the amount of consumed tokens, consider reducing the conversation table length to a reasonable (e.g. 5 conversation steps) length before feeding it into the node.
Note : If you use the Credentials Configuration node and do not select the "Save password in configuration (weakly encrypted)" option for passing the API key for the chat model connector node, the Credentials Configuration node will need to be reconfigured upon reopening the workflow, as the credentials flow variable was not saved and will therefore not be available to downstream nodes.