This node establishes a connection to a specific chat model hosted on the Hugging Face Hub. The difference to the HF Hub LLM Connector is that this node allows you to provide prompt templates which are crucial for obtaining the best output from many models that have been fine-tuned for chat-based usecases.
To use this node, you need to successfully authenticate with the Hugging Face Hub using the HF Hub Authenticator node.
Provide the name of the desired chat model repository available on the Hugging Face Hub as an input.
Please ensure that you have the necessary permissions to access the model. Failures with gated models may occur due to outdated tokens.
Note : If you use the Credentials Configuration node and do not select the "Save password in configuration (weakly encrypted)" option for passing the API key, the Credentials Configuration node will need to be reconfigured upon reopening the workflow, as the credentials flow variable was not saved and will therefore not be available to downstream nodes.