This connector allows you to connect to a local GPT4All LLM. To get started, you need to download a specific model from the GPT4All model explorer on the website. It is not needed to install the GPT4All software. Once you have downloaded the model, specify its file path in the configuration dialog to use it.
It is recommended to use models (e.g. Llama 2) that have been fine-tuned for chat applications. For model specifications including prompt templates, see GPT4All model list .
The currently supported models are based on GPT-J, LLaMA, MPT, Replit, Falcon and StarCoder.
For more information and detailed instructions on downloading compatible models, please visit the GPT4All GitHub repository .