This node provides the authentication for all OpenAI models. Learn more
Collection
KNIME for Generative AI
Explore this collection of ready to use workflows to get started with using Large Language Models (LLMs). Browse workflows for connecting to and interacting with LLMs, building chat apps, performing retrieval augmented generation, and more.
KNIME AI Extension Guide
This webinar guides you through creating your first workflow with the AI extension.
Like
Query AI via KNIME
In this section we introduce three Large Language Model (LLM) approaches accessible in KNIME via the KNIME AI Extension (Labs): OpenAI / Azure OpenAI, and Hugging Face. They can be used for text generation, translation, classification, and summarization tasks. Each of these three approaches contains three different nodes: one for authentication with the online model, one for connecting to the online model and one for sending the prompts to the model
OpenAI
Use the latest OpenAI model to classify your documents. OpenAI is most known for its application ChatGPT and offers the most state-of-the-art general models. One will yield the best general results with OpenAI models since they have been trained on a vast amount of data and the most parameters for decision-making.
Go to item
Workflow
Simple OpenAI Prompt
This workflow shows how to connect to an OpenAI LLM and send prompts to it.
AI Extension Example Workflows1) Large Language Models1.1 - Simple OpenAI Prompt
5
Azure OpenAI
Use the latest OpenAI models that are hosted on the Azure Cloud. These are the same models as the OpenAI ones but hosted in the secure Azure infrastructure.
Hugging Face
HuggingFace is an open-source community for building applications using machine learning models. Use their free or paid text-generating models right from the Hugging Face hub. These models can produce better results than the ones from OpenAI depending on the use case since HuggingFace offers the possibility to up and download specifically fine-tuned models.
Go to item
Workflow
Simple HuggingFace Prompt
This workflow shows how to connect to an LLM on Hugging Face Hub and send prompts to it.
AI Extension Example Workflows1) Large Language Models1.2 - HuggingFace Hub
4
Build a chatbot
KNIME makes it easy for you to use chat models. Chat models are a subset of LLMs trained for specific conversation inputs. For this reason, it is possible to connect each chat model to a LLM port but not vice versa.
Build with Open AI
Use the ChatGPT Application’s underlying model to build your chat with KNIME.
Go to item
Workflow
Simple ChatGPT Prompt
This workflow shows how to connect to the model behind ChatGPT and send prompts to it.
AI Extension Example Workflows2) Chat Model2.1 - Simple ChatGPT prompt
1
Build with Azure OpenAI
Use the latest OpenAI models that are hosted on the Azure Cloud. These are the same models as the OpenAI ones but hosted in the secure Azure infrastructure.
Add related information to your chat
Not only can you create your chatbot with KNIME, but you can also provide it with your data. Cut the cost of training or fine-tuning your model by providing it directly with the necessary content. Preprocess your documents in KNIME, store them in a local Vector Store and retrieve semantically similar documents to your question to enrich the content given to your chatbot.
Go to item
Workflow
Create a Vector Store
This workflow shows how to create a vector store from a KNIME table using OpenAI Embeddings and the FAISS Vector Store Creator.
AI Extension Example Workflows3) Vector Stores3.1 - Create a Vector Store
2
Information retrieval with an agent
You can further empower your chatbot by turning it into an agent. Since retrieving related information from a vector store is not always necessary, an agent decides whether it needs additional information sources to answer. Providing the agent with a set of different knowledge bases, it will automatically choose whether and from where information will be retrieved.
KNIME AI Extension (Labs)
Check out the whole extension below. Note that it is still in labs, so there can be compatibility changes because some features are significantly actively developed currently. Please share your feedback in the KNIME forum.
Go to item
Extension
KNIME AI Extension (Labs)
This KNIME extension connects to LLMs, chat and embeddings models from OpenAI, Hugging Face Hub and GPT4ALL.
KNIME AG, Zurich, Switzerland
7