Hub
Pricing About
WorkflowWorkflow

Ollama KNIME - using LLMs to split names and extract them into CSV - KNIME Forum (84090)

OllamaLLMGenAICSVExtract
+3
mlauber71 profile image
Draft Latest edits on 
Oct 26, 2024 3:20 PM
Drag & drop
Like
Download workflow
Workflow preview

Use LLM (Ollama/Llama3.2) to process text data in Chunks and collect a structured output on your local machine

  • you need Ollama installed and ready to run on your machine, also you should have GPt4All installed

  • tested it with Llama 3.2

  • The text you want to clear / be processed will be stored in chunks in JSOn structures to the LLM will understand the content and you can refer to the columns in the Prompt

  • There will be 10 lines at a time so as not to overflow the memory of the model

  • The Question will consist of the Prompt and then the JSOn file itself

  • The results will either be a CSV structure or sometimes a CSV structure enclosed in backticks - so there is a fork in the workflow to account for both. You might have to adapt this for your own data

  • The columns with the extracted CSV will then be written to actual CSVs and imported back

  • Key is that you tell the LLM to preserve the original row_key so as to be able to join it together

  • obviously some more work on the prompt or the data preprocessing might be necessary - you could also try and employ a (well) LLM to do that

  • An Apple Silicon machine (M1) works reasonably fast in order to let this run locally

External resources

  • Ollama KNIME - using LLMs to split names and extract them into CSV - KNIME Forum (84090)
  • Medium: Chat with local Llama 3 Model via Ollama in KNIME Analytics Platform — Also extract Logs into structured JSON Files
  • Medium: How to leverage open source LLMs locally via Ollama
Loading deploymentsLoading ad hoc jobs

Used extensions & nodes

Created with KNIME Analytics Platform version 5.3.2
  • Go to item
    KNIME AI ExtensionTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.3.2

    knime
  • Go to item
    KNIME Base nodesTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.3.2

    knime
  • Go to item
    KNIME ExpressionsTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.3.2

    knime
  • Go to item
    KNIME JavasnippetTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.3.0

    knime
  • Go to item
    KNIME JSON-ProcessingTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.3.0

    knime
  • Go to item
    KNIME Math Expression (JEP)Trusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.3.0

    knime
  • Go to item
    KNIME Quick FormsTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.3.2

    knime
  • Go to item
    KNIME REST Client ExtensionTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.3.2

    knime
  • Go to item
    KNIME ViewsTrusted extension

    KNIME AG, Zurich, Switzerland

    Version 5.3.2

    knime

Legal

By using or downloading the workflow, you agree to our terms and conditions.

KNIME
Open for Innovation

KNIME AG
Talacker 50
8001 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • Courses + Certification
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more about KNIME Business Hub
© 2025 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Data Processing Agreement
  • Credits