Hub
  • Software
  • Blog
  • Forum
  • Events
  • Documentation
  • About KNIME
  • KNIME Hub
  • Search

34 results

Filter
Data engineer
Best practices Data engineering Education ELT Spark
+4
  1. Go to item
    Workflow
    00.1_Extensions_setup
    Education Data engineering Data engineer
    +1
    Open this workflow and install suggested extensions. Restart KNIME Analytics Platform. After the extensions are installed, you ca…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > 00.1_Extensions_setup
    0
  2. Go to item
    Workflow
    02.2 Database update
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_2_ETL_Processing_II > 02.2_Database_update
    0
  3. Go to item
    Workflow
    03.0_Setup_Local_Big_Data_Environment
    Education Data engineering Data engineer
    +3
    This workflow sets up a local big data environment for the next exercise. It creates a local big data environment and loads the u…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.0_Setup_Local_Big_Data_Environment
    0
  4. Go to item
    Workflow
    04.0_Reset_DB&Big_Data_Environment
    Education Data engineering Data engineer
    +3
    This workflow resets the database by overwriting the customers and statistics tables and sets up a local big data environment and…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_4_Orchestration > 04.0_Reset_DB&Big_Data_Environment
    0
  5. Go to item
    Workflow
    Parse Contract Values Testflow
    Best practices Data engineer Data engineering
    +7
    For the company, it is important that contract values are always parsed correctly, even after the changes in the workflow. Theref…
    lada > Public > Testing Framework > testflows > report > 01_Parse_Contract_Values_Testflow
    0
  6. Go to item
    Workflow
    02.1_Data_Anonymization
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_2_ETL_Processing_II > 02.1_Data_Anonymization
    0
  7. Go to item
    Workflow
    01.2_Extract_S3_data&Blend
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_1_ETL_Processing_I > 01.2_Extract_S3_data&Blend
    0
  8. Go to item
    Workflow
    03.3_Aggregation_on_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.3_Aggregation_on_Spark
    0
  9. Go to item
    Workflow
    00.2_Setup_PostgreSQL_Database
    Education Data engineering Data engineer
    +1
    This workflow writes tables "customers", "contracts", "statistics" to PostgreSQL database. These tables in the database will be u…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > 00.2_Setup_PostgreSQL_Database
    0
  10. Go to item
    Workflow
    Orchestration Testflows
    Best practices Data engineer Data engineering
    +5
    In this workflow, we call all the tetflows, import their statuses and metadata and create a simple pdf report.
    lada > Public > Testing Framework > testflows > report > 03_Orchestration_Testflows
    0
  11. Go to item
    Workflow
    Parse Contract Values
    Education Data engineering Data engineer
    +4
    The company reads the pdf contracts, parses them, and extracts relevant information to save it in the tabular form. This workflow…
    lada > Public > Testing Framework > workflows > 01a_Parse_Contract_Values
    0
  12. Go to item
    Workflow
    03.4_Writing_from_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.4_Writing_from_Spark
    0
  13. Go to item
    Workflow
    02.1_Data_Anonymization
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_2_ETL_Processing_II > 02.1_Data_Anonymization
    0
  14. Go to item
    Workflow
    04.1_ETL_Customers
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_4_Orchestration > 04.1_ETL_Customers
    0
  15. Go to item
    Workflow
    03.4_Writing_from_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.4_Writing_from_Spark
    0
  16. Go to item
    Workflow
    03.2_Missing_value_imputation_on_Spark
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.2_Missing_value_imputation_on_Spark
    0
  17. Go to item
    Workflow
    Parse Contract Values Testflow
    Best practices Data engineer Data engineering
    +7
    For the company, it is important that contract values are always parsed correctly, even after the changes in the workflow. Theref…
    lada > Public > Testing Framework > testflows > JUnit > 01_Parse_Contract_Values_Testflow_JUnit
    0
  18. Go to item
    Workflow
    URL File Testflow
    Education Data engineering Data engineer
    +3
    A company validates that the file containing the URL for the US Customers data Web service is correct. The file is available in t…
    lada > Public > Testing Framework > testflows > report > 02_URL_File_Testflow
    0
  19. Go to item
    Workflow
    04.2_ELT_Usage
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_4_Orchestration > 04.2_ELT_Usage
    0
  20. Go to item
    Workflow
    04.1_ETL_Customers
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_4_Orchestration > 04.1_ETL_Customers
    0

KNIME
Open for Innovation

KNIME AG
Hardturmstrasse 66
8005 Zurich, Switzerland
  • Software
  • Getting started
  • Documentation
  • E-Learning course
  • Solutions
  • KNIME Hub
  • KNIME Forum
  • Blog
  • Events
  • Partner
  • Developers
  • KNIME Home
  • KNIME Open Source Story
  • Careers
  • Contact us
Download KNIME Analytics Platform Read more on KNIME Server
© 2022 KNIME AG. All rights reserved.
  • Trademarks
  • Imprint
  • Privacy
  • Terms & Conditions
  • Credits