Hub

140 results

Filter
Filter by tag
Data engineer
Best practices Data engineering Education ELT Spark Big data Orchestration Workflow dependencies Workflow service
  1. Workflow
    URL File Testflow
    Education Data engineering Data engineer
    +3
    A company validates that the file containing the URL for the US Customers data Web service is correct. The file is available in t…
    lada > Public > Testing Framework > testflows > report > 02_URL_File_Testflow
    0
    lada
  2. Workflow
    02.1_Data_Anonymization_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > exercises > Session_2_ETL_Processing_II > 02.1_Data_Anonymization
    0
    hayasaka
  3. Workflow
    01.2_Extract_WebService_data&Blend_solution
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Spring Summit Training 2023 > L4-DE Best Practices for Data Engineering > solutions > Session_1_ETL_Processing_I > 01.2_Extract_WebService_data&Blend
    0
    hayasaka
  4. Workflow
    01.2_Extract_S3_data&Blend_solution
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    chemgirl36 > Public Space > L4-DE Best Practices for Data Engineering > solutions > Session_1_ETL_Processing_I > 01.2_Extract_S3_data&Blend
    0
    chemgirl36
  5. Workflow
    03.4_Writing_from_Spark_exercise
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.4_Writing_from_Spark
    0
    hayasaka
  6. Workflow
    00.1_Extensions_setup
    Education Data engineering Data engineer
    +1
    Open this workflow and install suggested extensions. Restart KNIME Analytics Platform. After the extensions are installed, you ca…
    chemgirl36 > Public Space > L4-DE Best Practices for Data Engineering > 00.1_Extensions_setup
    0
    chemgirl36
  7. Workflow
    01.2_Extract_WebService_data&Blend_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Spring Summit Training 2023 > L4-DE Best Practices for Data Engineering - SQLite Version > exercises > Session_1_ETL_Processing_I > 01.2_Extract_WebService_data&Blend
    0
    hayasaka
  8. Workflow
    02.2 Database update_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Spring Summit Training 2023 > L4-DE Best Practices for Data Engineering - SQLite Version > exercises > Session_2_ETL_Processing_II > 02.2_Database_update
    0
    hayasaka
  9. Workflow
    02.1_Data_Anonymization_solution
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > solutions > Session_2_ETL_Processing_II > 02.1_Data_Anonymization
    0
    hayasaka
  10. Workflow
    03.3_Aggregation_on_Spark_solution
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    chemgirl36 > Public Space > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.3_Aggregation_on_Spark
    0
    chemgirl36
  11. Workflow
    01.2_Extract_S3_data&Blend_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    chemgirl36 > Public Space > L4-DE Best Practices for Data Engineering > exercises > Session_1_ETL_Processing_I > 01.2_Extract_S3_data&Blend
    0
    chemgirl36
  12. Workflow
    04.1_ETL_Customers_solution
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Spring Summit Training 2023 > L4-DE Best Practices for Data Engineering - SQLite Version > solutions > Session_4_Orchestration > 04.1_ETL_Customers
    0
    hayasaka
  13. Workflow
    Orchestration Testflows
    Best practices Data engineer Data engineering
    +5
    In this workflow, we call all the tetflows, import their statuses and metadata and create a simple pdf report.
    lada > Public > Testing Framework > testflows > report > 03_Orchestration_Testflows
    0
    lada
  14. Workflow
    01.1_Extract_WebService_data_solution
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > solutions > Session_1_ETL_Processing_I > 01.1_Extract_WebService_data
    0
    hayasaka
  15. Workflow
    01.1_Extract_S3_data_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Spring Summit Training 2023 > L4-DE Best Practices for Data Engineering > exercises > Session_1_ETL_Processing_I > 01.1_Extract_S3_data
    0
    hayasaka
  16. Workflow
    00.1_Extensions_setup
    Education Data engineering Data engineer
    +1
    Open this workflow and install suggested extensions. Restart KNIME Analytics Platform. After the extensions are installed, you ca…
    hayasaka > KNIME Spring Summit Training 2023 > L4-DE Best Practices for Data Engineering - SQLite Version > 00.1_Extensions_setup
    0
    hayasaka
  17. Workflow
    04.1_ETL_Customers_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    chemgirl36 > Public Space > L4-DE Best Practices for Data Engineering > exercises > Session_4_Orchestration > 04.1_ETL_Customers
    0
    chemgirl36
  18. Workflow
    03.3_Aggregation_on_Spark_solution
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.3_Aggregation_on_Spark
    0
    hayasaka
  19. Workflow
    01.1_Extract_WebService_data_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > exercises > Session_1_ETL_Processing_I > 01.1_Extract_WebService_data
    0
    hayasaka
  20. Workflow
    04.1_ETL_Customers_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > exercises > Session_4_Orchestration > 04.1_ETL_Customers
    0
    hayasaka