Hub

156 results

Filter
Filter by tag
Data engineering
Best practices Data engineer Education ELT Spark Big data Orchestration Workflow dependencies
  1. Workflow
    Interactive Workflow Metadata exploration
    KNIMEServer Web application Workflow summary
    +2
    This workflow shows a simple guided analytics application for exploring the metadata of a workflow. The example uses the Analyze …
    knime > Examples > 09_Enterprise > 03_Metadata_Mapping > Interactive_Workflow_Metadata_Exploration
    4
    knime
  2. Workflow
    Database Jam Session
    Database Credentials MySQL
    +8
    This workflow jams together data from not one, not two, but six databases! They are: MySQL, MongoDB, MS SQL Server, MariaDB, Orac…
    knime > Examples > 01_Data_Access > 02_Databases > 08_Database_Jam_Session
    3
    knime
  3. Workflow
    Try & Catch for Google Books API
    Onboarding Data engineering
    Use this workflow to wrap your GET request to Google Books API into a Try & Catch
    lada > Public > Examples > Try & Catch for Google Books API
    1
    lada
  4. Workflow
    Google BigQuery meets Databricks
    Google BigQuery DB query Cloud
    +7
    This workflow connects to the Austin Bikeshare dataset, hosted among the Google BigQuery public datasets and a Databricks instanc…
    knime > Examples > 10_Big_Data > 01_Big_Data_Connectors > 07_Will_They_Blend_BigQuery_Databricks
    1
    knime
  5. Workflow
    01.2_Extract_WebService_data&Blend_solution
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Spring Summit Training 2023 > L4-DE Best Practices for Data Engineering > solutions > Session_1_ETL_Processing_I > 01.2_Extract_WebService_data&Blend
    0
    hayasaka
  6. Workflow
    02.1_Data_Anonymization_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > exercises > Session_2_ETL_Processing_II > 02.1_Data_Anonymization
    0
    hayasaka
  7. Workflow
    Microsoft Sharepoint meets Google Cloud Storage
    Google Cloud Microsoft Sharepoint
    +6
    This workflow accesses data on Google Cloud Storage and on Microsoft Sharepoint, blends the data, and formats the data into a tab…
    haoran > Public > 01_Data_Access > 06_ZIP_and_Remote_Files > 08_Microsoft_Sharepoint_meets_Google_Cloud_Storage
    0
    haoran
  8. Workflow
    03.4_Writing_from_Spark_exercise
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.4_Writing_from_Spark
    0
    hayasaka
  9. Workflow
    00.1_Extensions_setup
    Education Data engineering Data engineer
    +1
    Open this workflow and install suggested extensions. Restart KNIME Analytics Platform. After the extensions are installed, you ca…
    hayasaka > KNIME Spring Summit Training 2023 > L4-DE Best Practices for Data Engineering - SQLite Version > 00.1_Extensions_setup
    0
    hayasaka
  10. Workflow
    03.0_Setup_Local_Big_Data_Environment
    Education Data engineering Data engineer
    +3
    This workflow sets up a local big data environment for the next exercise. It creates a local big data environment and loads the u…
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.0_Setup_Local_Big_Data_Environment
    0
    hayasaka
  11. Workflow
    03.3_Aggregation_on_Spark_solution
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.3_Aggregation_on_Spark
    0
    hayasaka
  12. Workflow
    03.1_In-database&Spark_processing_solution
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.1_In-database&Spark_processing
    0
    hayasaka
  13. Workflow
    00.1_Extensions_setup
    Education Data engineering Data engineer
    +1
    Open this workflow and install suggested extensions. Restart KNIME Analytics Platform. After the extensions are installed, you ca…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > 00.1_Extensions_setup
    0
    knime
  14. Workflow
    01.2_Extract_WebService_data&Blend_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_1_ETL_Processing_I > 01.2_Extract_WebService_data&Blend
    0
    knime
  15. Workflow
    03.2_Missing_value_imputation_on_Spark_exercise
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.2_Missing_value_imputation_on_Spark
    0
    knime
  16. Workflow
    04.0_Reset_DB&Big_Data_Environment
    Education Data engineering Data engineer
    +3
    This workflow resets the database by overwriting the customers and statistics tables and sets up a local big data environment and…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_4_Orchestration > 04.0_Reset_DB&Big_Data_Environment
    0
    knime
  17. Workflow
    01.1_Extract_S3_data_solution
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_1_ETL_Processing_I > 01.1_Extract_S3_data
    0
    knime
  18. Workflow
    03.2_Missing_value_imputation_on_Spark_solution
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    hayasaka > KNIME Fall Summit Training 2022 > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.2_Missing_value_imputation_on_Spark
    0
    hayasaka
  19. Workflow
    03.2_Missing_value_imputation_on_Spark_solution
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    hayasaka > KNIME Spring Summit Training 2023 > L4-DE Best Practices for Data Engineering - SQLite Version > solutions > Session_3_ELT_on_Big_Data > 03.2_Missing_value_imputation_on_Spark
    0
    hayasaka
  20. Workflow
    04.1_ETL_Customers_exercise
    Best practices Data engineer Data engineering
    +1
    The company has two branches: one in the United States and another one in Europe. New US customer data comes from a web service. …
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_4_Orchestration > 04.1_ETL_Customers
    0
    knime