Hub

70 results

Filter
Spark
Big Data Hive Hadoop Best practices Data engineer Data engineering ELT
  1. Workflow
    A meta collection about KNIME and performance and performance tuning and some problems
    Knime Performance Slow
    +23
    A meta collection about KNIME and performance and performance tuning and some problems
    mlauber71 > Public > _knime_performance_and_tuning
    3
    mlauber71
  2. Workflow
    Working with Google cloud services
    Google Bigquery Cloud storage
    +2
    This workflow demonstrates how to connect to various Google Cloud Services such as Google BigQuery, Google Dataproc, and Google C…
    knime > Examples > 10_Big_Data > 01_Big_Data_Connectors > 04_GoogleCloudExample
    1
    knime
  3. Workflow
    Movie Recommendation Engine with Spark Collaborative Filtering
    Retail Association rules Recommandation engine
    +10
    Creates a Recommendating Engine using Spark and Big data nodes on movie rating data.
    knime > Examples > 10_Big_Data > 02_Spark_Executor > 10_Recommendation_Engine_w_Spark_Collaborative_Filtering
    1
    rs1
  4. Workflow
    Working with Databricks
    Big data Databricks Spark
    +2
    This workflow demonstrates the usage of the Create Databricks Environment node which allows you to connect to a Databricks Cluste…
    knime > Examples > 10_Big_Data > 01_Big_Data_Connectors > 03_DatabricksExample
    1
    knime
  5. Workflow
    Big Data Analytics - Model Selection to Predict Flight Departure Delays on Hive & Spark
    Data blending Data science Machine learning
    +7
    This workflow trains a number of data analytics models on Hadoop and Spark and automatically selects the best model to predict de…
    knime > Examples > 50_Applications > 28_Predicting_Departure_Delays > 02_Scaling_Analytics_w_BigData
    1
    tobias.koetter
  6. Workflow
    Spark Compiled Model Predictor
    Spark Hadoop Big Data
    This workflow demonstrates the usage of the Spark Compiled Model Predictor node which converts a given PMML model into machine co…
    knime > Examples > 10_Big_Data > 02_Spark_Executor > 03_PMML_to_Spark_Comprehensive_Mode_Learning_Mass_Prediction
    1
    tobias.koetter
  7. Workflow
    03 Manipulating Big Data
    Big data Spark Hive
    L4-BD SELF-PACED COURSE exercise: - Manipulate data on Hive with the DB nodes - Perform ETL operations in Spark with the Spark no…
    manuel1972 > Public > Self-Paced Courses > L4-BD Introduction to Big Data with KNIME Analytics Platform > Exercises > 03 Manipulating Big Data
    0
    manuel1972
  8. Workflow
    04 Model Building on Big Data
    Big data Spark
    L4-BD SELF-PACED COURSE exercise: - Train a ML model in Spark - Read the prediction results into KNIME
    manuel1972 > Public > Self-Paced Courses > L4-BD Introduction to Big Data with KNIME Analytics Platform > Exercises > 04 Model Building on Big Data
    0
    manuel1972
  9. Workflow
    04 Model Building on Big Data
    Big data Spark
    L4-BD SELF-PACED COURSE exercise: - Train a ML model in Spark - Read the prediction results into KNIME
    halverdog > Public > L4-BD Introduction to Big Data with KNIME Analytics Platform > Exercises > 04 Model Building on Big Data
    0
    halverdog
  10. Workflow
    Hive to Spark and Spark to Hive
    Spark Hive Hadoop
    +2
    This workflow demonstrates the usage of the Hive to Spark and Spark to Hive nodes that allow you to transfer data between Apache …
    knime > Education > Courses > L4-BD Introduction to Big Data with KNIME Analytics Platform > 3_Spark > 4_Examples > 05_Hive_to_Spark_to_Hive
    0
    knime
  11. Workflow
    03 Manipulating Big Data - Solution
    Big data Spark Hive
    Solution to an L4-BD SELF-PACED COURSE exercise: - Manipulate data on Hive with the DB nodes - Perform ETL operations in Spark wi…
    tqthanh168 > Public > Self-Paced Courses > L4-BD Introduction to Big Data with KNIME Analytics Platform > Solutions > 03 Manipulating Big Data - Solution
    0
    tqthanh168
  12. Workflow
    03 Manipulating Big Data - Solution
    Big data Spark Hive
    Solution to an L4-BD SELF-PACED COURSE exercise: - Manipulate data on Hive with the DB nodes - Perform ETL operations in Spark wi…
    manuel1972 > Public > Self-Paced Courses > L4-BD Introduction to Big Data with KNIME Analytics Platform > Solutions > 03 Manipulating Big Data - Solution
    0
    manuel1972
  13. Workflow
    s_605 - use the stored rules and lists to actually prepare the data
    Spark H2o Data
    +4
    s_605 - apply the label encoding and other transformations stored in SQL code and the selected final column as RegEx string Get t…
    mlauber71 > Public > kn_example_bigdata_h2o_automl_spark_46 > s_605_spark_prepare_data
    0
    mlauber71
  14. Workflow
    s_601 - Sparkling predictions and encoded labels - "the poor man's ML Ops" (on a Big Data System)
    Knime Spark Hive
    +7
    Sparkling predictions and encoded labels - "the poor man's ML Ops" (on a Big Data System) Use Big Data Technologies like Spark to…
    mlauber71 > Public > kn_example_bigdata_h2o_automl_spark_46 > s_601_spark_label_encoder
    0
    mlauber71
  15. Workflow
    03.2_Missing_value_imputation_on_Spark_solution
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.2_Missing_value_imputation_on_Spark
    0
    hayasaka
  16. Workflow
    03.3_Aggregation_on_Spark_solution
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_3_ELT_on_Big_Data > 03.3_Aggregation_on_Spark
    0
    hayasaka
  17. Workflow
    04.2_ELT_Usage
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > solutions > Session_4_Orchestration > 04.2_ELT_Usage
    0
    hayasaka
  18. Workflow
    Fetch and Transform PubChem Data
    BigData Spark JSON
    +2
    This workflow prepares a data set using Local Big Data Environment for Data Chefs Battle: Chemistry vs Biology. It collects resul…
    b_eslami > Public > 02_Chemistry_and_Life_Sciences > 02_Fetch_And_Transform_PubChem_Data > 02_Fetch_And_Transform_PubChem_Data
    0
    b_eslami
  19. Workflow
    03.4_Writing_from_Spark_exercise
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.4_Writing_from_Spark
    0
    hayasaka
  20. Workflow
    03.2_Missing_value_imputation_on_Spark_exercise
    Education Data engineering Data engineer
    +3
    The company tracks the usage of the website and stores the information about each session. - Various data are collected, e.g., se…
    knime > Education > Courses > L4-DE Best Practices for Data Engineering > exercises > Session_3_ELT_on_Big_Data > 03.2_Missing_value_imputation_on_Spark
    0
    hayasaka