Hub

137 results

Filter
Apache Spark
AWS Chemistry Amazon S3 Livy PubChem Bioactivity data Biology Life sciences Big Data Tools & Services
+8
  1. Workflow
    01_Fetch_BioAssays
    PubChem Chemistry AWS
    +7
    This is the first workflow in the PubChem Big Data story. In the top part of the workflow we download the assay data from the Pub…
    knime > Life Sciences > Cheminformatics > ChemistryFPs_vs_BiologyFPs > DataPrep > 01_Fetch_BioAssays
    0
    knime
  2. Workflow
    02_Pivot_PubChemData
    Big Data AWS Apache Spark
    +4
    This is the second workflow in the PubChem Big Data story.
    knime > Life Sciences > Cheminformatics > ChemistryFPs_vs_BiologyFPs > DataPrep > 02_Pivot_PubChemData
    0
    knime
  3. Workflow
    03_Fetch_SMILES
    PubChem AWS Chemistry
    +4
    This is the third workflow in the PubChem Big Data story. First, we obtain the SMILES of the necessary CIDs using PubChem REST se…
    knime > Life Sciences > Cheminformatics > ChemistryFPs_vs_BiologyFPs > DataPrep > 03_Fetch_SMILES
    0
    knime
  4. Workflow
    04_Generate_Features
    Apache Spark KNIME Workflow Executor for Apache Spark KWEfAS
    +4
    This is the forth workflow in the PubChem Big Data story.
    knime > Life Sciences > Cheminformatics > ChemistryFPs_vs_BiologyFPs > DataPrep > 04_Generate_Features
    0
    knime
  5. Workflow
    01_Fetch_BioAssays
    AWS Apache Spark Amazon S3
    +1
    AWS Autentication component, Paths to Livy and S3 component, and Create Spark Contex (Livy) node require configuration.
    arnaud_heitzman > New space1 > link2hub
    0
    arnaud_heitzman
  6. Node / Source
    Create Local Big Data Environment
    Tools & Services Apache Spark
    Creates a fully functional local big data environment including Apache Hive, Apache Spark and HDFS. The Spark WebUI of the create…
    0
    knime
  7. Node / Source
    Create Local Big Data Environment (Legacy) (deprecated)
    Tools & Services Apache Spark
    Creates a fully functional local big data environment including Apache Hive, Apache Spark and HDFS. The Spark WebUI of the create…
    0
    knime
  8. Node / Source
    Create Spark Context (Jobserver) (deprecated)
    Tools & Services Apache Spark
    Creates a new Spark context via Spark Jobserver. Support for Spark Jobserver is deprecated and the Create Spark Context (Livy) no…
    0
    knime
  9. Node / Source
    Create Spark Context (Livy) (deprecated)
    Tools & Services Apache Spark
    Creates a new Spark context via Apache Livy . This node requires access to a remote file system such as HDFS/webHDFs/httpFS or S3…
    0
    knime
  10. Node / Source
    Create Spark Context (Livy)
    Tools & Services Apache Spark
    Creates a new Spark context via Apache Livy . This node requires access to a remote file system such as HDFS/webHDFs/httpFS or S3…
    0
    knime
  11. Node / Source
    Create Big Data Test Environment (deprecated)
    Tools & Services Apache Spark
    Creates a fully functional big data environment for testing purposes, including Apache Hive, Apache Spark and a remote file syste…
    0
    knime
  12. Node / Source
    Create Big Data Test Environment (legacy) (deprecated)
    Tools & Services Apache Spark
    Creates a fully functional big data environment for testing purposes, including Apache Hive, Apache Spark and a remote file syste…
    0
    knime
  13. Node / Source
    Create Databricks Environment (deprecated)
    Tools & Services Apache Spark
    Creates a Databricks Environment connected to an existsing Databricks cluster. See AWS or Azure Databricks documentation for more…
    0
    knime
  14. Node / Source
    Create Databricks Environment
    Tools & Services Apache Spark
    Creates a Databricks Environment connected to an existsing Databricks cluster. See AWS or Azure Databricks documentation for more…
    0
    knime
  15. Node / Source
    Create Local Big Data Environment (deprecated)
    Tools & Services Apache Spark
    Creates a fully functional local big data environment including Apache Hive, Apache Spark and HDFS. The Spark WebUI of the create…
    0
    knime
  16. Node / Manipulator
    Spark Category To Number
    Tools & Services Apache Spark Column
    +1
    Maps nominal column to double columns.
    0
    knime
  17. Node / Manipulator
    Spark Column Filter
    Tools & Services Apache Spark Column
    This node allows columns to be filtered from the input Spark DataFrame/RDD while only the remaining columns are passed to the out…
    0
    knime
  18. Node / Manipulator
    Spark Joiner
    Tools & Services Apache Spark Column
    +1
    This node joins two Spark DataFrame/RDDs in a database-like way. The join is based on the joining columns of both DataFrame/RDDs.
    0
    knime
  19. Node / Manipulator
    Spark Missing Value (Apply)
    Tools & Services Apache Spark Column
    +1
    Reads missing value replacement settings from the PMML port and applies them to the data. The node can handle the output of the K…
    0
    knime
  20. Node / Manipulator
    Spark Missing Value
    Tools & Services Apache Spark Column
    +1
    This node helps handle missing values found in the ingoing Spark data. The first tab in the dialog (labeled Default ) provides de…
    0
    knime