Spark SQL meets Hive SQL

This workflow builds a line plot of the age distribution for men and women in Maine (US) over the last 5 years.

In particular, women's data is processed via Hive SQL, and men's data via Spark SQL.

Will they blend? The whole data set is initially read from a Hadoop Hive installation.

.... and yes, Spark SQL and Hive SQL do blend!

External resources

• Will they blend? SparkSQL meets HiveQL. Of People Age and Machine Speed.