Scala Spark Core Spark Sql Hdfs Architecture Hive

Dataproc Bigquery Gcs Composer Dataflow

Hdfs Hive Hbase Oozie Sqoop

Java Apache Spark Jenkins Gitlab Kafka

Pyspark Sql Hive Impala Cdp

Java Mysql Oozie Zookeeper Sqoop

Apache Impala Apache Kafka PySpark Sqoop Apache Oozie

Hadoop Apache Spark Hive SQL Oozie

Hadoop Hive IBM DB2 SQL Server Oracle

Java Oozie Pig Hive Spark

Pyspark Hive Impala Hdfs Hadoop

Java Hadoop Apache Storm Flink Kafka