Description

Design and implement data warehouse and data lake architectures on Hadoop platforms to support business intelligence needs.

You will develop and optimize data processing workflows using Spark, execute complex queries with Hive and Impala, and write automation scripts for data manipulation.

Responsibilities

• Implement scalable data warehouse and data lake architectures.
• Develop and optimize data processing workflows using Spark.
• Execute complex queries and perform data analysis using Hive and Impala.
• Write and maintain shell scripts for automation and data manipulation.

Required Skills

• 10+ years of experience in Hadoop development.
• Hands-on expertise with Apache Spark.
• Proven experience with Hive and Impala.
• Proficiency in Python.
• Strong shell scripting and Bash skills.
• Experience with data lake and data warehouse implementations.

Key Skills

Education

Any gradudate