Description

You will design, develop, and maintain scalable, secure, and highly available data architectures on cloud platforms.

Responsibilities

• Develop PySpark scripts for integration with ETL, DQ, RC, and DP frameworks using Big Data technologies.
• Write Hive queries for data analysis and Sqoop queries to import data into Hadoop.
• Create pre-install and post-install scripts, and manage code in Bitbucket.
• Deploy code from SIT to UAT and PROD environments using RLM.
• Design and implement data security and access controls to ensure data privacy and confidentiality.

Required Skills

• 5+ years of experience in Data Engineering or a related occupation.
• Proficiency with AWS, Azure, or Google Cloud platforms.
• Experience with Hadoop ecosystems.
• Strong capabilities in Data Analysis.
• Experience developing PySpark scripts.
• Familiarity with ETL, DQ, RC, and DP concepts.
• Bachelor's degree in Science, Technology, or Engineering.

Key Skills

Education

Bachelor's degree