Description

You will lead data migration efforts from on-premises databases to AWS Cloud environments using S3 and Databricks.

Responsibilities

• Build and operationalize complex data solutions, applying transformations and data cleansing techniques.
• Design data architectures and perform analysis on complex sources to determine value for analytical processes.
• Incorporate data governance, security, and quality standards into all data management workflows.
• Test data movement, transformation code, and individual data components to ensure accuracy.
• Perform system analysis to resolve complex defects and incidents within the data pipeline.

Required Skills

• 10+ years of related experience in data engineering.
• Proficiency with Databricks, Apache Spark, and SparkSQL.
• Strong programming skills in Python, Scala, and Java.
• Hands-on experience with data migration from on-premises systems to AWS Cloud/S3.
• Ability to break down complex problems into manageable technical implementations.
• Solid understanding of modern software engineering practices.
• Experience managing data quality and security protocols.
• Bachelor's degree in a STEM-related field or equivalent experience.

Preferred Skills

• Experience with AWS and DBT.

Key Skills

Education

Any Graduate