Description

You will build and maintain an Enterprise Data Platform on AWS using Databricks, owning data ingestion, transformation, and source integration.

This role is on-site.

Responsibilities

• Lead data ingestion efforts and take full ownership of data sources and datasets.
• Optimize data transformation capabilities using the Medallion architecture.
• Analyze structured, unstructured, and semi-structured data to determine profiling and ingestion methods.
• Mentor junior engineers to promote engineering excellence and improve delivery processes.
• Collaborate with staff engineers to drive efficient workflows and proactive data integration.

Required Skills

• 5+ years of experience in data engineering roles.
• Extensive experience with Databricks, AWS, Python, Spark, and DBT.
• Proven track record managing cloud migration projects from on-premises systems.
• Expertise in data modeling and transformation within a Medallion architecture.
• Deep knowledge of data structures including Oracle, DB2, Mainframe, MongoDB, and DynamoDB.
• Ability to profile various data formats to optimize ingestion strategies.
• Strong experience leading teams and mentoring junior technical staff.
• Any Graduate degree.

Key Skills

Education

Any Gradute