Description

You will design and maintain scalable data engineering solutions within a cloud environment.

This role is on-site.

Responsibilities

• Design and implement scalable data engineering solutions on the cloud.
• Build large-scale data pipelines using distributed processing to support data science and application teams.
• Translate business requirements into functional data engineering architectures.
• Partner with product managers, architects, and data quality engineers to deliver solutions.
• Contribute to defining data governance across the platform.

Required Skills

• 3+ years of experience building scalable data engineering solutions.
• Proficiency in Python (TDD) and PySpark for building scalable algorithms.
• 3+ years of experience with Apache Spark, including optimization techniques.
• 2+ years of experience with Databricks, Delta tables, Unity Catalog, Delta Sharing, and Delta Live Tables (DLT).
• 3+ years of experience building ETL/ELT pipelines on Databricks and AWS (EMR).
• 2+ years of experience orchestrating pipelines using Apache Airflow or MWAA.
• Advanced SQL coding skills, including query optimization and nested queries.
• Experience with AWS services including S3, EC2, and ADX.
• 3+ years of experience in data modeling for structured and unstructured datasets.
• Experience with relational and columnar databases such as Redshift, RDS, Athena, and Redshift Spectrum.
• Strong understanding of Object Oriented Programming (OOP).

Preferred Skills

• Experience working in Agile and CI/CD environments.
• Experience building HTTP/REST APIs.
• Healthcare industry experience.

Key Skills

Education

Any Graduate