Description

You lead complex data engineering projects, designing architectures that align with business requirements and optimizing large-scale data workflows. This role is on-site.

Responsibilities

• Design, construct, and test data architectures and pipelines for large-scale datasets.
• Lead technical execution of data projects, ensuring best practices and high-quality solutions.
• Collaborate with product, finance, and business units to ensure pipelines meet specific requirements.
• Oversee data solutions that enable predictive and prescriptive analytics across environments.

Required Skills

• 8+ years overall IT experience, including 5+ years in data engineering.
• Strong proficiency in Python scripting and PySpark for data processing.
• Expertise in SQL and big data processing techniques.
• Proven experience building data lakes in Iceberg format with a strong architectural understanding.
• Hands-on experience with AWS Glue jobs and AWS cloud data services (S3, Redshift, Lambda, EMR, Airflow, Postgres, SNS, Event Bridge).
• Strong understanding of healthcare finance systems.
• Experience leading data engineering teams in Agile environments.

Key Skills

Education

Any Graduate