Description

You will lead complex data engineering projects and design architectures that align with business requirements.

Responsibilities

• Lead the development of data pipelines and architectures designed to handle large-scale datasets.
• Design, construct, and test data architecture to meet specific business needs.
• Provide technical leadership for data projects to ensure best practices and high-quality solutions.
• Collaborate with product, finance, and other business units to ensure pipeline alignment.
• Use DBT to transform raw data into actionable insights and oversee solutions for predictive analytics.

Required Skills

• 12+ years of overall IT experience with 5+ years focused on core data technologies.
• Strong experience in Python scripting and PySpark for data processing.
• Proficiency in SQL and managing big data via Informatica ETL.
• Proven experience in data quality and optimization of data lakes in Iceberg format.
• Hands-on experience with AWS services including S3, Redshift, Lambda, EMR, Airflow, Postgres, SNS, and Event Bridge.
• Expertise in BASH/Shell scripting.
• Experience with Data Build Tool (DBT) or similar transformation tools.
• Experience with MuleSoft API.

Preferred Skills

• Experience with Kafka and Tableau.
• Strong understanding of healthcare data systems and experience leading data engineering teams.
• Experience working in Agile environments.

Key Skills

Education

Any Graduate