Description

You will lead the development team and drive the overall development effort in coordination with Solutions Architects and offshore resources.

Responsibilities

• Lead the development team and provide technical direction for all workstreams.
• Review development artifacts and deliverables to ensure engineering best practices are met.
• Collaborate with stakeholders and the ACFC team to align with engineering philosophies.
• Manage data pipeline construction and transformation logic within Azure Databricks.
• Convert existing Scala programs to PySpark.

Required Skills

• 5+ years of professional experience in data engineering.
• Expertise in Azure Databricks (ADB) for building data pipelines.
• Proficiency in Python and Spark for data transformations.
• Experience working with Scala programs within Databricks.
• Hands-on experience with Azure Data Factory (ADF).
• Working knowledge of Azure Data Lake Gen2.
• Experience with Synapse Analytics (dedicated SQL pool).
• Practical experience with Delta Lake and PySpark.
• Strong SQL skills.

Preferred Skills

• Experience with Tidal Scheduler.
• Background working in the Healthcare domain.

Key Skills

Education

Any Graduate