Description

You will own the modernization of legacy data pipelines and the design of scalable lakehouse architectures on Azure.

This role is remote.

Responsibilities

• Refactor legacy ETL pipelines into Python and PySpark-based solutions.
• Build scalable data pipelines using Azure Data Factory, Synapse, and Databricks.
• Design and support lakehouse architectures utilizing ADLS Gen2 and Delta Lake.
• Optimize SQL queries and large-scale data processing workloads for performance.
• Support cloud migrations from on-premises systems like Teradata, SQL Server, and Oracle.

Required Skills

• Strong Python experience for data engineering.
• Hands-on PySpark or Spark experience.
• Proficiency with the Azure stack: Azure Data Factory, Synapse, or Databricks.
• Advanced SQL skills, including performance tuning and complex transformations.
• Experience with ETL modernization or migration projects.
• 5+ years of professional experience.

Preferred Skills

• Experience with Informatica or legacy ETL migration.
• Background in large enterprise data warehouses or regulated domains like healthcare.

Referral Bonus: Refer a candidate and earn up to $2,000.

Key Skills

Education

Any Gradute