Description

Design and maintain scalable data engineering solutions using Python, Azure Data Factory, and Azure Databricks.

This role is on-site.

Responsibilities

• Build and optimize ADF pipelines for reliable data ingestion and transformation workflows.
• Develop and tune PySpark jobs in Databricks for large-scale distributed data processing.
• Translate business requirements into efficient cloud-based data integration and analytics solutions.
• Ensure data quality, performance, and reliability across end-to-end ETL/ELT pipelines.
• Monitor, troubleshoot, and resolve failures in ADF pipelines and Databricks workloads.

Required Skills

• 10+ years of hands-on engineering experience.
• Expertise in Python for data engineering tasks.
• Strong proficiency with Azure Data Factory (ADF).
• Experience developing and optimizing Databricks workloads.
• Deep understanding of ETL/ELT pipeline design and optimization.
• Knowledge of Azure security, governance, and compliance standards.

Preferred Skills

• Experience delivering solutions for overseas contractor models.

Key Skills

Education

Any Gradute