Description

Build and maintain scalable data applications and ETL pipelines within the Microsoft Azure ecosystem.

Responsibilities

• Develop batch ETL pipelines and real-time data processes using diverse source and target locations.
• Design technical architectures for enterprise projects in partnership with analysts and architects.
• Perform root cause analysis on data processes to identify improvements and solve complex data problems.
• Mentor and coach other data professionals on engineering standards, design reviews, and code reviews.
• Document data engineering capabilities, standards, and operational processes.

Required Skills

• 5+ years of progressive data engineering experience.
• 3+ years of hands-on experience with PySpark.
• Expertise in Azure Databricks, Python, and Scala.
• Deep knowledge of Azure architecture including Synapse and Azure Data Factory (ADF) pipelines.
• Strong proficiency in T-SQL, SQL Server, and Synapse stored procedures.
• Experience with AWS and CI/CD implementation.
• Practical application of dimensional modeling, data warehousing, and data governance.
• Experience with code refactoring, design patterns, and building scalable data applications.
• Ability to work with structured and unstructured data across SQL and No-SQL databases.

Preferred Skills

• Experience developing real-time data pipelines.
• Knowledge and understanding of Boomi.

Key Skills

Education

Any Graduate