Description

You will design, develop, and maintain scalable data pipelines and architectures on Azure Cloud.

Responsibilities

• Implement and manage Azure Data Lake solutions to store and process large data volumes.
• Develop and maintain ETL processes using Azure Data Factory.
• Write efficient and optimized SQL queries for data extraction, transformation, and loading.
• Monitor and troubleshoot data pipelines to ensure performance and reliability.
• Implement data security and compliance measures according to industry standards.

Required Skills

• 8-10+ years of Data Engineering experience, with 2-3+ years focused on Azure Cloud services.
• 3-5+ years experience working with Azure Data Lake.
• 3-5+ years of Python for data processing and automation.
• 2+ years of Databricks experience.
• 1-2+ years of Azure Data Factory (ADF) for ETL processes.
• 5+ years of SQL, including prior ETL experience such as SSIS.
• Familiarity with data governance and security best practices.
• Strong problem-solving and communication abilities.

Preferred Skills

• Master’s degree in a related field.
• Experience with Azure Synapse Analytics or Azure Machine Learning.

Key Skills

Education

Any Graduate