Description

Role Overview :

As an Azure Data Engineer you will be instrumental in designing, developing, and maintaining our clients' data pipelines and infrastructure on the Azure cloud platform. You will collaborate closely with data scientists, analysts, and other engineers to build robust, scalable, and reliable data solutions. Your work will directly impact our clients' ability to derive meaningful insights from their data, enabling them to make data-driven decisions and improve business outcomes.

Key Responsibilities :

- Design and implement data ingestion pipelines from various sources into Azure Data Lake Storage, ensuring data quality and integrity.

- Develop and maintain data transformation processes using Azure Synapse Analytics, optimizing performance and scalability.

- Build and deploy data models and data warehouses to support business intelligence and reporting needs, enabling stakeholders to access and analyze data effectively.

- Collaborate with data scientists to build and deploy machine learning models, providing the necessary data infrastructure and support.

- Monitor and troubleshoot data pipelines, ensuring data availability and reliability for downstream consumers.

- Implement data governance and security policies, protecting sensitive data and ensuring compliance with regulatory requirements.

Required Skillset :

- Demonstrated ability to design and implement data solutions on the Azure cloud platform, including Azure Data Lake Storage, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.

- Proven ability to write efficient and maintainable code in Python for data processing and automation tasks.

- Strong understanding of data warehousing concepts, data modeling techniques, and ETL processes.

- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

- Ability to analyze complex problems, identify root causes, and implement effective solutions.

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field

Key Skills

Education

Any Graduate