Description

Own the design, development, and optimization of data pipelines and infrastructure on Azure. You will translate complex data lineage into clear insights for non-technical stakeholders while ensuring robust data modelling and query performance.

Responsibilities

• Build and maintain scalable data pipelines using Python, Pandas, NumPy, and PySpark.
• Design advanced data models and optimize complex SQL queries for performance.
• Deploy and manage data services across Azure, AWS (S3, Redshift), and GCP (BigQuery).
• Containerize applications using Docker for consistent deployment environments.
• Communicate technical infrastructure details and data lineage to non-technical audiences.

Required Skills

• 7+ years of total relevant experience in data engineering or similar roles.
• Strong Python programming skills with deep experience in Pandas, NumPy, and PySpark.
• Advanced SQL expertise including query optimization and database design.
• Hands-on experience with Azure cloud data services.
• Proficiency with AWS (S3, Redshift) and Google Cloud (BigQuery).
• Experience with Docker for containerization.
• Ability to explain technical concepts to non-technical stakeholders.

Key Skills

Education

Any Gradute