Description

You design, build, and maintain scalable data pipelines and architectures on the Azure cloud platform.

Responsibilities

• Design, develop, and optimize end-to-end data pipelines and ETL/ELT processes using Azure Data services.
• Build scalable data solutions using Azure Databricks, PySpark, and Snowflake for batch and real-time workloads.
• Develop and maintain data models and schemas in Postgres and MongoDB.
• Write efficient, reusable code in Python and SQL to transform and load data.
• Collaborate with data scientists, analysts, and business users to gather requirements and deliver solutions.

Required Skills

• 5+ years of professional experience in data engineering.
• Expert proficiency in Python and SQL.
• Hands-on experience with PySpark and Databricks.
• Experience modeling data in Postgres and MongoDB.
• Experience managing data warehousing solutions in Snowflake.
• Familiarity with designing and maintaining Azure data architectures.
• Ability to monitor pipeline performance and ensure data quality.

Key Skills

Education

Any Graduate