Description

You will design, build, and maintain scalable data pipelines and infrastructure on Azure.

This role is hybrid.

Responsibilities

• Develop and optimize ETL pipelines using Azure Data Factory and Databricks for data ingestion and migration.
• Implement robust data solutions using PySpark, Python, and SQL within distributed computing environments.
• Manage and query data across structured (Postgres) and NoSQL (MongoDB) databases.
• Collaborate with Data Scientists and stakeholders to define data requirements and deliver analytical solutions.

Required Skills

• 10+ years of experience in data engineering or related technical roles.
• Expert-level proficiency in Azure Data Factory and Databricks.
• Strong coding skills in Python, PySpark, and SQL.
• Hands-on experience with Hive for data warehousing and analysis.
• Practical knowledge of Postgres and MongoDB for data storage and retrieval.
• Familiarity with containerization (Docker, Kubernetes) and orchestration technologies.

Preferred Skills

• Experience with shell scripting in Bash, Unix, or Windows environments.
• Ability to translate complex business challenges into technical information solutions.

Key Skills

Education

Any Graduate