Description

You will build and optimize data pipelines and processing jobs within the Microsoft Azure ecosystem.

Responsibilities

• Develop complex and optimized queries for structured and semi-structured datasets.
• Build data pipelines using Azure Data Factory and Azure Databricks.
• Implement CI/CD pipelines using GitHub, Jenkins, or JGP.
• Integrate data flows between modern cloud platforms and legacy backend environments.
• Manage workflows using tools like Airflow, Crontab, or CA Workload Automation.

Required Skills

• 6+ years of experience in Data Engineering with a focus on big data processing.
• Proficiency in SQL and experience with relational databases like MS-SQL and Oracle.
• Hands-on experience with Azure Data Platform, including Azure SQL Database, ADLS, and Azure Databricks.
• Strong programming skills in Python, Scala, or Shell scripting.
• Experience working with NoSQL datasets and traditional DBMS environments.
• Practical knowledge of DevOps practices and CI/CD implementation.
• Ability to manage competing priorities and integrate business requirements with technical execution.

Preferred Skills

• Experience with workflow management tools such as Airflow.

Key Skills

Education

Any Graduate