Description

You will engineer and manage scalable data pipelines and ETL workflows in a cloud environment. This role is hybrid.

Responsibilities

• Design and implement efficient ETL workflows using Azure and Databricks.
• Develop data processing logic using Spark and Python to handle raw data at scale.
• Manage and optimize job scheduling and orchestration using Control-M.
• Gather and process data using scripting, APIs, and SQL.
• Apply Agile methodologies using Jira, Github, and Jenkins for development workflows.

Required Skills

• 10+ years of development experience in Azure, Databricks, Python, Spark, and Control-M.
• Proficiency in designing ETL workflows and understanding Data Warehouse concepts.
• Strong ability to write complex SQL queries and process data at scale.
• Experience working with cloud computing environments.
• Familiarity with Agile Development methodologies.
• Hands-on experience with Jira, Github, and Jenkins.

Key Skills

Education

Any Graduate