Description

You will engineer and manage data pipelines in a cloud environment.

Responsibilities

• Design efficient and scalable ETL workflows.
• Gather and process raw data at scale using scripting, APIs, and SQL.
• Develop data processing logic using Spark and Python.
• Manage and optimize job scheduling using Control-M.

Required Skills

• 10+ years of development experience in Azure, Databricks, Python, Spark, and Control-M.
• Proficiency in designing ETL workflows and understanding Data Warehouse concepts.
• Experience working with cloud computing environments.
• Strong ability to write SQL queries and process data at scale.
• Familiarity with Agile Development methodologies.
• Knowledge of Jira, Github, and Jenkins is required.

Key Skills

Education

Any Graduate