Description

You will design and implement scalable data architectures and pipelines within the Azure ecosystem.

This role is remote.

Responsibilities

• Architect scalable data pipelines and manage data replication into Azure cloud environments.
• Build dimensional data models and design complex ETL processes for large-scale heterogeneous data warehouses.
• Coordinate with ML teams to promote models to governed production environments via DataOps and MLOps.
• Optimize and tune ETL performance for high-volume data processing jobs.
• Collaborate with onshore and offshore cross-functional teams to deliver concurrent projects.

Required Skills

• 12+ years of experience in Data Engineering and Data Modelling.
• Hands-on expertise with Azure, ADF, and Databricks (PySpark).
• Proficiency in Python, SQL, and Unix Shell scripting.
• Experience with Snowflake Data Warehouse.
• Hands-on experience with ETL tools including Matillion, Qlik, or DataStage.
• Knowledge of Oracle, IBM DB2, SAP HANA, and ERP systems (SAP and JDEx).
• Experience handling large-scale data ingestion and complex data warehouse environments.

Preferred Skills

• Experience working with ML teams to support production stability through AMS.

Key Skills

Education

Any Graduate