Description

Key Responsibilities

 Design, develop, and maintain scalable ETL/ELT pipelines

using Azure Data Factory (ADF).

 Build and optimize data transformation processes

using Azure Databricks and PySpark.

 Perform end-to-end data migration activities from legacy

systems to Azure-based data lakes and data warehouses.

 Analyze source-to-target mappings and implement complex

business transformation logic.

 Develop reusable data ingestion frameworks and automation

solutions.

 Write efficient and optimized SQL queries, stored procedures,

and performance tuning solutions.Implement data validation,

reconciliation, and data quality checks during migration

activities.

 Collaborate with Business Analysts, Architects, QA teams,

and stakeholders to understand data requirements.Support

deployment, release management, and CI/CD processes

using Azure DevOps.

 Troubleshoot production issues and provide timely

resolutions.

 Participate in code reviews and ensure adherence to

development best practices.

 Create and maintain technical documentation, migration

runbooks, and deployment guides.Support Agile ceremonies

including Sprint Planning, Daily Scrum, Retrospectives, and

Release activities.

Required Technical Skills

Must Have

Azure Data Factory (ADF)

Azure Databricks

 PySpark

 SQL Server / DB2 / Relational Databases

 Python

 Azure DevOps

 ETL/ELT Development

 Data Migration & Data Integration

 Source-to-Target Mapping

 Data Validation and Reconciliation

 CI/CD Pipelines

 Medallion Architecture (Bronze, Silver, Gold)

Key Competencies

 Strong analytical and problem-solving skills.

 Excellent communication and stakeholder management

skills.

 Ability to work in Agile/Scrum environments.

 Ownership mindset and proactive approach to delivery.

 Ability to mentor junior team members and drive technical

excellence

Key Skills

Education

Bachelor's degree