Description

You will lead the design and development of cloud-native applications and services using modern architecture patterns.

Responsibilities

• Design and develop cloud-native applications and services using modern architecture patterns.
• Build data pipelines leveraging Azure Databricks, Python, and PySpark.
• Orchestrate end-to-end design and build processes for Near-Real Time and Batch Data Pipelines.
• Lead the migration of existing applications to cloud environments, ensuring minimal disruption.
• Provide technical assistance, problem resolution, and troubleshooting support.

Required Skills

• 14+ years of Azure and Data Engineering experience.
• Strong hands-on experience with Azure Databricks and Azure Data Factory (ADF).
• Proficiency in Python, PySpark, and Spark SQL.
• Experience designing ETL processes and data pipelines within Azure Data Lake Gen 2 and Synapse Analytics.
• Knowledge of data security implementation, encryption, and PII/PSI legislation compliance.
• Experience with scripting languages such as Shell Scripting.
• In-depth understanding of various Azure storage services.
• Minimum 3 years of real project experience.

Key Skills

Education

Any Graduate