Description

Lead ETL development and data architecture within an Azure-based environment.

Responsibilities

• Design and implement data pipelines using Azure Data Factory and Azure Databricks.
• Develop scalable data solutions leveraging Spark, PySpark, and Lakehouse architectures.
• Manage source code and deployment workflows using GitLab or similar CI/CD tools.
• Ensure data integrity through rigorous audits, balance, and control mechanisms.
• Implement data security, governance, and compliance protocols across the platform.

Required Skills

• 7+ years of experience working with the Azure Data Platform and Azure Cloud.
• Expertise in SQL, PL/SQL, and advanced Data Warehousing concepts.
• Hands-on experience with Azure Databricks, PySpark, and Azure Data Factory.
• Proficiency in Python and ETL development.
• Strong understanding of Big Data Spark and Lakehouse architectures.
• Experience with SCM and CI/CD tools such as GitLab or GitHub.
• Experience managing data within Oracle or other relational databases.

Preferred Skills

• Experience with Snowflake.
• Knowledge of Object-Oriented Programming (OOP) concepts.
• Familiarity with Power BI, SQL Server, Teradata, or MySQL.

Key Skills

Education

Any Gradute