Description

You will design and implement end-to-end, scalable data architectures using the Azure Databricks platform.

Responsibilities

• Architect end-to-end data solutions aligned with technical constraints and business requirements.
• Lead the implementation of data pipelines, ETL/ELT processes, and data transformation tasks.
• Optimize data workflows and perform performance tuning within Azure Databricks.
• Integrate Databricks with Azure Data Lake, Azure Synapse Analytics, and Azure Machine Learning.
• Provide technical leadership, conduct code reviews, and mentor development teams.

Required Skills

• 12+ years of total professional experience.
• 5+ years in data architecture or data engineering roles.
• Extensive experience with Azure Databricks and Apache Spark.
• Proficiency in Azure Data Lake, Azure Synapse Analytics, and Azure Data Factory.
• Strong command of Python, Scala, or Java.
• Expertise in SQL and NoSQL databases.
• Deep understanding of ETL/ELT processes and data warehousing principles.
• Proven track record of implementing large-scale cloud data solutions on Azure.
• Ability to troubleshoot and resolve complex technical issues related to data processing.

Preferred Skills

• Experience with machine learning and AI integration in data pipelines.
• Microsoft Certified: Azure Solutions Architect Expert or Azure Data Engineer Associate.
• Databricks Certified Associate Developer for Apache Spark.

Key Skills

Education

Any Graduate