Description

You will design and implement scalable, secure cloud data architectures on Microsoft Azure.

Responsibilities

• Design large-scale data processing and analytics solutions using Azure Databricks and Apache Spark.
• Lead the architecture and implementation of Data Mesh and Data Product solutions within Databricks environments.
• Develop technical blueprints, documentation, and CI/CD pipelines using Azure DevOps.
• Collaborate with stakeholders to translate business requirements into technical data architectures.
• Optimize Azure cloud resources for performance, cost, and reliability while maintaining security standards.

Required Skills

• 10+ years of experience in data engineering or a related field.
• Extensive experience with Azure Databricks and Apache Spark.
• Proficiency in Python and SQL.
• Deep knowledge of Microsoft Azure cloud services.
• Experience with data warehousing solutions including Delta Lake and Lakehouse architectures.
• Proven ability to design and implement CI/CD pipelines via Azure DevOps.
• Strong understanding of data governance, encryption, identity management, and network security.
• Experience working with relational databases.
• Bachelor's degree in Computer Science, Engineering, or a related field.

Key Skills

Education

Any Graduate