Description

Design and implement optimized architectures for batch and streaming data environments while owning technical delivery of Azure Databricks projects.

This role is on-site.

Responsibilities

• Propose optimized solutions for new and existing projects to reduce latency and costs.
• Monitor Azure and Databricks resources to suggest ideal configurations for current and future workloads.
• Create cost reports for existing Databricks sources.
• Collect customer requirements and lead offshore teams to project delivery.

Required Skills

• 5+ years of experience in data engineering or consulting roles.
• Expertise in Azure Databricks core functionality.
• Proficiency in Python and SQL.
• Experience with ETL processes and SSIS.
• Strong understanding of Azure administration and platform services.
• Ability to optimize batch and streaming environments for cost and performance.
• Experience leading technical delivery teams.

Preferred Skills

• Experience with cloud cost management and resource monitoring.

Key Skills

Education

ANY GRADUATE