Description

You will design and implement optimized architectures for batch and streaming data environments. You own the technical delivery of Azure Databricks projects, including data source migrations and configuration changes.

Responsibilities

• Propose optimized solutions for new and existing projects to reduce latency and costs.
• Monitor Azure and Databricks resources to suggest ideal configurations for current and future workloads.
• Create cost reports for existing Databricks sources.
• Collect customer requirements and lead offshore teams to project delivery.

Required Skills

• 5+ years of experience in data engineering or consulting roles.
• Expertise in Azure Databricks core functionality.
• Proficiency in Python and SQL.
• Experience with ETL processes and SSIS.
• Strong understanding of Azure administration and platform services.
• Ability to optimize batch and streaming environments for cost and performance.
• Experience leading technical delivery teams.

Preferred Skills

• Experience with cloud cost management and resource monitoring.

Key Skills

Education

ANY GRADUATE