Description

You will design and lead the delivery of large-scale distributed data systems and pipeline architectures.

This role is remote.

Responsibilities

• Design and maintain optimal data pipeline architectures to assemble complex datasets meeting business requirements.
• Manage end-to-end delivery by investigating problem areas and working cross-functionally with product managers and stakeholders.
• Lead teams in building and operating high-volume distributed systems within a SaaS environment.
• Drive optimization, testing, and tooling to improve solution quality and engineering velocity.
• Develop capacity and growth projection forecasts for the environment within established budgets.

Required Skills

• 12+ years of relevant technical experience.
• Expertise in Azure Cloud platform and orchestrating workloads on cloud.
• Strong hands-on experience with Databricks components.
• Deep technical knowledge of Data Warehousing and Data Lake at scale.
• Proficiency in PySpark and Python programming.
• Experience with Data Engineering, ETL, and Data Migration.
• Hands-on skills with SQL, ADF, ADLS, Synapse, and Azure SQL.
• Proven ability to manage large-scale projects including scheduling, resource management, and budgeting.
• Experience setting technical vision while balancing business drivers.

Preferred Skills

• Experience managing distributed teams.
• Proficiency with APIs, containerization, and orchestration.

Key Skills

Education

Any Gradute