Description

Lead the design and implementation of modern data platforms and pipelines.

This role is on-site.

Responsibilities

• Design and optimize ELT pipelines using Databricks (PySpark), Azure Data Factory, or Synapse.
• Build and manage data marts on Snowflake, leveraging Streams, Tasks, Clustering, and RBAC.
• Develop modular data models and transformations using dbt, managed via Dagster, Airflow, or Prefect.
• Implement automated data validation using Great Expectations or dbt tests to ensure production data quality.
• Manage infrastructure as code with Terraform or Bicep and deploy via GitHub Actions or Azure DevOps.

Required Skills

• 6+ years in Data Engineering with production-level Azure Databricks and PySpark.
• Hands-on experience with dbt for transformations and Dagster or similar tools for orchestration.
• Strong SQL and Python programming skills, emphasizing modularity and scalability.
• Experience deploying infrastructure as code (Terraform/Bicep) and managing CI/CD workflows.
• Proven ability to build data marts and analytics solutions on Snowflake.
• Proficiency in Git for version control and team collaboration.
• Experience with ELT pipelines, ADF, Synapse, GitHub Actions, and Azure DevOps.

Preferred Skills

• Familiarity with financial services use cases, such as capital markets or asset/wealth management.
• Experience leading Agile ceremonies and mentoring junior engineers.

Key Skills

Education

Any Graduate