Description

Design and maintain enterprise data architectures, including warehouses, lakes, and lakehouse environments, while building scalable batch and streaming pipelines.

This role is on-site.

Responsibilities

• Architect data models using dimensional modeling, Data Vault 2.0, or similar methodologies.
• Build and maintain batch and streaming data pipelines with full observability, alerting, and change data capture.
• Implement data governance frameworks, including cataloging, lineage tracking, and automated quality checks.
• Administer cloud data platforms, optimizing storage, compute, and cost efficiency using infrastructure-as-code.
• Define data contracts between producers and consumers, collaborating with analytics and BI teams.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency with Databricks and PySpark for large-scale data processing.
• Strong SQL skills for data manipulation and querying.
• Experience with Azure Data Factory (ADF) for pipeline orchestration.
• Knowledge of data governance, metadata management, and schema design.
• Understanding of ELT/ETL patterns and real-time ingestion frameworks.

Preferred Skills

• Bachelor's degree in Computer Science, Engineering, or related field.
• Experience with Data Vault 2.0 implementation.
• Familiarity with master data management standards and business glossaries.

Key Skills

Education

Bachelor's degree