Description

You will own the design and architecture of the Data Platform and associated data engineering activities.

Responsibilities

• Design and architect the Data Platform, including ingestion frameworks for batch and micro-batch processing.
• Define end-to-end data architecture frameworks and manage data contracts, DQ, metadata, and lineage.
• Analyze existing data pipelines to define integration points and design patterns for the data factory.
• Assess data sources, cataloging needs, and data management requirements, including quality and accessibility.
• Implement Command Query Responsibility Segregation (CQRS) patterns within data solutions.

Required Skills

• 5+ years of experience in data architecture and engineering.
• Strong experience with the AWS Data stack (S3, Lambda, Glue, Redshift).
• Proficiency in Scala, Python, and SQL.
• Expertise in designing data models (Logical/Physical), understanding 3NF, Data Vault, and Star Schemas.
• Strong hands-on experience with streaming/EDA tools like Kafka and AWS MSK/Kinesis.
• Experience with Infrastructure as Code (Terraform) and CI/CD pipelines (Jenkins/Gitlab).
• Good understanding of data governance, including retention, lineage, and access controls.
• Familiarity with security aspects like encryption and tokenisation.
• Knowledge of observability tools such as Prometheus, Grafana, or CloudWatch.

Key Skills

Education

Any Gradute