Description

Own the end-to-end data lifecycle, translating business requirements into architecture solutions and verifying offshore team designs.

This role is on-site.

Responsibilities

• Design and maintain master data pipelines for collecting, processing, and loading data from diverse sources.
• Architect data solutions including Data Warehouse, Data Lakehouse, and Data Mesh strategies.
• Verify and audit data designs produced by offshore engineering teams to ensure quality and alignment.
• Optimize data pipelines for performance, scalability, and reliability, identifying automation opportunities.
• Implement CI/CD pipelines for data processes in collaboration with DevOps and Engineering teams.

Required Skills

• 5+ years of experience in data architecture and designing master data pipelines.
• Expertise in data modelling for Data Warehouses and Data Lakes.
• Proficiency in SQL for data manipulation and retrieval from relational databases.
• Strong scripting skills in Python and Unix/Shell for automating data transformations.
• Hands-on experience with ETL processes and data pipeline development.
• Experience with data processing frameworks such as Apache Spark or Apache Flink.
• Familiarity with CI/CD tools and practices for deployment and monitoring.

Preferred Skills

• Master's degree in a technical field.

Key Skills

Education

ANY GRADUATE