Description

Own the end-to-end data lifecycle, translating business requirements into robust architecture solutions while verifying designs from offshore teams.

Responsibilities

• Design, develop, and maintain master data pipelines for collecting, processing, and loading data from diverse sources.
• Architect effective data solutions including Data Warehouse, Data Lakehouse, and Data Mesh strategies.
• Verify and audit data designs produced by offshore engineering teams to ensure quality and alignment.
• Optimize data pipelines for performance, scalability, and reliability, identifying opportunities for automation.
• Implement CI/CD pipelines for data processes in collaboration with DevOps and Engineering teams.

Required Skills

• 5+ years of experience in data architecture and designing master data pipelines.
• Expertise in data modelling for Data Warehouses and Data Lakes.
• Proficiency in SQL for data manipulation and retrieval from relational databases.
• Strong scripting skills in Python and Unix/Shell for automating data transformations.
• Hands-on experience with ETL processes and data pipeline development.
• Experience with data processing frameworks such as Apache Spark or Apache Flink.
• Familiarity with CI/CD tools and practices for deployment and monitoring.
• Bachelor's degree in Computer Science, Information Technology, or a related field.

Preferred Skills

• Master's degree in a technical field.

Key Skills

Education

ANY GRADUATE