Description

Big Data Engineer based in Singapore.

Responsibilities

• Design and build distributed ETL/ELT pipelines for large datasets (batch and/or near real-time).
• Develop and optimize data models using dimensional and warehouse patterns to enable self-serve analytics.
• Implement data quality controls, reconciliation checks, and monitoring/alerting for pipeline reliability.
• Build and maintain CI/CD for data pipelines, including testing, deployment, and rollback practices.
• Troubleshoot performance and data issues such as skew, partitioning, late data, and duplicates.

Required Skills

• 7+ years of experience in data engineering with hands-on Big Data exposure.
• Strong SQL skills, including window functions, tuning, and complex transformations.
• Hands-on experience with Spark and at least one ecosystem component (Hive/Hadoop) in production.
• Experience with data modeling and warehousing patterns (star schema, SCD, ETL design).
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree