Description

Lead the data engineering department to deliver scalable data solutions for internal and external stakeholders.

Responsibilities

• Design, develop, and operationalize data pipelines for ingestion, transformation, and extraction.
• Own the data platform, specifying and implementing technological enhancements and new components.
• Drive cloud migration activities, transitioning existing services into cloud-native Azure and/or AWS environments.
• Manage data extraction services, including ad-hoc, monthly, and quarterly requests in accordance with SLAs.
• Oversee data accessibility, security, quality, retention, and ethical handling of all datasets.

Required Skills

• Minimum 10 years of experience in product or software development.
• Minimum 5 years of experience working specifically with a data platform.
• Proficiency in SQL and Python with Pandas for data pipeline implementation.
• Strong experience with Hadoop, Spark, and Jupyter.
• Hands-on experience with cloud-native services, specifically Azure and/or AWS.
• Experience using ETL tools such as Talend or cloud-native alternatives.
• Proficiency in automation and monitoring tools, including Shell scripts and Airflow.
• Ability to implement reporting using a data platform or reporting software.
• Strong leadership and organizational skills to manage a technical team.

Preferred Skills

• Experience working within the financial industry.
• Knowledge of financial data such as CCRIS, SSM, Angkasa, or Idaman.

Key Skills

Education

Any Graduate