Description

Key Responsibilities
Design, develop, and maintain scalable data pipelines for batch and streaming workloads.
Build and optimize data processing solutions using Apache Spark.
Develop real-time data processing applications using Apache Flink.
Leverage AWS services to build, deploy, and manage data engineering solutions.
Develop robust and maintainable data processing applications using Python.
Monitor, troubleshoot, and optimise data pipelines for performance, reliability, and scalability.
Collaborate with data scientists, software engineers, and other stakeholders to deliver data-driven solutions.
Ensure data quality, consistency, and availability across batch and streaming environments

Key Skills

Education

Bachelor's degree