Description

You will design, develop, and maintain data pipelines and processing systems on AWS, focusing on AWS DataHub and related services. You own the ETL workflows using AWS Glue and implement infrastructure as code with AWS CDK. You integrate real-time data streaming via Kafka and collaborate with cross-functional teams on data architecture. You optimize performance and ensure scalability for data platforms.

Responsibilities

• Design and maintain data pipelines and processing systems on AWS.
• Develop and manage ETL workflows using AWS Glue.
• Implement infrastructure as code using AWS CDK.
• Integrate and manage real-time data streaming using Kafka.

Required Skills

• Strong experience with AWS DataHub.
• Hands-on expertise with Kafka.
• Proficiency in AWS Glue for ETL development.
• Solid experience in AWS CDK.
• 5+ years of experience in data processing and data pipelines.
• Strong problem-solving and analytical skills.

Key Skills

Education

Any Gradute