Description

You will design, develop, and manage distributed data streaming solutions using Apache Kafka and AWS infrastructure.

Responsibilities

• Design and operate Kafka clusters, including cluster design, optimization, monitoring, and schema evolution.
• Implement and manage data streams using MSK Connect and Kafka Connect with JDBC connectors for RDBMS integration.
• Deploy and manage cloud infrastructure using Terraform across various AWS services.
• Build and maintain data processing pipelines using SQL and Python.
• Create functional documentation, process maps, and test plans within an Agile/Scrum environment.

Required Skills

• Minimum 10 years of IT experience with at least 7 years in a data engineering organization.
• Hands-on experience with AWS MSK (Amazon Managed Streaming for Apache Kafka).
• Deep knowledge of Apache Kafka internals, schema registry, and REST API.
• Proficiency with AWS services including EC2, ELB, RDS, Route53, S3, VPC, VPN, and TGW.
• Expertise in relational databases such as Oracle, Postgres, and SQL Server.
• Strong experience with Terraform for infrastructure as code.
• Advanced SQL and Python skills for data processing.
• Strong understanding of data modeling and RDBMS database design.

Preferred Skills

• Bachelor’s Degree in Computer Science or Software Engineering.

Key Skills

Education

Any Graduate