Description

You will design, build, and manage distributed data streaming solutions using Apache Kafka and AWS infrastructure.

This role is remote.

Responsibilities

• Design and operate Kafka clusters, handling optimization, monitoring, and schema evolution.
• Implement data streams using MSK Connect and Kafka Connect with JDBC connectors for RDBMS integration.
• Deploy and manage cloud infrastructure across AWS services using Terraform.
• Build and maintain data processing pipelines using SQL and Python.
• Create functional documentation, process maps, and test plans within an Agile/Scrum environment.

Required Skills

• Minimum 10 years of IT experience, with at least 7 years in a data engineering context.
• Hands-on experience with AWS MSK (Amazon Managed Streaming for Apache Kafka).
• Deep knowledge of Apache Kafka internals, Schema Registry, and REST API.
• Proficiency with AWS services: EC2, ELB, RDS, Route53, S3, VPC, VPN, and TGW.
• Expertise in relational databases including Oracle, Postgres, and SQL Server.
• Strong experience with Terraform for infrastructure as code.
• Advanced SQL and Python skills for data processing and modeling.
• Strong understanding of data modeling and RDBMS database design.

Preferred Skills

• Bachelor’s Degree in Computer Science or Software Engineering.

Key Skills

Education

Any Graduate