Description

You will design, develop, and manage large-scale data streams and messaging systems within distributed computing environments.

Responsibilities

• Design and operate Kafka clusters, including optimization, monitoring, and schema registry management.
• Implement data integrations using MSK Connect and Kafka Connect with JDBC connectors for RDBMS.
• Build and maintain data processing pipelines using Python and SQL.
• Deploy and manage cloud infrastructure using Terraform and AWS services.
• Troubleshoot Kafka internals and maintain distributed system stability.

Required Skills

• 10+ years of IT experience with at least 7 years in data engineering.
• Extensive experience with Apache Kafka, cluster design, and stream processing.
• Hands-on experience with AWS MSK (Amazon Managed Streaming for Apache Kafka).
• Proficiency in AWS services including EC2, ELB, RDS, Route53, S3, VPC, VPN, and TGW.
• Strong skills in SQL and Python for data processing.
• Experience with relational databases such as Oracle, Postgres, and SQL Server.
• Hands-on experience with Terraform for infrastructure as code.
• Knowledge of Data Modeling and RDBMS database design.
• Experience working within Agile/Scrum development processes.
• Bachelor’s Degree in Computer Science or Software Engineering.

Preferred Skills

• Experience with Java, Spring, and RabbitMQ.

Key Skills

Education

Any Gradute