Description

You will design, build, and maintain data pipelines and real-time streaming architectures.

This role is on-site.

Responsibilities

• Design and develop data pipelines using Java and Python.
• Implement real-time data streaming using Kafka and CDC processes.
• Manage scalable storage solutions and integration using S3.
• Optimize big data processing using Spark and SQL.
• Troubleshoot pipeline issues to ensure data quality and integrity.

Required Skills

• 4+ years of experience in data engineering and pipeline management.
• Strong development expertise in Java and Python.
• Hands-on experience with Kafka, S3, CDC, Spark, and SQL.
• Proficiency with container technologies like Docker.
• Experience handling large datasets in cloud environments.
• Solid understanding of data architecture and real-time processing.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate