Description

Design and maintain large-scale data processing pipelines using distributed systems and cloud platforms.

Responsibilities

• Develop scalable data ingestion, storage, transformation, and analysis solutions.
• Optimize existing pipelines to improve performance, scalability, and reliability.
• Monitor, troubleshoot, and resolve production issues to ensure continuous data flow and integrity.
• Collaborate with cross-functional teams to translate business requirements into technical data solutions.

Required Skills

• 5+ years of experience in Big Data engineering.
• Deep expertise in Hadoop, Spark, Hive, and Trino.
• Proficiency in Java, Scala, or Python for object-oriented programming.
• Strong SQL skills, including window functions, joins, and complex query optimization.
• Hands-on experience with AI development tools and AI workflow design.
• Bachelor's degree in Computer Science, Information Systems, or a related discipline.
• Experience with distributed systems and cloud platforms.

Preferred Skills

• Experience optimizing SQL code for high-performance environments.

Key Skills

Education

Any Graduate