Description

You will build scalable Big Data engineering solutions and generative AI applications, focusing on data management efficiencies and query optimization.

This role is on-site.

Responsibilities

• Collaborate with Data Scientists and developers to identify Big Data and query tuning opportunities using machine learning and generative AI.
• Build and orchestrate end-to-end applications using Python, Docker, Google Cloud, and internal ML frameworks.
• Design scalable Big Data engineering solutions and generative AI applications.
• Implement prompt engineering techniques to fine-tune LLMs for specific application needs.

Required Skills

• 5+ years of experience as a Big Data or MLOps Engineer.
• Proficiency in Python and Docker.
• Hands-on experience with Google Cloud, Spark, Spark SQL, and BigQuery.
• Proven expertise in tuning Dataproc, BigQuery, and Spark applications.
• Experience developing Generative AI applications.
• Solid understanding of software engineering best practices, including Git, code reviews, and testing.
• Background in using Hive SQL for query optimization.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate