Description

You will develop and integrate ML solutions focused on data management efficiencies and query optimization.

This role is on-site.

Responsibilities

• Collaborate with Data Scientists and developers to identify Big Data and query tuning opportunities using machine learning and generative AI.
• Design and develop scalable Big Data engineering solutions and generative AI applications.
• Write clean, high-performance, and maintainable code for backend applications.
• Create backend applications using Python, Docker, and Google Cloud to orchestrate end-to-end workflows.
• Implement prompt engineering techniques to fine-tune and enhance LLMs.

Required Skills

• 5+ years of experience as a Big Data or MLOps Engineer.
• Proficiency in Python, Spark, Spark SQL, and Hive SQL.
• Hands-on experience with BigQuery and SQL.
• Experience with Google Cloud, specifically tuning Dataproc and BigQuery applications.
• Experience building and deploying Generative AI applications.
• Practical knowledge of Docker for application orchestration.
• Solid understanding of software engineering best practices, Git, code reviews, and testing methodologies.

Preferred Skills

• Experience with in-house ML frameworks and prompt engineering for LLM enhancement.

Key Skills

Education

Any Graduate