Description

You will build and maintain scalable data engineering solutions for GenAI, RAG, and LLM-based AI Agent applications. This role focuses on distributed data processing and cloud-based integrations.

Responsibilities

• Design and optimize large-scale data pipelines using Python, SQL, and Apache Spark on AWS.
• Develop distributed data-processing solutions for structured and unstructured data environments.
• Implement data workflows supporting Retrieval-Augmented Generation (RAG) and LLM-based AI Agents.
• Optimize complex SQL queries for data extraction, transformation, and analysis.
• Troubleshoot pipeline performance, reliability, and system-integration issues.

Required Skills

• 5+ years of experience as a Data Engineer or Big Data Engineer.
• Strong hands-on programming with Python and SQL.
• Experience using Python or Scala for Big Data and distributed processing.
• Hands-on expertise with Apache Spark.
• Experience with Hadoop, Hive, and Trino.
• Strong experience with AWS Cloud.
• Experience supporting Generative AI applications and RAG solutions.

Preferred Skills

• Experience building scalable data platforms for AI, GenAI, and LLM-based agents.
• Experience integrating Data Engineering pipelines with AI and Machine Learning applications.

Key Skills

Education

Bachelor's degree