Description

Design and implement scalable data solutions on AWS, focusing on PySpark applications, data modeling, and LLM optimization.

This role is on-site.

Responsibilities

• Design and implement secure, cost-efficient data solutions on AWS.
• Develop and deploy PySpark applications to extract, transform, and aggregate data.
• Pretrain, fine-tune, and optimize large language models (LLMs) and implement RAG/augmentation strategies.
• Build and maintain data models to deliver data-driven business insights.
• Automate data preparation tasks through scripting and workflow tooling.

Required Skills

• 15+ years of experience in data engineering or cloud architecture.
• Hands-on production-level experience with Databricks on AWS.
• Proficiency in PySpark and Python, including Pandas, Scikit-learn, and Matplotlib.
• Strong SQL skills and experience with varied data formats and sources.
• Experience with ETL tools, such as Informatica.
• Proven track record in cloud data migration from on-premises to AWS.
• Experience in data modeling and data architecture design.

Preferred Skills

• Experience consolidating and ensuring integrity of data from diverse internal sources.
• Ability to maintain clear documentation of data workflows and coding standards.

Key Skills

Education

Bachelor's degree