Description

You will design and manage scalable data platforms that enable advanced analytics, Machine Learning, and Generative AI solutions.

This role is remote.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines for structured and unstructured data.
• Build and optimize data lakes, data warehouses, and AI-ready data platforms.
• Develop ingestion, transformation, and orchestration frameworks using cloud-native technologies.
• Prepare, cleanse, and engineer datasets for AI/ML and Generative AI workloads.
• Integrate LLMs, vector databases, embeddings, and RAG pipelines into enterprise solutions.

Required Skills

• 15+ years of experience in data engineering.
• Strong proficiency in Python, SQL, and PySpark.
• Hands-on experience with Apache Spark and Databricks.
• Expertise in building ETL/ELT pipelines.
• Experience with Generative AI, LLMs, and RAG architecture.
• Understanding of AI/ML fundamentals and data preparation.
• Experience with vector databases (Pinecone, ChromaDB, FAISS).
• Knowledge of data modeling (Star/Snowflake schemas) and data warehousing.

Preferred Skills

• Retail domain experience.
• Familiarity with orchestration tools like Airflow, Dataflow, or ADF.

Key Skills

Education

Any Graduate