Description

You will design and implement generative AI solutions, leveraging large language models and complex data pipelines to drive intelligent applications.

This role is hybrid.

Responsibilities

• Build and maintain ETL pipelines using PySpark, Databricks, and Kafka for efficient data processing.
• Develop AI integrations using LLMs, LangChain, and prompt engineering techniques.
• Implement complex SQL transformations, data validation, and performance tuning.
• Create data visualizations and reports using Tableau or Power BI.
• Deploy and manage cloud infrastructure on AWS or Azure services.

Required Skills

• 8+ years of experience in software engineering or data engineering.
• Expert-level proficiency in Python and SQL.
• Hands-on experience with PySpark and Databricks for big data processing.
• Strong knowledge of AWS or Azure services (S3, EC2, Redshift, EMR).
• Experience with streaming data tools like Kafka and libraries like Pandas.
• Proficiency in data visualization tools such as Tableau or Power BI.
• Hands-on experience with ETL pipeline development.
• Understanding of Large Language Models (LLM) and AI integrations.

Preferred Skills

• Bachelor's degree in Computer Science or related field.
• Experience with prompt engineering and LLM fine-tuning.

Key Skills

Education

Bachelor's degree