Description

You will design and implement scalable data engineering solutions and AI workflows.

This role is on-site.

Responsibilities

• Architect end-to-end data pipelines using Python, PySpark, and Databricks across AWS, Azure, or GCP.
• Develop and integrate NLP and LLM-based solutions, including prompt engineering and AI workflows.
• Build and maintain CI/CD pipelines using Jenkins, Git, and Airflow.
• Manage data storage and processing using Snowflake, MS SQL, and NoSQL databases.
• Monitor data quality and drive automation to optimize engineering workflows.

Required Skills

• Strong experience in Python, PySpark, and Databricks.
• Hands-on expertise in cloud platforms (AWS, Azure, or GCP).
• Experience in NLP, LLMs, prompt engineering, and tools such as OpenAI and LangChain.
• Knowledge of data pipeline orchestration tools like Airflow.
• Experience with CI/CD tools such as Jenkins and version control systems like Git.
• Familiarity with NoSQL databases and distributed data systems.
• Understanding of DevOps practices and automation.

Preferred Skills

• Exposure to healthcare data domains.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Key Skills

Education

Any Graduate