Description
You will build and manage data pipelines within a healthcare context.
Responsibilities
- Develop and maintain data pipelines using SQL, Python, and Spark.
- Orchestrate data workflows using Airflow, ADF, or Databricks.
- Implement API development solutions using Python.
- Integrate AI and ML capabilities including Gen AI, Prompt Engineering, RAG, and MLOps.
- Manage data across GCP, Azure, AWS, and Snowflake environments.
Required Skills
- 5+ years of experience in Data Engineering.
- Mandatory experience working in the healthcare industry.
- Proficiency in SQL and Python.
- Hands-on experience with Spark.
- Experience with cloud platforms: GCP, Azure, and AWS.
- Working knowledge of Snowflake.
- Experience with orchestration tools: Airflow, ADF, or Databricks.
- Experience with API development using Python.
- Practical knowledge of Gen AI, Prompt Engineering, RAG, and MLOps.
- Any Graduate degree.