Description

You will build and maintain data pipelines within the healthcare domain.

Responsibilities

• Design and implement data processing workflows using PySpark and Python.
• Manage data infrastructure and services within AWS environments.
• Develop and maintain streaming data pipelines using Kafka or Kinesis.
• Deploy and manage infrastructure as code using Terraform and Docker.
• Orchestrate complex data workflows using Airflow.

Required Skills

• 8+ years of professional data engineering experience.
• Mandatory experience working in the healthcare domain.
• Expertise in Python and PySpark.
• Hands-on experience with AWS services including Glue, Lambda, Athena, and EMR.
• Proficiency with Spark and Kafka or Kinesis.
• Strong command of SQL and NoSQL databases, specifically PostgreSQL, Redis, and Elasticsearch.
• Experience implementing CI/CD pipelines.
• Practical knowledge of Terraform and Docker.
• Experience with Airflow for orchestration.

Key Skills

Education

Any Graduate