Description
Essential Responsibilities
- Understand the overall requirement & design of the Project engaged
- Work closely with tech leads in India & US to understand the existing data pipeline developed in Databricks,Pyspark & GCP
- Own development and enhancement work in the data pipeline (Databricks) and provide regular updates to leads
- Collaborate closely with product managers, data engineers, and stakeholders to translate business requirements into technical solution.
The experience we are looking to add to our team
Required
- Bachelor’s degree or higher from a reputed university
- 3 to 6 years total experience with majority of that experience related to ETL experience with Strong Hands on experience in PySpark & Databricks
- Good hands-on experience in any Cloud Data platform, GCP is preferred.
- Experience in processing streaming data using Kafka / Pub-Sub
- Experience designing and deploying data pipelines orchestration using Apache Airflow.
- Healthcare industry experience
Good to have
- Healthcare industry experience
- Extensive experience in GCP associated Data services