Description

Lead the development of big data platforms and define strategies for cloud-based data infrastructure.

This role is on-site.

Responsibilities

• Build and scale data platforms, pipelines, and transformation capabilities using the Apache suite and AWS.
• Develop and support batch and real-time data pipelines for medical data from diverse sources.
• Interface with technology teams to extract, transform, and load data using SQL, Python, and ETL processes.
• Conduct functional and non-functional testing by writing test scenarios and scripts.
• Evaluate existing applications to implement new features that meet business requirements.

Required Skills

• 8+ years of experience in database design, pipelining, and development.
• Proficiency in Spark, PySpark, Hive, and Airflow.
• Hands-on experience with AWS or other cloud platforms.
• Strong SQL skills, including writing complex queries, stored procedures, and views.
• Working knowledge of Snowflake and relational databases such as PostgreSQL or MySQL.
• Bachelor's degree in Computer Science, Mechanical Engineering, or equivalent relevant experience.

Preferred Skills

• Experience building big data platforms and understanding healthcare data.
• Familiarity with Talend and Tableau.

Key Skills

Education

Bachelor's degree in computer science,