Description
You will lead the design and development of large-scale data pipelines and architectures, ensuring technical quality and alignment with business requirements.
This role is on-site.
Responsibilities
- Design, construct, and test data architectures that handle large-scale datasets.
- Lead the development of data pipelines enabling predictive and prescriptive analytics.
- Provide technical leadership for data projects, enforcing best practices and high-quality solutions.
- Collaborate with product, finance, and business units to ensure pipelines meet specific requirements.
- Align data architecture with Healthfirst solution architecture.
Required Skills
- 10+ years of experience in Data Engineering.
- Strong proficiency in Python scripting and Spark for data processing.
- Expert-level SQL skills for big data processing.
- Experience with AWS cloud platform and data services (S3, Redshift, Lambda, EMR, Airflow, Glue).
- Strong understanding of BASH/Shell scripting.
- Experience leading data engineering teams in Agile environments.
- Healthcare insurance domain expertise.
Preferred Skills
- Experience with Kinesis.
- Excellent problem-solving skills and attention to detail.