Description

You will design, develop, and maintain scalable data pipelines for ingestion and processing within an AWS environment.

This role is on-site.

Responsibilities

• Design and maintain scalable data pipelines using Python, Spark, and AWS services.
• Implement ETL processes for batch and streaming data using AWS Glue and EMR.
• Develop data storage solutions utilizing Medallion Architecture in S3 and Redshift.
• Lead the integration of Qlik Sense and QlikView dashboards and data models into AWS platforms.
• Monitor, optimize, and ensure data quality using Airflow, CloudWatch, and CI/CD practices.

Required Skills

• 8-10 years of professional software engineering and architecture experience.
• 4+ years leading cloud-native AWS solutions.
• Expertise in AWS services: EC2, Lambda, S3, RDS, Redshift, Glue, Step Functions, IAM, and CloudFormation/Terraform.
• Strong programming skills in Python and Java.
• Experience with Spark and ETL development.
• Experience with Qlik Sense and QlikView.
• Proficiency with monitoring and logging tools like CloudWatch or Datadog.
• Proven leadership in delivering healthcare-related platforms, specifically 340B pricing programs and Managed Care workflows.

Preferred Skills

• Experience with Airflow and other orchestration tools.

Key Skills

Education

Not specified