Description

You will design, develop, and maintain scalable data pipelines for ingestion and processing within an AWS environment.

Responsibilities

• Design and maintain scalable data pipelines using Python, Spark, and AWS services.
• Implement ETL processes for batch and streaming data using AWS Glue and EMR.
• Develop data storage solutions utilizing Medallion Architecture in S3 and Redshift.
• Lead the integration of Qlik Sense and QlikView dashboards and data models into AWS platforms.
• Monitor and optimize data workflows using Airflow and other orchestration tools.
• Ensure data quality and integrity throughout the entire data lifecycle.
• Deploy data pipelines using CI/CD practices.

Required Skills

• 8-10 years of professional experience.
• 8+ years of software engineering and architecture experience.
• 4+ years leading cloud-native AWS solutions.
• Expertise in AWS services: EC2, Lambda, S3, RDS, Redshift, Glue, Step Functions, IAM, and CloudFormation/Terraform.
• Strong programming skills in Python and Java.
• Experience with Spark and ETL development.
• Experience with Qlik Sense and QlikView.
• Proven leadership in delivering healthcare-related platforms, specifically 340B pricing programs and Managed Care workflows.
• Proficiency with monitoring and logging tools like CloudWatch or Datadog.

Key Skills

Education

Not specified