Description

You will design, develop, and maintain scalable data pipelines in Snowflake for healthcare claims, contract configuration, and fee-for-service reimbursement logic.

Responsibilities

• Build and optimize ELT processes using Snowflake SQL, stored procedures, and dynamic SQL for complex healthcare datasets.
• Develop and maintain Apache Airflow DAGs on AWS MWAA for pipeline orchestration, scheduling, and monitoring.
• Write clean, testable Python scripts for data transformation, validation, web scraping automation, and API integrations.
• Implement CI/CD workflows using Bitbucket Pipelines and Liquibase for database migration and schema change management.
• Support data quality and governance processes, including Snowflake role-based access control and dynamic data masking.

Required Skills

• 5+ years of hands-on data engineering experience.
• Proficiency in Snowflake: ELT pipeline development, stored procedures, query optimization, and data modeling (star, snowflake, hybrid schemas).
• Strong SQL skills, including complex joins, window functions, CTEs, and dynamic SQL generation.
• Solid Python experience in a data engineering context (Pandas, file processing, API clients, web scraping with BeautifulSoup or Scrapy).
• Experience with Apache Airflow for pipeline orchestration (AWS Managed Workflows for Apache Airflow preferred).
• Hands-on experience with AWS services: S3, Lambda, SNS, CloudWatch, IAM.
• Proficiency with Git-based version control and CI/CD pipelines (Bitbucket Pipelines preferred).
• Experience with database migration tooling (Liquibase preferred).

Key Skills

Education

Bachelor's degree