Description

You will lead the design, development, and implementation of scalable data infrastructure, pipelines, warehouses, and lakes.

Responsibilities

• Design and implement Kafka connectors and partitioned topics to sync source data to destination marts.
• Develop real-time data transformations and monitoring using Apache Flink.
• Migrate on-premises ETL jobs from PHP to AWS Flink and Glue.
• Maintain CI/CD pipelines using infrastructure-as-code and manage schema registries for data governance.
• Build dashboards in Datadog and CloudWatch to monitor system health and resolve disruptions.

Required Skills

• 6+ years of experience working with professional scrum teams.
• 4+ years of experience using Git version control.
• 3+ years of experience designing and indexing relational databases.
• 2+ years of experience building and operationalizing real-time data streams.
• Proficiency with Apache Kafka, Debezium, and Apache Flink (including PyFlink).
• Strong experience with AWS services including Kinesis, CDK, Terraform, Athena, Glue, and Lambda.
• Experience with Python, MySQL, Docker, and JavaScript.
• Experience building data APIs and providing Data as a Service.
• Ability to work PST hours (8:00 AM - 5:00 PM or 9:00 AM - 6:00 PM).
• Basic understanding of genomic concepts and terminology.

Preferred Skills

• AWS Associate Solution Architect or AWS Data Engineer certification.
• Knowledge of PHP MVC frameworks like Symfony.

Key Skills

Education

Any Graduate