Description

Design, build, and manage scalable analytics infrastructure and data pipelines on AWS.

This role is remote.

Responsibilities

• Design, build, and deploy automated data pipelines to integrate complex datasets from various sources.
• Develop and maintain large-scale processing systems, databases, and software components.
• Implement operational improvements including automation of manual processes, data quality checks, and error recovery.
• Collaborate with developers, architects, and data scientists to ensure optimal data delivery architecture.
• Lead the design, testing, and deployment of technical components while providing peer review and direction to developers.

Required Skills

• Extensive experience with AWS and Python.
• Hands-on expertise with Kafka and Terraform.
• Experience managing Postgres, MySQL, or DocumentDB.
• Experience with stream processing application development using Kafka Streams or Flink APIs.
• Ability to establish both batch and real-time data feeds from systems of record.
• Strong understanding of data modeling, mining, and production processes.
• Any graduate degree.

Preferred Skills

• Experience with Flink, EMR, Hudi, AWS Redshift, ECS/EKS, or Glue Catalog.
• AWS Certified Solutions Architect Associate, Developer, or Data Engineering certification.

Key Skills

Education

Any graduate