Description

You will design and maintain scalable data processing integrations and production-grade workflows.

Responsibilities

• Build, operate, and maintain fault-tolerant data processing integrations on AWS.
• Identify and resolve issues within large-scale production data workflows.
• Create and maintain unit tests and continuous integration pipelines.
• Manage multiple concurrent data engineering projects.
• Develop intelligent data pipelines to support customer requirements.

Required Skills

• 10+ years of experience as an enterprise Data Engineer, preferably from a consulting background.
• 3+ years of professional Python programming experience.
• Proven experience with Apache Airflow and Spark.
• Hands-on experience with MongoDB and MySQL.
• Experience building and operating data integrations within AWS.
• Software development experience including unit testing and CI.
• BS/MS degree in Computer Science or equivalent industry experience.
• Strong communication skills for working within a geographically distributed team.

Preferred Skills

• Experience using Docker or Kubernetes.

Key Skills

Education

BS/MS degree in Computer Science