Description

You will build and maintain data processing infrastructure and pipelines using Spark and Python in Columbus, OH.

Responsibilities

• Build and manage data pipelines using Spark.
• Develop data processing infrastructure within AWS environments.
• Implement infrastructure as code using Terraform.
• Maintain production data using ACID compliant formats like Hudi, Iceberg, or Delta Lake.

Required Skills

• 8+ years of experience in data engineering roles.
• Proficiency in Python and SQL.
• Extensive experience building data pipelines with Spark.
• Hands-on experience with AWS.
• Experience with NoSQL and relational datastores.
• Experience with cloud object stores.
• Proficiency with Terraform for infrastructure as code.
• Production experience with ACID compliant formats (Hudi, Iceberg, or Delta Lake).
• Cloud certification.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate