Description

You will support large-scale data pipelines in a distributed, scalable AWS environment. You will lead the design and development of batch and streaming data applications while optimizing production infrastructure.

Responsibilities

• Design and develop batch and streaming data applications using AWS services.
• Optimize production AWS environments for data infrastructure and frameworks.
• Provide technical direction and guide the team in resolving complex issues.
• Partner with development teams to deliver technical solutions.
• Troubleshoot problems under pressure and maintain system stability.

Required Skills

• 8+ years of experience in IT or Software Engineering.
• Hands-on experience with AWS services including Airflow, Glue, and Lambda.
• Proficiency with Big Data technologies, specifically Spark and PySpark.
• Strong programming skills in Python.
• Experience with SQL and Linux environments.
• Proficiency in Bash scripting.
• Bachelor's degree in Computer Science or 4 years of relevant work experience.
• Proven leadership experience with the ability to provide technical direction.

Key Skills

Education

Bachelor's degree in Computer Science