Description

You will build and maintain scalable data applications using Python and PySpark on AWS.

This role is on-site.

Responsibilities

• Design and implement scalable AWS architecture patterns.
• Develop data pipelines using Airflow, Kafka, and Jenkins.
• Build and test applications using Pytest and PyUnit frameworks.
• Manage continuous integration and deployment (CI/CD) pipelines.
• Cross-functional collaboration to solve analytical problems.

Required Skills

• 10+ years of software development experience.
• Expert proficiency in Python programming.
• Expert proficiency in PySpark, Spark SQL, and Spark APIs.
• Hands-on experience with AWS services: S3, Databricks, Data Lake Storage.
• Experience with Django or Flask.
• Proficiency with Pytest and PyUnit.
• Experience with Airflow and Kafka.
• Experience with Jenkins and CI/CD workflows.
• Bachelor's degree in Computer Science or related field.

Preferred Skills

• Master's degree in a relevant technical field.

Key Skills

Education

Bachelor's or Master's degrees