Description

Design, implement, and maintain scalable Python applications and data pipelines on AWS. You own the release pipeline, testing strategy, and cloud infrastructure for data processing solutions.

Responsibilities

• Develop and optimize Python applications using Django or Flask.
• Build and manage data pipelines using PySpark, Spark SQL, Airflow, and Kafka.
• Implement CI/CD pipelines with Jenkins and manage AWS services including S3 and Databricks.
• Write and execute comprehensive tests using Pytest and PyUnit to ensure code quality.
• Design executable principles for scalable application architecture and cloud best practices.

Required Skills

• 5+ years of professional experience with Python programming.
• Expert proficiency in PySpark, Spark SQL, and related Spark APIs.
• Hands-on experience with AWS Cloud services (S3, Databricks, Data Lake Storage).
• Strong knowledge of Python testing frameworks such as Pytest and PyUnit.
• Experience with data pipeline tools including Airflow and Kafka.
• Familiarity with CI/CD tools and Jenkins.
• Bachelor’s degree in Computer Science, Information Technology, or a relevant field.

Preferred Skills

• Master’s degree in Computer Science or related field.
• Experience with Django or Flask web frameworks.

Key Skills

Education

bachelor’s degree in computer science