Description

You design, implement, and maintain scalable data solutions using Python and PySpark.

This role is on-site.

Responsibilities

• Design and maintain scalable applications following executable design principles.
• Build and manage data pipelines using Airflow, Kafka, and Jenkins.
• Implement and manage AWS solutions across S3, Databricks, and Data Lake Storage.
• Develop and test applications using Pytest, PyUnit, or similar Python testing frameworks.
• Collaborate with cross-functional teams to deliver cloud-based architecture patterns.

Required Skills

• 5+ years of experience in software or data engineering.
• Expert proficiency in Python programming.
• Expert proficiency in PySpark, including Spark SQL and Spark APIs.
• Experience with AWS cloud services including S3, Databricks, and Data Lake Storage.
• Experience with Django or Flask frameworks.
• Experience with CI/CD pipelines and tools.
• Experience with data pipeline tools such as Airflow and Kafka.
• Strong knowledge of cloud architecture patterns and best practices.
• Bachelor’s degree in Computer Science, Information Technology, or a relevant field.

Preferred Skills

• Master's degree in a relevant technical field.

Key Skills

Education

bachelor’s degree in computer science