Description

You will build and maintain scalable data applications using Python and the Spark ecosystem.

This role is on-site.

Responsibilities

• Design and implement scalable AWS data architectures and solutions.
• Develop robust data pipelines using Airflow, Kafka, and Jenkins.
• Build and manage CI/CD pipelines to support continuous deployment.
• Test and debug applications using Pytest and PyUnit frameworks.
• Collaborate with cross-functional teams to implement executable design principles.

Required Skills

• 5+ years of professional experience in software or data engineering.
• Expert proficiency in Python programming.
• Deep experience with PySpark, including Spark SQL and Spark APIs.
• Hands-on experience with AWS services: S3, Databricks, and Data Lake Storage.
• Proficiency with Python web frameworks such as Django or Flask.
• Strong understanding of cloud architecture patterns and best practices.
• Bachelor’s degree in Computer Science, IT, or a related field.

Preferred Skills

• Master's degree in a relevant technical field.

Key Skills

Education

Any Graduate