Description

You will design, implement, and maintain scalable data solutions and AWS cloud architectures.

Responsibilities

• Design and implement executable design principles for scalable applications.
• Build and maintain data pipelines using Airflow, Kafka, and Jenkins.
• Develop and test applications using Python testing frameworks.
• Manage and deploy solutions within AWS environments and CI/CD pipelines.
• Collaborate with cross-functional teams to solve complex analytical problems.

Required Skills

• 5+ years of professional experience in software or data engineering.
• Expert proficiency in Python programming.
• Expert proficiency in PySpark, including Spark SQL and Spark APIs.
• Hands-on experience with AWS services including S3 and Databricks.
• Experience with data pipeline tools such as Airflow and Kafka.
• Proficiency in testing and debugging with Pytest or PyUnit.
• Experience with Python frameworks like Django or Flask.
• Working knowledge of CI/CD pipelines and Jenkins.
• Bachelor’s degree in Computer Science, IT, or a relevant field.

Preferred Skills

• Master's degree in a technical field.

Key Skills

Education

Bachelor's or Master's degrees