Description

You will own the development and maintenance of Big Data applications using Python, Spark, and PySpark.

Responsibilities

• Design, develop, and test Python applications focused on Spark and PySpark for Big Data processing.
• Collaborate with architects to design and implement technical solutions.
• Participate in code reviews to ensure adherence to development best practices.
• Troubleshoot and resolve application issues across the software development lifecycle.
• Contribute to the continuous improvement of development processes and tools.

Required Skills

• 5+ years of software development experience.
• Strong proficiency in Python programming.
• Extensive experience with Spark and PySpark.
• Solid understanding of CI/CD methodologies.
• Experience working with microservices architecture.
• Background in Data Engineering and DevOps.
• Experience with AWS.

Preferred Skills

• Experience with Big Data technologies such as Hadoop or Hive.
• Familiarity with cloud platforms like Azure.
• Knowledge of data modeling and database design.

Key Skills

Education

Bachelor's degree in Computer Science