Description

You will design, develop, and implement new features for our existing data framework.

Responsibilities

• Develop new framework features using PySpark and Python.
• Write efficient standalone PySpark scripts to execute data transformations based on business logic.
• Apply object-oriented programming concepts to solve complex data problems.
• Test and debug code to ensure accuracy and performance.
• Document all programming tasks and procedures for troubleshooting and future reference.

Required Skills

• 5+ years of experience as a Senior Data Engineer or in a similar role.
• Proficiency in Python and PySpark.
• Strong understanding of Object-Oriented Programming (OOP) concepts.
• Experience with SQL.
• Proven ability to troubleshoot and solve complex software issues.
• Bachelor's degree in Computer Science.
• Ability to work independently with minimal supervision.

Preferred Skills

• Hands-on experience with AWS.

Key Skills

Education

Bachelor's degree in Computer Science