Description

You will build and extend data frameworks using Python and PySpark.

Responsibilities

• Design, develop, and implement new features into the existing framework using PySpark and Python.
• Write efficient standalone scripts for data transformations based on defined business logic.
• Apply object-oriented programming concepts to solve complex data engineering problems.
• Test and debug code to ensure accuracy and produce desired results.
• Document all programming tasks and procedures for troubleshooting and future reference.

Required Skills

• 5+ years of experience as a Senior Data Engineer or in a similar role.
• Proficiency in Python and PySpark.
• Strong understanding of Object-Oriented Programming (OOP) concepts.
• Proven ability to write standalone transformation scripts.
• Advanced problem-solving and software troubleshooting skills.
• Effective written and verbal communication skills.
• Ability to work independently with minimal supervision.
• Any Graduate degree.

Preferred Skills

• Experience with AWS.

Key Skills

Education

Any Graduate