Description

You will build data engineering solutions using Python and Spark to improve process efficiencies and data performance. This role is on-site.

Responsibilities

• Develop tools and techniques to enhance process efficiencies and data performance.
• Review and test data accuracy and validity before uploading to the data lake.
• Troubleshoot issues and perform deep data analysis.
• Oversee the delivery of business priorities within a Scaled Agile Framework (SAFe) environment.

Required Skills

• 8+ years of experience with Python and PySpark.
• Strong proficiency in SQL and data formats (JSON, YAML, CSV, Tab Delimited).
• Experience with Linux and Unix environments.
• Working knowledge of version control systems (GIT, Subversion).
• Familiarity with Java and Spring Boot.
• Experience with Hadoop or similar platforms (HDFS, HBASE, HIVE).

Preferred Skills

• Understanding of Object-Oriented Programming (OOP) and Design Patterns.
• Experience with CI tools like Bamboo and Jira/Confluence.

Key Skills

Education

Any Gradute