Description

Develop solutions leveraging data engineering principles using Python and Spark.

Responsibilities

• Develop tools and techniques to improve process efficiencies and data performance.
• Review and test data accuracy and validity before uploading to the data lake.
• Troubleshoot and perform data analysis.
• Oversee the delivery of business priorities within a Scaled Agile Framework (SAFe) environment.

Required Skills

• Python
• Spark (PySpark)
• SQL
• Linux and Unix understanding
• Working knowledge of data formats (JSON, YAML, CSV, Tab Delimited)
• Experience with version control (GIT, Subversion)
• Familiarity with Java and Springboot
• Experience with Hadoop or similar platforms (HDFS/HBASE/HIVE)

Preferred Skills

• Understanding of OOP and Design Patterns
• Experience with CI tools like Bamboo and Jira/Confluence

Key Skills

Education

Any Gradute