Description

Lead data acquisition and processing engineering for new application setups and legacy system implementations.

This role is on-site.

Responsibilities

• Develop and maintain Big Data Hadoop and Spark ETL processes.
• Design and model databases to support new and existing applications.
• Perform SQL performance tuning to ensure optimal database performance.
• Write and maintain Unix Shell scripts and manage job scheduling with Autosys.
• Collaborate with an 8-person team within an Agile environment using JIRA.

Required Skills

• 5+ years of data engineering experience.
• Proficiency with Spark, Hive, and Scala.
• Strong expertise in data modeling and database design.
• Advanced SQL performance tuning skills.
• Competence in Unix Shell scripting and Autosys.
• Experience working with Agile methodologies and JIRA.
• Bachelor's Degree.

Key Skills

Education

Bachelor's Degree