Description

Manage and maintain Spark and SQL production environments to ensure availability for large-scale analytical applications.

Manage, install, and upgrade production environments for large-scale data and analytical applications. Monitor system connectivity, network stability, and execute backups. Plan capacity upgrades or downsizing based on system requirements. Implement continuous improvements through automation and appropriate tooling. Gather and present project metrics and activity reports to stakeholders.

Responsibilities

• Manage, install, and upgrade production environments for large-scale data and analytical applications.
• Monitor system connectivity, network stability, and execute backups.
• Plan capacity upgrades or downsizing based on system requirements.
• Implement continuous improvements through automation and appropriate tooling.
• Gather and present project metrics and activity reports to stakeholders.

Required Skills

• 2+ years of hands-on experience supporting Spark ecosystem technologies in production.
• 3+ years of experience scripting with Python or Anaconda.
• Proven background as a SQL DBA.
• Proficiency in shell scripting or Bash.
• Experience with Spark and SQL.
• Bachelor's degree in informatics, life sciences, or equivalent work experience.

Preferred Skills

• Master of Science (MS) degree in a relevant area of study.
• Experience with data science tools such as Data Robot.

Key Skills

Education

ANY GRADUATE