Description

You will build and tune scalable, high-volume data pipelines to support large-scale software engineering deliverables.

This role is hybrid.

Responsibilities

• Build and tune complex, scalable data pipelines using PySpark and Apache Spark.
• Analyze and resolve moderately complex software engineering challenges.
• Collaborate with client personnel on large-scale software engineering deliverables.
• Consult on software engineering initiatives and contribute to planning processes.
• Ensure all deliverables meet established policies, procedures, and compliance requirements.

Required Skills

• 5+ years of software engineering experience or equivalent.
• Proficiency in Python.
• Extensive experience with PySpark and Apache Spark.
• Strong SQL skills.
• Experience working with high-performance object stores such as NetApp or equivalent.
• Experience building and managing complex data pipelines.

Preferred Skills

• Knowledge of Iceberg and Demio.
• Cloud computing experience.

Key Skills

Education

Any Graduate