Description

You will design and build data pipelines for distributed environments.

This role is hybrid.

Responsibilities

• Develop data solutions using object-oriented Python.
• Implement and tune data processing jobs on Hadoop and Spark platforms.
• Integrate and manage data storage solutions across distributed environments.
• Write and maintain automated testing suites for data workflows.

Required Skills

• 10+ years of professional development experience.
• Expertise in Python, including object-oriented programming.
• Strong command of SQL, with preference for PostgreSQL or Snowflake.
• 3+ years implementing and tuning Hadoop/Spark platforms.
• Hands-on experience implementing and tuning Amazon EMR.
• Experience with data warehousing, data lake patterns, and structured/unstructured data.
• Bachelor’s degree in Computer Science or related field.

Preferred Skills

• Familiarity with APIs; Boto3 experience.
• Solid understanding of software design principles.

Key Skills

Education

Bachelor’s degree