Description

You will build and manage data pipelines for our consolidated data lake and Snowflake data warehouse.

Responsibilities

• Develop data pipelines using Scala, Java, and Spark EMR to move data into Snowflake or our data lake.
• Design and implement solutions to solve department and business problems in collaboration with cross-functional teams.
• Determine optimal infrastructure placement for data based on specific use cases and data models.
• Identify and implement process improvements throughout the data lifecycle.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Hands-on development in distributed computing environments using Hadoop and Spark.
• Proficiency in Scala or Java for data processing.
• Experience with Apache Airflow for workflow orchestration.
• Strong knowledge of SQL.
• Experience working within AWS or GCP environments.
• Competency in TypeScript, HTML, and CSS.

Preferred Skills

• Ability to architect solutions alongside engineering and data analyst teams.
• Degree in Computer Science, Information Systems, Data Science, or a related field.

Key Skills

Education

ANY GRADUATE