Description

Lead data engineering efforts and own end-to-end data flows and business logic integration.

Responsibilities

• Design and implement ETL processes to extract data from various sources.
• Analyze large datasets on Hadoop HDFS using Hive and Spark.
• Translate business requirements into technical data specifications.
• Manage the end-to-end flow of data across product lines.

Required Skills

• 9+ years of experience in Data Engineering, ETL, or BI.
• 5+ years of experience with the Big Data stack including Hadoop, Hive, and Spark.
• Proficiency in Spark using either Python or Scala.
• Strong SQL skills for complex data querying and analysis.
• Experience with shell scripting and basic Python scripting.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience building applications using Google Cloud Platform frameworks like Dataflow, Dataproc, or PubSub.

Key Skills

Education

Bachelor's degree in Computer Science