Description

You will build and optimize large-scale data processing systems and pipelines for the California, USA office.

Responsibilities

• Implement systems to track data quality and consistency across pipelines.
• Develop tools that support self-service ETL pipeline management.
• Tune SQL and MapReduce jobs to improve data processing performance.
• Collaborate with data analytics teams to translate business requirements into engineering solutions.

Required Skills

• 5+ years of experience in data engineering.
• Extensive experience with the Hadoop ecosystem: MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, and Parquet.
• Proficiency in at least one SQL language: MySQL, PostgreSQL, SQL Server, or Oracle.
• Deep understanding of SQL engines and advanced performance tuning.
• Strong scripting skills in Python, Ruby, Perl, or Bash.
• Experience using workflow management tools such as Airflow, Oozie, Azkaban, or UC4.
• Any graduate degree.

Preferred Skills

• Experience with large-scale distributed data processing.

Key Skills

Education

ANY GRADUATE