Description

You will build and maintain data infrastructure and processes.

This role is remote.

Responsibilities

• Develop and manage ETL pipelines using Python and Airflow.
• Model data structures for data conversion tasks.
• Process large datasets using Spark, Hive, and HDFS.
• Query and manipulate data using SQL and GCP BigQuery.

Required Skills

• 6+ years of professional experience in data engineering.
• Expertise in Python and SQL.
• Hands-on experience with GCP, specifically GCP BigQuery.
• Proficiency in building ETL pipelines with Airflow.
• Experience with big data processing frameworks like Spark and Hive.
• Familiarity with distributed file systems, including HDFS.
• Understanding of data modeling principles for data conversion.
• Prior experience with HR conversion or migration projects.

Key Skills

Education

Any Graduate