Description

You will build and maintain large-scale data processing systems and pipelines.

This role is remote.

Responsibilities

• Build and manage data pipelines using Python.
• Execute ETL processes and manage data ingestion workflows.
• Develop and optimize queries within MPP and cloud databases.
• Maintain data structures within Hadoop and Spark environments.

Required Skills

• 5+ years of experience in DW/BI or Big Data projects.
• 4+ years of experience in ETL and data ingestion.
• Proficiency in Python for data pipeline development.
• Hands-on experience with Hadoop tools and technologies.
• Working experience with Apache Spark.
• Strong proficiency in SQL and PL/SQL.
• Experience with MPP databases (Teradata, Greenplum, Netezza, or Vertica).
• Experience with cloud databases (Redshift, BigQuery, or Snowflake).
• Practical experience using Airflow for orchestration.

Preferred Skills

• Specific experience with Google BigQuery.

Key Skills

Education

Any Graduate