Description

You will design, build, and maintain data pipelines and infrastructure.

This role is remote.

Responsibilities

• Own ETL orchestration and workflow management using Airflow, Flink, Oozie, and Azkaban on AWS/GCP.
• Develop and optimize data solutions leveraging Spark, Snowflake, and Databricks.
• Debug and resolve issues within complex Spark jobs.
• Collaborate with technical and non-technical teams to deliver data products.

Required Skills

• 5+ years of experience in data engineering or business intelligence.
• Proficiency in Python programming.
• Expert knowledge of database fundamentals and distributed computing.
• Advanced proficiency in complex SQL.
• 5+ years experience with ETL orchestration tools (Airflow, Flink, Oozie, Azkaban) on AWS/GCP.
• Experience with Snowflake, Redshift, and PostgreSQL or other DBMS platforms.
• Experience with Spark and Databricks.
• Demonstrable ability to clear a HackerRank code test.

Preferred Skills

• Experience with AWS services (EC2/S3/IAM).
• Knowledge of reporting tools such as Tableau, Superset, and Looker.

Key Skills

Education

Any Gradute