Description

You will design, build, and maintain data pipelines and infrastructure.

Responsibilities

• Own ETL orchestration and workflow management processes using tools like Airflow, Flink, Oozie, and Azkaban on AWS/GCP.
• Develop and optimize data solutions leveraging Spark, Snowflake, and Databricks.
• Debug and resolve issues within complex Spark jobs.
• Collaborate with technical and non-technical teams to deliver data products.

Required Skills

• 5+ years of experience in data engineering or business intelligence.
• Proficiency in Python programming.
• Expert knowledge of Database fundamentals and distributed computing.
• Advanced proficiency in Complex SQL.
• 5+ years experience with ETL orchestration tools (Airflow, Flink, Oozie, Azkaban) on AWS/GCP.
• Experience with Snowflake, Redshift, and PostgreSQL or other DBMS platforms.
• Demonstrable ability to clear a HackerRank code test.
• Experience with Spark and Databricks.
• Excellent communication skills.

Preferred Skills

• Experience with AWS services (EC2/S3/IAM).
• Knowledge of reporting tools such as Tableau, Superset, and Looker.

Key Skills

Education

Any Gradute