Description

You will own the design, development, and maintenance of the big data ETL infrastructure.

This role is on-site.

Responsibilities

• Design and develop new automation frameworks for ETL processing.
• Support existing ETL frameworks and serve as the technical point of contact for related teams.
• Enhance ETL automation frameworks based on evolving user requirements.
• Performance tune Spark and Snowflake ETL jobs.
• Conduct technology proofs of concept and suitability analysis for cloud migration.

Required Skills

• 7+ years of data engineering experience.
• Strong proficiency in UNIX Shell and Python scripting.
• Expertise in Apache Spark and Spark internals.
• Strong command of SQL.
• Hands-on experience with HDFS, Hive, and Impala.
• Working knowledge of Git, DevOps, and CI/CD enterprise code management tools.
• Proven logical reasoning capabilities.

Preferred Skills

• Working experience with Snowflake or data integration tools like Informatica Cloud.
• Experience with Azure or AWS cloud environments.

Key Skills

Education

Bachelor's degree