Description

You will own the design, development, and maintenance of our big data ETL infrastructure.

Responsibilities

• Design and develop new automation frameworks for ETL processing.
• Support existing ETL frameworks and serve as the technical point of contact for related teams.
• Enhance ETL automation frameworks based on evolving user requirements.
• Performance tune Spark and Snowflake ETL jobs.
• Conduct technology proofs of concept and suitability analysis for cloud migration.
• Optimize processes using automation and new utility development.

Required Skills

• 7+ years of data engineering experience.
• Strong proficiency in UNIX Shell and Python scripting.
• Expertise in Apache Spark.
• Strong command of SQL.
• Hands-on experience with HDFS, Hive, Impala, and Spark internals.
• Proven logical reasoning capabilities.
• Working knowledge of Git, DevOps, and CICD/enterprise code management tools.
• Excellent written and verbal communication skills.
• Ability to execute and prioritize tasks independently.

Preferred Skills

• Working experience with Snowflake or any data integration tool like Informatica Cloud.
• Experience with Azure or AWS cloud environments.

Key Skills

Education

Bachelor's degree