Description

You will build and maintain data infrastructure for large-scale processing, migrating workloads from Hadoop to Snowflake.

This role is hybrid.

Responsibilities

• Migrate data pipelines and workloads from Hadoop to Snowflake.
• Develop and maintain ETL processes and data transformations in a hybrid cloud environment.
• Use Hadoop and Apache Spark for data processing and analysis.
• Create UNIX shell and Python scripts for automation and data workflows.
• Build and manage CI/CD pipelines for data deployment and integration.

Required Skills

• 7+ years of professional experience as a Data Engineer or similar role.
• Extensive hands-on experience with Hadoop.
• Proficiency in Apache Spark for distributed data processing.
• Strong knowledge of SQL for querying large datasets.
• Strong proficiency in UNIX Shell scripting.
• Solid experience with Python scripting for automation.
• Experience with CI/CD pipelines.
• Demonstrated production environment experience.

Preferred Skills

• Experience with Snowflake.
• Familiarity with IDMC or other ETL tools.

Key Skills

Education

Any Graduate