Description

You will modernize data systems by migrating applications from Python to PySpark and managing pipelines in Snowflake.

Responsibilities

• Migrate existing Python-based applications to PySpark for scalable processing.
• Develop and maintain data pipelines within the modernization framework.
• Manage data processing tasks using SQL and Snowflake.
• Handle JSON data structures to ensure seamless integration.

Required Skills

• 8+ years of professional experience in data engineering.
• Extensive hands-on experience with Python.
• Strong proficiency in PySpark.
• Advanced SQL skills for complex data manipulation.
• At least 2 years of experience working with Snowflake.
• Proven experience handling JSON data formats.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Experience with Hadoop ecosystems.
• Prior work with Hive.

Key Skills

Education

ANY GRADUATE