Description

You will build data engineering and machine learning applications for model development and advanced reporting using large-scale datasets.

This role is on-site.

Responsibilities

• Cleanse, manipulate, and analyze structured and unstructured data (XML, JSON, PDF) on the Hadoop platform.
• Develop Python, PySpark, and Spark scripts to filter, map, and aggregate data.
• Manage data processes and implement data quality reports.
• Create data profiling, deduplication, and matching logic for analysis.
• Present technical recommendations regarding Hadoop and related technologies to management.

Required Skills

• 10+ years of experience in data engineering or related roles.
• Proficiency in Python, PySpark, and Spark for data ingestion and processing.
• Hands-on experience with the Hadoop platform.
• Expertise in handling JSON and XML formats.
• Strong SQL skills for data manipulation.
• Experience with Snowflake.
• Ability to perform exploratory data analysis.

Preferred Skills

• Experience in the Mortgage domain.
• Strong grasp of data architectures.

Key Skills

Education

ANY GRADUATE