Description

You will design, build, and maintain scalable data pipelines using PySpark to process large volumes of structured and unstructured data.

This role is hybrid.

Responsibilities

• Design and develop scalable data pipelines using PySpark for high-volume data processing.
• Develop and manage ETL/ELT workflows using Informatica BDM.
• Translate business requirements into technical data solutions and architecture.
• Optimize data processing jobs for performance, reliability, and cost.
• Implement data quality, governance, and validation processes across integrated sources.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in PySpark for large-scale data processing.
• Experience developing and managing ETL/ELT processes.
• Familiarity with integrating data from APIs and enterprise systems.
• Knowledge of data warehouse and data lake architectures.
• Ability to ensure compliance with security and banking regulatory standards.

Preferred Skills

• Bachelor's degree in Computer Science, Engineering, or related field.
• Experience with Informatica BDM.

Key Skills

Education

Bachelor's degree