Description

You will build and manage scalable data pipelines using PySpark to handle large volumes of structured and unstructured data.

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark.
• Develop and manage ETL/ELT workflows using Informatica BDM.
• Translate business requirements from stakeholders into technical data solutions.
• Optimize data processing jobs for performance and reliability.
• Implement data quality, governance, and validation processes across integrated data sources.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in PySpark for large-scale data processing.
• Experience developing and managing ETL processes.
• Familiarity with integrating data from APIs and enterprise systems.
• Knowledge of data warehouse and data lake architectures.
• Ability to ensure compliance with security and banking regulatory standards.

Key Skills

Education

Bachelor's degree