Description

You will develop data integration solutions within the IICS ecosystem, focusing on ETL transformations and API data retrieval.

This role is on-site.

Responsibilities

• Analyze existing ETL processes using Talend and PySpark.
• Develop transformations using PySpark and IICS based on data architecture requirements.
• Create reusable IICS CAI processes to retrieve JSON/XML data from multiple API endpoints.
• Develop reusable PySpark code to populate dimension and history tables in the data lake.
• Perform unit testing and assist code promotion through environments.

Required Skills

• Expert knowledge of Informatica PowerCenter design and development, including Designer, Workflow Manager, Workflow Monitor, and Repository Manager.
• Advanced skills in Informatica, including parameter files, session partitioning, and push down optimization.
• Proficiency with PySpark and IICS.
• Strong experience with ETL processes and data integration.
• Familiarity with AWS ecosystem components like Step Functions and DynamoDB.
• Ability to use Unix commands for ETL job execution and troubleshooting.
• Experience working in an Agile environment.
• Bachelor's degree in Computer Science or equivalent.

Preferred Skills

• 5+ years of experience in data engineering roles.

Key Skills

Education

Bachelor's degree