Description

You will design and build data pipelines and graphs to extract, transform, and load data from various databases, flat files, and message queues.

Responsibilities

• Design and build Ab Initio data graphs and pipelines to create consumable data layers.
• Collaborate with Business Analysts and Product teams to gather data requirements.
• Maintain data pipelines through bug fixes and functional enhancements.
• Document technical designs and operational runbooks.
• Perform unit testing and troubleshoot issues within production environments.

Required Skills

• 10+ years of IT experience with a focus on Data Integration or Data Warehousing.
• 5+ years of ETL design and development experience using Ab Initio.
• 1-2 years of data integration experience on Hadoop platforms, preferably Cloudera.
• Working knowledge of HDFS, Hive, and Impala.
• Proficiency in Unix/Linux shell scripting.
• Strong SQL skills with the ability to write high-performing queries.
• Solid understanding of OLTP and OLAP data models and warehouse fundamentals.
• Experience with Agile development practices.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

Preferred Skills

• Ab Initio CDC (Change Data Capture) experience.
• Working knowledge of AWS services.
• Java development experience.

Key Skills

Education

Not specified