Description

You will design and build data pipelines and Ab Initio data graphs to extract data from databases, flat files, and message queues.

Responsibilities

• Collaborate with Business Analysts and Product teams to gather data requirements.
• Design and build Ab Initio data graphs and pipelines to transform data into consumable layers.
• Document technical designs and operational runbooks.
• Support data pipelines with bug fixes, enhancements, and production troubleshooting.
• Mentor junior developers and work independently to deliver high-quality code.

Required Skills

• 10+ years of IT experience, predominantly in Data Integration or Data Warehousing.
• 5+ years of ETL design and development experience using Ab Initio.
• 1-2 years of data integration experience on the Hadoop platform, preferably Cloudera.
• Working knowledge of HDFS, Hive, Impala, and related Hadoop technologies.
• Strong SQL skills with the ability to write high-performing queries.
• Experience with Unix/Linux shell scripting.
• Deep understanding of OLTP/OLAP data models and data warehouse fundamentals.
• Experience with Agile development practices.
• Proven ability to implement automated testing and engineering best practices.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

Preferred Skills

• Ab Initio CDC (Change Data Capture) experience.
• Working knowledge of AWS services.
• Java development experience.

Key Skills

Education

Bachelor's degree