Description

You will design and build data pipelines and graphs to support complex data integration requirements.

Responsibilities

• Design and build Ab Initio data graphs and pipelines to extract data from databases, flat files, and message queues.
• Transform data to create consumable layers for various application uses.
• Collaborate with Business Analysts and Product teams to gather data requirements.
• Support existing data pipelines through bug fixes, enhancements, and production troubleshooting.
• Document technical designs and operational runbooks.

Required Skills

• 10+ years of IT experience, predominantly in Data Integration or Data Warehousing.
• 5+ years of ETL design and development experience using Ab Initio.
• 1-2 years of data integration project experience on Hadoop platforms, preferably Cloudera.
• Proficiency in SQL and writing high-performance queries.
• Strong understanding of OLTP and OLAP data models and data warehouse fundamentals.
• Experience with Unix/Linux shell scripting.
• Working knowledge of HDFS, Hive, Impala, and related Hadoop technologies.
• Knowledge of Agile development practices.
• Experience with unit testing, automated testing, and engineering best practices for reusable code.

Preferred Skills

• Ab Initio CDC (Change Data Capture) experience.
• Working knowledge of AWS services.
• Java development experience.

Key Skills

Education

Any Graduate