Description

You will design, build, and maintain data platforms focused on big data and data management, ensuring reliability and automation.

Responsibilities

• Gather data requirements by collaborating with Business Analysts and Product teams.
• Design and build AbInitio data graphs and pipelines to extract data from databases, flat files, and message queues.
• Transform data to establish a consumable data layer for various application uses.
• Support data pipelines by resolving bugs and implementing enhancements.
• Document technical designs and operational runbooks.

Required Skills

• 10+ years of IT experience, predominantly in Data Integration or Data Warehouse.
• 5+ years of ETL Design and Development experience using AbInitio.
• Sound understanding of SQL and ability to write well-performing queries.
• Good knowledge of OLTP and OLAP data models and data warehouse fundamentals.
• Working knowledge of Hadoop, HDFS, Hive, and Impala.
• Working experience with Unix/Linux shell scripting.
• Rigor in high code quality, automated testing, and writing reusable code components.
• Ability to unit test code thoroughly and troubleshoot production issues.
• Knowledge of Agile Development practices.

Preferred Skills

• AbInitio CDC experience in an ETL project setting.
• Working knowledge of AWS services.
• Java development experience.

Key Skills

Education

Any Graduate