Description

Lead the design, implementation, and expansion of scalable data pipelines using DataStage and Snowflake Cloud Data Warehouse.

Responsibilities

• Design and implement scalable ETL pipelines for extraction, transformation, and loading.
• Troubleshoot DataStage jobs and perform performance tuning to resolve pipeline issues.
• Automate jobs using Unix scripts and develop reusable Unix components.
• Document technical specifications and perform unit testing for all ETL processes.
• Collaborate with stakeholders to gather requirements and support data infrastructure needs.

Required Skills

• 4+ years of experience in DataStage Administration, Development, and CDC.
• 2+ years of recent hands-on experience with IBM DataStage v11.x.
• Expertise in DataStage Designer, Director, and Operations Console.
• Proficiency in designing Parallel Jobs, Job Sequencing, and Parallel Routines.
• Advanced UNIX skills including script automation and component development.
• Strong SQL skills with expertise in query development and performance tuning.
• Experience with DB2, Oracle, Teradata, Hive, and HBase.
• Knowledge of Data Warehousing, Star Schema, and Snowflake Schema methodologies.
• Familiarity with Azure big data technologies and Snowflake Cloud Data Warehouse.

Preferred Skills

• Experience working within Agile or Scaled Agile environments.
• Knowledge of AutoSys scheduler.

Key Skills

Education

Any Graduate