Description

You will own the design, implementation, and expansion of scalable data pipelines using DataStage and Snowflake Cloud Datawarehouse.

Responsibilities

• Design and implement robust data pipelines for extraction, transformation, and loading from diverse source systems.
• Troubleshoot DataStage jobs and perform performance tuning to resolve pipeline bottlenecks.
• Document technical specifications for all ETL processes and execute unit testing.
• Collaborate with stakeholders to address data infrastructure needs and resolve technical issues.
• Maintain and improve existing data processes to ensure long-term architectural scalability.

Required Skills

• 4+ years of experience in DataStage Administration, Development, and Change Data Capture (CDC).
• 2+ years of recent hands-on experience with IBM DataStage v11.x.
• Expertise in DataStage Designer, Director, and Operations Console.
• Proficiency in designing Parallel Jobs, Job Sequencing, Parameter Sets, and Parallel Routines.
• Expert-level Unix skills, including automation via Unix scripts and reusable components.
• Strong SQL skills, including developing and debugging complex queries and RDBMS tuning.
• Experience with DB2, Oracle, Teradata, Hive, and HBase.
• Deep understanding of Data Warehousing concepts, including Star and Snowflake Schema methodologies.
• Experience using SQL, Azure big data technologies, and Snowflake Cloud Datawarehouse.

Preferred Skills

• Knowledge of AutoSys scheduler.
• Experience working with Agile or Scaled Agile principles.

Key Skills

Education

Any Graduate