Description

Key Responsibilities

Pipeline Development: Design and develop scalable ETL/ELT pipelines using Ab Initio (Continuous Flows, GDE, Co-Operating System).

Cloud Migration: Migrate legacy Ab Initio graphs and data frameworks into GCP cloud-native solutions like BigQuery, Cloud Dataflow, and Cloud Composer (Airflow).

Automation & Scripting: Write clean, efficient Python scripts for data processing, pipeline orchestration, API integrations, and workflow automation.

Data Modeling: Optimize data warehouse performance, partition strategies, and schema designs specifically within Google BigQuery.

CI/CD Integration: Build and maintain deployment pipelines using Jenkins, GitLab CI/CD, or GCP Cloud Build for automated code promotions.

Required Technical Skills

Ab Initio Suite: Expert-level knowledge of GDE, Co-Operating System, Enterprise Meta-Environment (EME), and Conduct>It.

Google Cloud Platform: Hands-on experience with BigQuery, Cloud Storage (GCS), Pub/Sub, and Dataflow.

Programming: Advanced proficiency in Python (Pandas, NumPy, Apache Beam) and robust Unix/Linux Shell Scripting.

Databases: Strong SQL skills for complex query optimization and data analysis

Key Skills

Education

Bachelor's degree