Description

You will design, build, and maintain data pipelines to move data from various sources into data lakes and warehouses.

Responsibilities

• Architect and implement ETL pipelines using AWS Glue, defining extraction methods, transformation logic, and loading procedures.
• Develop scripts to extract data from databases, APIs, flat files, and Mainframe applications.
• Manage data migrations from Oracle Exadata to AWS using AWS DMS for delta workloads.
• Handle Oracle Exadata compression tables and utilize Oracle data loader.
• Maintain data flows using AWS services including S3, RDS, Kinesis, and EFS.

Required Skills

• 5+ years of experience in ETL development.
• Proficiency in Python, PySpark, and Spark for cloud-based data processing.
• Hands-on experience with AWS Glue, S3, Redshift, and RDS Oracle.
• Direct experience with AWS DMS and Oracle Exadata data migration.
• Knowledge of AWS Kinesis, EFS, and data warehouse architecture.
• Ability to work with diverse data sources including APIs and Mainframe applications.
• Bachelor's degree in Computer Science or a related field.

Key Skills

Education

Any Graduate