Description

You will design, build, and maintain data pipelines to move data from various sources into data warehouses and data lakes.

Responsibilities

• Architect and implement ETL pipelines using AWS Glue, defining extraction methods, transformation logic, and loading procedures.
• Develop scripts to extract data from databases, APIs, flat files, and Mainframe applications using S3, RDS, and Kinesis.
• Manage Oracle data migrations specifically involving Exadata and handling compression tables.
• Execute delta workloads using AWS DMS.
• Maintain data flow across AWS EFS, S3, and RDS Oracle environments.

Required Skills

• 12+ years of experience in data engineering or ETL development.
• Proficiency in Python, PySpark, and Spark for efficient cloud data processing.
• Hands-on experience with AWS Glue, S3, and Redshift.
• Expertise in AWS DMS for delta workloads.
• Experience with AWS RDS Oracle and AWS EFS.
• Direct experience with Oracle Exadata and Oracle data loader.
• Proven ability to manage data extraction from diverse sources including APIs and Mainframe applications.

Preferred Skills

• Experience managing Oracle Exadata compression tables.

Key Skills

Education

Any Gradute