Description

You will design, implement, and maintain scalable data pipelines across Netezza, Hadoop, Snowflake, DBT, and DataStage. This role consolidates data from SAP, Oracle, Kafka, and various cloud databases into consistent, available datasets.

This role is on-site.

Responsibilities

• Build and optimize ETL workflows using DBT and DataStage for large-scale data processing.
• Integrate data from enterprise platforms (SAP, Oracle) and messaging queues, ensuring consistency.
• Design hybrid data solutions leveraging AWS, Azure, and GCP for storage and analytics.
• Implement rigorous data quality checks and validation mechanisms using Python and SQL.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency with Netezza, Hadoop, Snowflake, DBT, and DataStage.
• Strong command of Python and SQL for data transformation and validation.
• Hands-on experience with at least one cloud platform: AWS, Azure, or GCP.
• Experience integrating with SAP, Oracle, and Kafka.
• Ability to design scalable pipelines for on-prem and cloud environments.
• Willingness to travel to unanticipated client sites throughout the USA.

Preferred Skills

• Master’s degree in Computer Science, IT, IS, or Engineering.

Key Skills

Education

Any Graduate