Description

Build and maintain ETL processes for privacy applications and regulatory compliance. You will own data extraction, transformation, and loading from OLEDB, Excel, XML, and flat files.

Responsibilities

• Develop ETL processes using merge, join, union, split, sort, and lookup transformations.
• Write UNIX scripts to move data to Teradata and validate file integrity across servers.
• Create and manage temporary and fact tables using Teradata and Spark SQL.
• Optimize ETL objects, indexing, and partitioning; tune SQL, HQL, and Spark SQL queries.
• Promote components to production via CI/CD pipelines using GitHub and execute testing phases.

Required Skills

• 3+ years of experience in data engineering.
• Proficiency in SQL, HQL, and Spark SQL.
• Experience writing UNIX scripts for data movement and validation.
• Hands-on experience with GitHub and CI/CD processes.
• Ability to work with OLEDB, Excel, and XML data sources.
• Experience managing data flows into SQL data warehouses.
• Knowledge of ETL optimization, indexing, and partitioning.

Preferred Skills

• Bachelor’s degree in Computer Science, Computer Information Systems, Technology Management, or equivalent experience.

Key Skills

Education

Any Graduate