Description

Design and implement data warehouse architectures and ETL processes to integrate disparate data sources.

Responsibilities

• Design and create data warehouse structures while managing all extraction, transformation, and load functions.
• Write optimized SQL queries, database procedures, and functions for data loading and application integration.
• Implement batch processing workflows for high-volume data transactions and execute data profiling and cleansing.
• Develop stream systems to discover, integrate, and ingest machine-produced data in real-time.
• Manage data quality, profiling, and database security using shell scripting and data comparison techniques.

Required Skills

• 7+ years of experience with Ab Initio.
• Strong proficiency in SQL and UNIX.
• Expertise in ETL concepts including 3NF, dimensional modeling, fact loads, and surrogate keys.
• Experience with AutoSys for automated job executions.
• Hands-on experience with shell scripting and data comparison across tables.
• Strong analytical skills to oversee complex data situations.

Preferred Skills

• Experience with AWS.
• Python programming skills.

Key Skills

Education

Any Graduate