Description

You will own ETL processes and maintain data integrity across the data landscape, ensuring system stability through rigorous monitoring and troubleshooting.

Responsibilities

• Monitor ETL loads and capture failures to ensure system stability and uptime.
• Execute advanced SQL queries and apply Data Warehouse concepts to manage complex data flows.
• Troubleshoot technical escalations and coordinate with engineering teams to implement fixes.
• Analyze data to identify root causes of technical problems and recommend resolutions.
• Document production support issues to facilitate root cause analysis and management reporting.

Required Skills

• 10+ years of experience in data engineering roles.
• Proficiency in PySpark for large-scale data processing.
• Strong Python programming skills for automation and scripting.
• Deep understanding of ETL concepts and data validation techniques.
• Advanced SQL query development and optimization.
• Knowledge of Data Warehouse architecture and best practices.
• Experience with standard operating procedures (SOP) for application management.

Preferred Skills

• Ability to interpret complex data and communicate findings to internal stakeholders.

Key Skills

Education

Any Graduate