Description

This role requires close collaboration with technical teams and business stakeholders to resolve data-related incidents, identify root causes, and improve the reliability and scalability of enterprise data platforms.

Key Responsibilities

Support, monitor, and troubleshoot data pipelines, large datasets, and production data issues.

Develop and maintain data engineering solutions within Microsoft Azure environments using Python and Databricks.

Build and maintain notebooks, data transformations, and data processing workflows using PySpark.

Perform data read/write operations and troubleshoot data processing issues across enterprise platforms.

Optimize data warehouse performance using advanced T-SQL, indexing, execution plans, and query tuning.

Troubleshoot ETL pipelines, data-quality issues, performance bottlenecks, and scalability challenges.

Investigate production incidents, perform root-cause analysis, and implement sustainable solutions.

Collaborate with stakeholders and technical teams to resolve data and platform issues.

Contribute to data platform modernization, reliability, and operational improvements.

Provide technical guidance and coaching to team members when needed.

Required Qualifications

5+ years of experience in data engineering, application support, technical leadership, or data-platform troubleshooting.

Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.

Hands-on experience with Microsoft Azure data engineering technologies.

Strong programming experience with Python.

Working experience with Databricks and PySpark.

Strong T-SQL skills and experience working with enterprise data warehouses.

Experience with stored procedures, functions, execution plans, indexing, and query optimization.

Experience troubleshooting ETL pipelines, data-quality issues, performance problems, and scalability challenges.

Strong understanding of relational database concepts, data movement, reporting flows, and production support practices.

Demonstrated experience with incident management, root-cause analysis, and stakeholder communication.

Strong problem-solving and communication skills.

Preferred Qualifications

Experience with Azure Data Factory (ADF).

Experience with Azure Data Lake Storage (ADLS).

Knowledge of Delta Lake and Parquet.

Experience with AKS (Azure Kubernetes Service).

Familiarity with SSIS/MSBI.

Experience with Power BI or Alteryx.

Understanding of ERP data extraction and integration concepts.

Experience working with data related to audit, accounting, or financial services environments.

Key Skills

Education

Any Graduate