Description

Provide Tier 1 support for cloud data engineering processes, focusing on monitoring and resolving failures in data processing and loading pipelines.

Responsibilities

• Monitor and respond to issues in batch, API, and streaming data processes to ensure data freshness and continuity.
• Perform break/fix recovery and corrective actions for incidents within a large Azure Enterprise Data Lake environment.
• Manage incidents using ServiceNow while adhering to established SLA expectations and escalation procedures.
• Support diverse data workflows including real-time API transfers and streaming via change log records.

Required Skills

• 3 to 5 years of experience in Cloud Data Engineering support or development roles.
• Hands-on experience in Microsoft Azure environment handling Tier 1 support and recovery.
• Proficiency with Azure Data Factory, Databricks, Python, PySpark, and Scala.
• Experience managing large datasets and complex data environments.
• Knowledge of SQL, data warehouse star schemas, and ETL concepts.
• Experience with streaming support using Event Hub, Databricks Clusters, Cosmos DB, and Azure SQL DB.
• Experience with batch processing using Databricks Notebooks, Azure Data Lake Storage, and automated scheduling tools.
• Familiarity with APIs, Azure Functions, and Azure App Insights.

Preferred Skills

• Bachelor's Degree in Computer Science, Computer Information Systems, or a related field.
• Knowledge of Big Data solutions, NoSQL DBMSs, and Reverse Proxy concepts (Kong, nginx, or Apache).

Key Skills

Education

Bachelor's Degree