Description

You will provide technical support and engineering for data ingestion pipelines and Azure-based data warehousing solutions.

Responsibilities

• Design and implement performant data ingestion pipelines using Apache Spark, Azure Databricks, Dataverse, and Azure Cosmos DB.
• Troubleshoot critical issues (CRITSITs) and provide rapid support to customers.
• Deliver and present proofs of concept for key technology components to stakeholders.
• Support the delivery of project components including API interfaces, DevOps, ARM, and Azure PowerShell.
• Evaluate tool performance and applicability against specific customer requirements.

Required Skills

• 5+ years of experience in data management and building ETL/data warehouse transformation processes.
• Hands-on experience with Azure Synapse Analytics, Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, and Azure Cosmos DB.
• Proficiency in T-SQL and designing data models.
• Experience building data pipelines using Azure Data Factory and Apache Spark (preferably Databricks).
• Knowledge of SQL Data warehousing MPP architecture and Serverless Architecture.
• Ability to troubleshoot query plans, analyze logs via Kusto Explorer, and perform network trace analysis.
• Understanding of Azure networking including Private Link, Azure DNS, Load Balancers, and Azure Active Directory.
• Experience working in a DevOps environment using tools such as Microsoft Visual Studio Team Services, Chef, Puppet, or Terraform.
• Microsoft Azure AZ-900 or DP-900 certification.

Preferred Skills

• Experience with Azure Stream Analytics.

Key Skills

Education

Any Graduate