Description

You will architect and develop end-to-end data pipelines, manage cloud-based analytics platforms, and expose data services via APIs. This role is on-site.

Responsibilities

• Design and develop data models, structures, and ETL jobs for data acquisition and transformation.
• Create, schedule, and monitor Azure Data Factory (ADF) pipelines and implement master data management standards.
• Develop data services and RESTful APIs using Azure API Management Service.
• Manage cloud-based data and analytics platforms, ensuring data quality and security throughout the lifecycle.
• Translate business stakeholder requirements into technical solutions and prototype through proofs of concept.

Required Skills

• 10+ years of relevant experience with a Bachelor’s degree in Computer Science, Computer Engineering, or a related field.
• Expertise in Azure Cloud platform services and Azure SQL, including complex queries, stored procedures, and query optimization.
• Hands-on experience with real-time data capture and processing using Azure Event Hubs and Azure Service Bus.
• Proficiency in building pipelines and complex transformations using Databricks/Spark with .Net/C#, Python, Java, R, or Scala.
• Experience with NoSQL databases such as Azure CosmosDB or other document stores.
• Experience using Azure Purview for data cataloging, classification, lineage, and metadata management.
• Experience configuring data quality management workflows using Profisee.
• Working knowledge of ADLS Gen2, Azure Blob storage, and data formats like Parquet, Avro, CSV, and ORC.

Preferred Skills

• Experience with Azure Synapse Analytics, Azure Analysis Services, and Power BI.
• Understanding of MPP databases and large-scale data processing.

Key Skills

Education

Bachelor’s Degree