Description

You will design and build data solutions on Azure, owning the full lifecycle from ingestion to modeling.

Responsibilities

• Build Data Warehouse and Data Mart solutions using Azure Synapse SQL pools.
• Develop Azure Data Factory pipelines for ingesting data from flat files, RDBMS, cloud storage, and SFTP.
• Create complex orchestrations and transformations for structured and semi-structured data using PySpark and SQL.
• Refactor traditional ML models to execute on the Spark framework.
• Model NoSQL schemas and containers with Cosmos DB integrations.

Required Skills

• 5-10 years of experience developing data solutions on Microsoft Azure.
• Strong T-SQL skills for writing complex stored procedures, functions, and views.
• Deep understanding of Massive Parallel Processing (MPP) systems.
• Experience with Spark architecture and performance tuning for big data workloads.
• Proficiency in Python or C#.
• Hands-on experience with PySpark, SQL, and Azure Data Factory.
• Experience with Azure Databricks and Cosmos DB.
• Familiarity with Cognitive Search or Elastic Search integrations.
• Competency in Git, Visual Studio, and IntelliJ or Eclipse.

Preferred Skills

• Experience with Kafka, Hive, or Hadoop.
• Azure Data certifications (DP-200, DP-201, or DP-203).

Key Skills

Education

Any Graduate