Description

You will build and manage data pipelines and storage solutions within the Azure ecosystem.

Responsibilities

• Convert technical source-to-target specifications into Azure Data Factory pipelines.
• Implement partitioning schemes, partition keys, and Change Feed Notifications in Azure Cosmos DB.
• Manage Azure Blob Storage operations, including data movement, metadata retrieval, and retention policies.
• Develop and maintain data processing logic using Azure Databricks.
• Configure and manage real-time streaming using Azure Stream Analytics or Azure Data Explorer.

Required Skills

• 4+ years of professional experience in data engineering.
• Hands-on expertise with SQL and NoSQL databases, including MongoDB.
• Experience with Azure Databricks using PySpark, Scala, or SparkSQL.
• Practical knowledge of Azure Data Factory.
• Experience with Azure Synapse Analytics or Azure Analysis Services.
• Competency in Azure Blob Storage management and SDK usage.
• Familiarity with Azure Cosmos DB container operations.
• Bachelor's degree in Computer Science.

Preferred Skills

• Experience with Azure Data Explorer or Azure Time Series Insights.
• Hands-on experience with Azure HDInsight.

Key Skills

Education

Bachelor's degree in Computer Science