Description

You will design and implement end-to-end data engineering solutions within the Microsoft ecosystem, specifically owning Azure Synapse implementations.

This role is on-site.

Responsibilities

• Debug and fine-tune Spark notebooks to optimize memory consumption and processing performance for large-scale data volumes.
• Conduct feasibility studies, technical risk assessments, and architectural reviews for new data initiatives.
• Provide technical guidance and implement coding standards and best practices for the engineering team.
• Manage process compliance across assigned modules while handling data volumes in the hundreds of gigabytes.

Required Skills

• 10+ years of experience in data engineering with strong Microsoft ecosystem focus.
• Proficiency in PySpark and writing Python code within Azure Synapse Notebooks.
• Hands-on experience with Azure Synapse end-to-end implementations.
• Strong expertise in SQL, Azure Data Lake, and data modeling principles.
• Working knowledge of Kusto for telemetry data processing.
• Experience with Spark structured streaming, specifically from Event Hubs.
• Recent experience (3-4 years) working within the Microsoft ecosystem.

Preferred Skills

• Knowledge of Azure DevOps, Azure WebApps, Azure Functions, and Azure Cosmos DB.
• Local Redmond residency.

Key Skills

Education

Any Graduate