Description

Build and manage data pipelines and dataflows to support business requirements.

Responsibilities

• Build simple to complex pipelines and dataflows within Azure Data Factory.
• Implement modules incorporating security and authorization frameworks.
• Analyze underlying data flows and provide technical input on data requirements.
• Contribute to the full data warehouse lifecycle, including design documents, unit test plans, and code review reports.

Required Skills

• 6-8 years of data engineering or software development experience.
• Expert-level knowledge of Azure Data Factory.
• Advanced knowledge of Azure SQL DB, Synapse Analytics, and Logic Apps.
• Proficiency in T-SQL, SSIS, and SSRS.
• Experience with Power BI and Azure Data Lake.
• Strong understanding of Azure DevOps, CI/CD, and Analysis Services.
• Practical knowledge of data modeling, database design, and SQL Server best practices.
• Solid grasp of master data management, data warehousing, and BI architecture.

Preferred Skills

• Experience in Agile environments such as Scrum, Lean, or Kanban.
• Knowledge of Big Data technologies including Spark, NoSQL, Azure Databricks, and the Hadoop ecosystem.

Key Skills

Education

Bachelor or master’s degree in computer science