Description

You will design, build, and maintain scalable data pipelines and infrastructure using the Microsoft stack and Pentaho.

Responsibilities

• Architect and optimize data pipelines using Azure Data Factory, Azure Databricks, and SSIS.
• Integrate Pentaho for data transformations and orchestration.
• Manage Microsoft SQL Server and Azure SQL Database, ensuring data integrity, security, and performance.
• Perform ETL processes, including data cleansing and enrichment, using SQL queries, stored procedures, and Pentaho.
• Implement monitoring and alerting using Azure Monitor and Azure Log Analytics.

Required Skills

• Experience with Azure SQL Database.
• Proficiency in Azure Databricks.
• Strong SQL skills for data transformation and management.
• Programming experience with Python.
• Expertise in Microsoft technology stack including SSIS, Azure Data Factory, and Azure Logic Apps.
• Hands-on experience with Pentaho for data integration and analytics.

Preferred Skills

• Knowledge of Azure infrastructure including ARM templates, Azure VMs, and AKS.
• Ability to use Azure Monitor and Azure Log Analytics for troubleshooting.

Key Skills

Education

ANY GRADUATE