Build and maintain data pipelines and infrastructure within the Azure ecosystem.
Responsibilities
- Develop and manage data workflows using Azure Data Factory and Azure Databricks.
- Implement serverless logic and event-driven architectures using Azure Functions and Azure Event Grid.
- Manage data storage and lifecycle within Azure Data Lake Storage.
- Monitor system health and performance using Azure Monitor and Azure Log Analytics.
- Orchestrate deployments and CI/CD processes via Azure DevOps.
Required Skills
- 5+ years of experience in data engineering roles.
- Proficiency in Python and R.
- Strong SQL skills including T-SQL and SQL stored procedures.
- Experience with SQL Server and Oracle/PL-SQL.
- Hands-on experience with Azure Service Bus.
- Direct experience with Azure Data Factory and Azure Databricks.
- Familiarity with Azure Data Lake Storage and Azure Functions.
- Ability to utilize Azure Log Analytics and Azure Monitor.
- Experience with Azure DevOps.
Preferred Skills
- Background in managing complex Oracle/PL-SQL environments.