Description

You will lead the design and maintenance of scalable data architectures within the Azure ecosystem.

Responsibilities

• Design and develop scalable data pipelines using Azure Databricks and Azure Data Lake.
• Implement ETL processes and data integration workflows using Azure Data Factory.
• Develop and optimize data processing workflows using PySpark.
• Integrate and transform Bloomberg data to support specific business use cases.
• Monitor pipeline performance and ensure data quality across all storage solutions.
• Collaborate with data scientists and analysts to support data-driven decision-making.
• Assist with data visualization and dashboarding using Power BI.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Proficiency with Azure cloud services and Azure Data Lake.
• Hands-on experience with Azure Databricks.
• Strong expertise in Python and PySpark.
• Deep understanding of ETL processes and data integration.
• Experience managing and transforming complex data sources.
• Any Graduate degree.

Preferred Skills

• Experience with Bloomberg data acquisition and transformation.
• Familiarity with Power BI for data visualization.

Key Skills

Education

Any Graduate