Description

• Develop and maintain our data infrastructure, including data warehouses, data lakes, OneLake, and data pipelines.
• Design, build, and maintain data pipelines and workflows using Microsoft Fabric, Synapse Data Engineering, and Azure Data Factory (ADF).
• Work with other Data Engineers and stakeholders to understand their data needs and develop solutions to meet those needs.
• Develop and implement data quality assurance processes to ensure the accuracy and reliability of our data.
• Automate data processing tasks to improve efficiency, including CI/CD for Fabric deployments.
• Work with other Data Engineers to implement new data products and services.

What you know

• 5+ years of experience in data engineering.
• Experience with data modelling and data warehousing.
• Experience with data quality assurance.
• Experience with scripting languages, such as Python and SQL.
• Strong problem-solving and analytical skills.
• Experience with MSSQL, Fabric, Power BI, and Azure Data Factory (ADF) is highly desirable.
• Core Platform: Microsoft Fabric, OneLake, Synapse Data Engineering, Synapse Data Science
• Languages: Python (PySpark, pandas, NumPy, Scikit-Learn), SQL, Delta Lake
• Workflows: Fabric Notebooks, Data Factory Pipelines, CI/CD for Fabric (fabric-cicd)

Education:

• Bachelor’s degree in computer science, Information Systems, Engineering, Computer Applications, or related field

Key Skills

Education

Bachelor's degree