Description

You will design, build, and support data transformation solutions to deliver production-ready datasets to product owners and users.

Responsibilities

• Design, construct, deploy, and test applications to transform data using Python and Azure Data Factory.
• Develop and support data integration via APIs, cloud storage, and SFTP.
• Provide data analysis of internal and external sources for delivery to end-user solutions.
• Enable Power BI users by delivering data through dataflows and datasets.
• Automate processes to improve efficiency and ensure applications adhere to compliance standards.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Intermediate to advanced proficiency in Python for data manipulation and scripting.
• Experience with Spark and Azure Databricks.
• Hands-on experience with Azure Data Factory Pipelines.
• Proficiency in SQL and scripting languages like PowerShell or M-Query.
• Experience with C# and systems programming.
• Working knowledge of DevOps and Agile development principles.
• Ability to take technical ownership of requirements and collaborate with Business Analysts and Project Managers.

Preferred Skills

• Experience with Azure Data Lake Storage and Notebooks like Jupyter.
• Knowledge of MDX, DAX, and Windows batch commands.
• Degree in Computer Science, Statistics, Mathematics, or a related quantitative field.

Key Skills

Education

Any Graduate