Description

You will design and implement data pipelines within the Azure ecosystem.

Responsibilities

• Develop scalable applications to extract, transform, and load data across various formats.
• Build and maintain data pipelines using Azure Data Factory and Azure Databricks.
• Migrate data between complex systems and storage locations.
• Collaborate with engineering and product teams to understand and map complex data systems.
• Load processed data into SQL Server, Hadoop Data Lake, or other storage environments.

Required Skills

• 8-10 years of hands-on experience in data engineering.
• Expertise in Azure Data Factory.
• Strong development experience with Azure Databricks and PySpark.
• Proven experience executing data migration projects.
• Proficiency with SQL Server.
• Experience working with Hadoop environments.
• Ability to work with diverse data storage locations and formats.
• Bachelor's degree in any field.

Key Skills

Education

Any Gradute