Description

You will design, implement, and manage Azure cloud solutions and data pipelines.

This role is on-site.

Responsibilities

• Develop and maintain data pipelines using Databricks and PySpark for ingestion, processing, and analysis.
• Configure Azure Data Factory to orchestrate data workflows and ETL processes.
• Implement and optimize Azure Data Lake Storage for efficient data storage and retrieval.
• Collaborate with cross-functional teams to design and implement data warehouse solutions.
• Monitor, troubleshoot, and optimize data processes for performance and reliability.

Required Skills

• 10+ years of professional experience in data engineering.
• Proficiency in PySpark and Databricks.
• Hands-on experience with Azure Data Factory, Azure Data Lake Storage, and Azure Active Directory.
• Strong proficiency in Python and SQL.
• Experience with Snowflake and relational databases.
• Working knowledge of Git for version control and collaboration.
• Familiarity with data warehousing concepts and technologies.
• Bachelor's degree in Computer Science, Engineering, or a related field.

Preferred Skills

• Azure certifications such as Azure Administrator or Azure Data Engineer.

Key Skills

Education

Any Graduate