Description

You will build and maintain scalable data pipelines and storage solutions within the Azure ecosystem.

Responsibilities

• Develop and maintain scalable data pipelines using Azure Databricks.
• Design and implement data modeling, data warehousing, and data lakes.
• Build interactive dashboards and reports using PowerBI.
• Write SQL queries and scripts for data manipulation and retrieval.
• Optimize data processing performance and ensure data quality across multiple sources.

Required Skills

• 5+ years of experience in data engineering roles.
• Proficiency with PySpark and Apache Spark core components.
• Experience with Spark DataFrame, Spark Streaming, and Spark SQL optimization.
• Strong SQL skills, including DQL, DML, and DDL.
• Experience with SQL Server database management.
• Proficiency in PowerBI, including DAX and PowerQuery for data transformation.
• Knowledge of Databricks Unity Catalog.
• Experience using Azure DevOps.
• Background in data visualization techniques.

Key Skills

Education

Any gradudate