Description

You will build and optimize scalable data pipelines for warehousing and visualization projects.

This role is hybrid.

Responsibilities

• Build and optimize scalable data pipelines using PySpark (Spark SQL, DataFrames, and Datasets).
• Develop and manage workflows within Azure Databricks, including scripting in Python.
• Model data for Data Warehousing and Visualization projects using Semantic Layers.
• Write complex SQL queries and build views across multiple tables.

Required Skills

• 5+ years of hands-on software development experience with a strong emphasis on Python.
• Deep expertise in PySpark, including Spark SQL, DataFrames, and Datasets.
• Solid experience with Azure Databricks (Unity Catalog), Delta tables, and Python scripting.
• Proficiency in writing complex SQL queries and designing data warehouse models.
• Familiarity with Azure cloud services such as Azure Data Lake and Azure Data Factory.
• Experience with data governance, security, and compliance in cloud environments.
• Proficiency with Power BI, including DAX and Power Query.

Preferred Skills

• Experience with project management tools like Jira and documentation tools like Confluence.
• Familiarity with CI/CD pipelines.

Key Skills

Education

Any Gradute