Description

You will build and manage end-to-end data solutions within the Azure ecosystem.

Responsibilities

• Design and implement data lakes, data warehouses, and data pipelines on Azure.
• Build and optimize high-performance pipelines using Azure Databricks, PySpark, and Python to process large datasets.
• Implement data modeling techniques and design warehousing solutions for BI and analytics.
• Integrate data across systems using Azure Fabric to ensure consistency and accessibility.
• Develop Azure Semantic Models and SQL Cubes for multidimensional analysis and self-service exploration.
• Maintain data quality and integrity through validation rules, cleansing processes, and governance best practices.
• Optimize pipelines and queries for scalability, performance, and cost-effectiveness.
• Document data flow diagrams, data models, and ETL specifications.

Required Skills

• 5+ years of experience in data engineering roles.
• Extensive hands-on experience with Azure Databricks for large-scale processing.
• Proficiency in PySpark, Spark, and Python for data transformation and analysis.
• Experience implementing Data Lakes on Azure.
• Experience using Azure Fabric for data integration and management.
• Experience working with SQL Cubes.
• Strong SQL skills, including complex queries and stored procedures.
• Solid understanding of data warehousing, data modeling, and ETL processes.
• Ability to work independently in a remote environment adhering to PST working hours.

Key Skills

Education

Any Graduate