Description

Lead the design and development of scalable data pipelines and business intelligence solutions.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks, Python, and SQL.
• Implement and optimize data models using Kimball dimensional modeling, including Slowly Changing Dimensions (SCD) and Snapshot Tables.
• Collaborate with data scientists and analysts to translate data requirements into high-quality technical solutions.
• Ensure data integrity through rigorous testing, validation, and monitoring of pipeline performance.
• Manage and optimize complex SQL queries and data processing workflows.

Required Skills

• 7+ years of experience in SQL with a focus on developing and optimizing complex queries.
• Extensive experience with Kimball dimensional modeling, SCD, and Snapshot Tables.
• Proficiency in Databricks, including hands-on work with SQL and Python notebooks.
• Strong experience with Python for data engineering and quality validation.
• Hands-on experience creating and managing reports and dashboards in Power BI.
• Proven ability to communicate complex technical concepts to non-technical stakeholders.
• Bachelor's degree or equivalent experience.

Preferred Skills

• Experience using Great Expectations for data quality and reliability.

Key Skills

Education

Any Graduate