Description

Key Responsibilities

• Design, develop, and implement scalable data solutions using Databricks and Microsoft Azure.
• Build and optimize data pipelines and data processing workflows using PySpark and Python.
• Develop complex SQL queries, transformations, and data models for analytical and operational requirements.
• Leverage Azure data services to build robust cloud-based data solutions.
• Work with stakeholders and technical teams to understand business and data requirements.
• Troubleshoot, optimize, and improve data pipelines and processing performance.
• Ensure data quality, reliability, scalability, and security across data solutions.
• Participate in architecture and technical design discussions.
• Provide technical leadership and mentorship to other team members.
• Follow best practices for cloud data engineering, CI/CD, monitoring, and deployment.

Required Skills & Experience

• Senior-level experience in data engineering, data solutions, or a related technical role.
• Strong experience designing and implementing data solutions.
• Expert-level Databricks experience.
• Strong expertise with Microsoft Azure Data Services.
• Advanced SQL skills.
• Strong Python programming experience.
• Strong hands-on experience with PySpark.
• Experience developing scalable and high-performance data pipelines.
• Strong understanding of cloud-based data architecture and data engineering principles.
• Excellent problem-solving and communication skills

Key Skills

Education

Bachelor's or Master's degrees