Description

Key Skills: Databricks SQL, Delta Lake, PySpark, Data Processing, Data Analytics, Property & Casualty Insurance, SQL, Python, Data Management, ETL

Good to Have Skills: Databricks Workflows, data architecture design, performance optimization, code review practices, technical troubleshooting, stakeholder collaboration, documentation skills, industry trend awareness, data validation and monitoring processes, Databricks Certified Data Engineer Associate certification, PySpark Certification.

Roles & Responsibilities:

• Develop and implement data solutions using Databricks SQL and Delta Lake to optimize data processing and storage.
• Collaborate with cross-functional teams to design and execute Databricks Workflows that streamline data operations.
• Utilize PySpark to enhance data analytics capabilities and support complex data transformations.
• Analyze and interpret data within the Property & Casualty Insurance domain to provide actionable insights.
• Ensure data integrity and accuracy by implementing robust validation and monitoring processes.
• Contribute to the development of scalable data architectures that support business objectives.
• Participate in code reviews and provide constructive feedback to improve code quality.
• Troubleshoot and resolve technical issues related to Databricks and PySpark implementations.
• Stay updated with industry trends and emerging technologies to continuously improve solutions.
• Document technical specifications and maintain comprehensive records of data processes.
• Collaborate with stakeholders to understand requirements and deliver solutions that meet business needs.
• Optimize performance of data workflows to ensure efficient processing and timely delivery of insights.
• Support the team in achieving project milestones and deliverables through effective communication and collaboration.

Experience Required: Strong experience in Databricks SQL, Delta Lake, and Workflows with proficiency in data management. Solid understanding of PySpark and its application in data processing and analytics. Domain expertise in Property & Casualty Insurance enabling insightful data analysis. Excellent problem-solving skills and ability to troubleshoot complex technical issues

Key Skills

Education

Any Graduate