Description

Lead technical implementations and design Databricks-based solutions to meet client requirements.

Responsibilities

• Design, develop, and implement data pipelines and ETL processes within Databricks environments.
• Optimize and tune Databricks clusters for performance and scalability.
• Lead technical implementations and provide mentorship and guidance to team members.
• Collaborate with data engineers and scientists to integrate data sources and build analytical solutions.
• Implement data security and governance best practices while monitoring jobs for performance bottlenecks.

Required Skills

• 8+ years of experience in technical architecture or similar roles.
• Deep knowledge of Databricks architecture and development.
• Proficiency in Scala or Java.
• Experience with cloud platforms including AWS or Azure.
• Bachelor's degree in Computer Science.
• Proven ability to conduct code reviews and troubleshoot complex technical issues.

Preferred Skills

• Databricks certification or related technology certifications.

Key Skills

Education

Bachelor's degree in Computer Science