← Back to jobs

Quantum Technologies LLC Logo
Databricks Integration Engineer

Quantum Technologies LLC

 

Boston, MA, USA

Posted On: Just posted
Experience: 12+ years
Availability: Onsite
Openings: 1
Category: Integration Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Job Description:
We are seeking an experienced Databricks expert to design and deliver scalable, secure data and AI platforms on the Databricks Lakehouse. The role will define the target architecture, establish engineering standards, and guide the implementation of data ingestion, transformation, governance, performance optimization, and production operations.
 
Key Responsibilities:
•    Design scalable and secure Databricks Lakehouse architectures.
•    Define target architecture, engineering standards, and reusable frameworks.
•    Lead data ingestion, transformation, governance, and production operations.
•    Conduct architecture reviews and technology evaluations.
•    Drive performance and cost optimization across the platform.
•    Establish CI/CD, monitoring, and operational best practices.
•    Partner with client stakeholders, data engineers, analysts, security teams, and vendors to translate business requirements into technical solutions.
•    Provide technical leadership and mentoring to engineering teams.

Required Skills:
•    12-15 years of overall experience in data engineering, integration, or cloud/data architecture.
•    Strong hands-on expertise with Databricks and cloud architecture.
•    Strong knowledge of Apache Spark, Delta Lake, Unity Catalog, SQL, and Python.
•    Experience designing enterprise-scale data and AI platforms.
•    Strong understanding of data governance, security, performance tuning, and cost optimization.
•    Experience with CI/CD and production monitoring.
•    Excellent communication and stakeholder-management skills.

Preferred Skills:
•    Exposure to Generative AI (GenAI) solution patterns.
•    Understanding of enterprise architecture principles and standards

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs