← Back to jobs

Avance Consulting Logo
Senior Databricks Data Engineer

Avance Consulting

 

Troy, MI, USA

Posted On: Just posted
Experience: 10+ years
Availability: Onsite
Openings: 1
Category: Senior Databricks Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

We are seeking an experienced Databricks Data Engineer with 10+ years of experience in data engineering, data governance, and lakehouse architecture. The candidate should have strong expertise in Databricks, PySpark, AWS integration, and enterprise data management.

Key Responsibilities

Design, develop, and maintain scalable data engineering solutions using the Databricks Lakehouse Platform.

Build ETL/ELT pipelines using PySpark, Python, and Spark SQL.

Implement data modeling, dimensional modeling, and data warehousing solutions.

Work with Delta Lake for data storage and processing.

Establish data governance, data quality, and data management practices.

Integrate Databricks with AWS services, including Amazon S3, AWS Glue, Lambda, CloudWatch, IAM, and VPC.

Implement Unity Catalog, MLflow, and Data Mesh/Data Products.

Support AI/ML and Generative AI initiatives.

Develop and maintain CI/CD pipelines and Infrastructure as Code practices.

Support analytics and reporting using Power BI or similar platforms.

Required Skills & Experience

10+ years of experience in Data Engineering and Data Governance.

Strong hands-on experience with Databricks, PySpark, Spark SQL, and Python.

Expertise in Delta Lake, ETL/ELT, data modeling, and data warehousing.

Experience with AWS services, including S3, IAM, Glue, Lambda, and CloudWatch.

Knowledge of Databricks on AWS and Unity Catalog.

Experience with MLflow, Data Mesh, and Data Products.

Exposure to AI/ML and Generative AI.

Knowledge of CI/CD and Infrastructure as Code concepts.

Experience with Power BI or similar analytics platforms.

Key Skills

Digital: Data Governance

Digital: Databricks

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs