← Back to jobs

Quantum Technologies LLC Logo
Azure Databricks Engineer

Quantum Technologies LLC

 

Dallas, TX, USA

Posted On: Just posted
Experience: 5+ years
Availability: Onsite
Openings: 2
Category: Azure Databricks Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Job Description:

We are looking for an experienced Azure Databricks Data Engineer with strong expertise in building scalable data engineering solutions using Azure cloud technologies and Databricks.

Key Responsibilities:

  • Design and develop scalable ETL/ELT data pipelines using Azure Databricks.
  • Build data transformation workflows using PySpark, Spark SQL, Python, and SQL.
  • Develop and manage pipelines using Azure Data Factory (ADF).
  • Implement data lakehouse solutions using ADLS Gen2 and Delta Lake.
  • Work with Delta Tables and Medallion Architecture (Bronze, Silver, Gold).
  • Optimize Spark jobs for performance and scalability.
  • Implement data governance and security using Unity Catalog.
  • Manage CI/CD pipelines using Azure DevOps and Git.

Required Skills:

  • Azure Databricks
  • PySpark, Apache Spark, Spark SQL
  • Python and SQL
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage Gen2 (ADLS)
  • Delta Lake / Delta Live Tables
  • ETL/ELT pipeline development
  • Spark performance optimization
  • Azure DevOps and CI/CD

Preferred Skills:

  • Unity Catalog and Databricks Workflows
  • Azure Synapse Analytics
  • Structured Streaming / Event Hubs
  • Terraform and Infrastructure as Code
  • RBAC and Managed Identities
  • Power BI

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs