← Back to jobs

E-Solutions Logo
Databricks Engineer

E-Solutions

 

Phoenix, AZ, USA

Posted On: 1 day ago
Experience: 5+ years
Availability: Onsite
Openings: 1
Category: Databricks Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

You design and deliver end-to-end data engineering pipelines, including batch and real-time streaming solutions, on cloud-based lakehouse platforms.

This role is on-site.

Responsibilities

  • Develop scalable ETL/ELT pipelines using PySpark, Scala, and SQL.
  • Implement advanced data modeling, including 3NF, dimensional modeling, and enterprise data warehousing strategies.
  • Manage Unity Catalog for fine-grained security and access controls.
  • Drive CI/CD automation, deployment strategies, and DevOps best practices.
  • Optimize performance of pipelines, Spark jobs, and compute resources.

Required Skills

  • 5+ years of experience with Databricks and cloud-native storage/compute platforms.
  • Strong hands-on programming skills in Python, PySpark, Scala, and SQL.
  • Deep understanding of Delta Lake and Lakehouse architecture.
  • Experience with Apache Spark for both batch and streaming workloads.
  • Proficiency in implementing incremental data loading and metadata-driven ingestion.
  • Knowledge of data quality frameworks and governance standards.
  • Experience integrating with orchestration tools like Apache Airflow.

Preferred Skills

  • Experience with Delta Live Tables, Autoloader, and Structured Streaming.
  • Background in providing architectural guidance to cross-functional teams.

Education

Bachelor's degree

Related Jobs

No related jobs found

← Back to jobs