← Back to jobs

Diverse Lynx Logo
Data Engineer - Databricks, Scala

Diverse Lynx

 

Quincy, MA, USA

Posted On: Just posted
Experience: 8+ years
Availability: Onsite
Openings: 1
Category: Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

Must have atleast 8+ years of extensive Data engineering experience in Databricks, ETL/ELT using data pipelines, SQL/Procesurr experience
Must have 8 years of hands on development proficiency in implementing Databricks solutions using scala and spark with data frames and notebooks/sql
Must have 8+ years of hands on development and performance tuning/ enhancement experience in scala/pyspark and sql
Must have strong experience with Databricks, including developing and Eligible to workimizing spark jobs, data transformations, and data processing workflows
Must have experience and a good understanding on the below topics:

  • Databricks delta lake storage
  • Unity catalog
  • Autoloader
  • Lakehouse architecture
  • Medallion architecture
  • Databricks serverless Eligible to workions
  • Dataset and data frame
  • Databricks clusters configuration and sizing
  • Databricks job orchestration
  • Spark structured streaming

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs