← Back to jobs

Appridat Solutions LLC Logo
Senior Databricks Engineer

Appridat Solutions LLC

 

Weehawken, New Jersey, USA

Posted On: 30+ days ago
Experience: 10+ years
Availability: Hybrid
Openings: 1
Category: Senior Databricks Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will design and implement enterprise data warehouse solutions within a large-scale cloud environment, focusing on investment banking systems.

Responsibilities

  • Develop frameworks to load and transform data using data vault modeling for daily reporting.
  • Build and optimize big data pipelines, architectures, and datasets using Spark and Databricks.
  • Implement batch and streaming solutions with Delta Lake and Lakehouse architectures.
  • Apply DevOps practices including CI/CD pipelines, test automation, and micro-services.
  • Perform performance tuning and quality improvements on large-scale systems.

Required Skills

  • 15+ years of total IT experience with at least 10 years in large global teams.
  • 8+ years of experience in the investment banking domain.
  • Expertise in Databricks and Spark using Python or Scala.
  • Extensive experience with Microsoft Azure, including ADLS Gen2.
  • Hands-on experience with Azure Data Factory and Cosmos DB.
  • Proficiency with Kafka and Event Hubs.
  • Strong understanding of Algorithms and Data Structures.
  • Experience with Infrastructure-as-Code using Terraform, ARM, Bicep, or CloudFormation.
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical discipline.

Preferred Skills

  • Additional experience in finance or banking sectors.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs