Description

Architect secure, scalable, cloud-native data platforms on AWS using Databricks for banking and capital markets workloads.

This role is remote.

Responsibilities

• Design end-to-end AWS and Databricks data lakehouse architectures for financial services.
• Lead cloud migration strategies, defining re-platform and re-architect patterns.
• Implement CI/CD pipelines and Infrastructure as Code (Terraform) for automated provisioning.
• Build and optimize Delta Lake ETL/ELT pipelines for batch and real-time processing.
• Ensure platforms meet regulatory compliance, security controls, and audit requirements.

Required Skills

• 10+ years of experience in cloud architecture and data engineering.
• Expertise in AWS services: VPC, IAM, KMS, networking, and security.
• Deep experience with Databricks platform, including clusters, jobs, and notebooks.
• Proficiency in Delta Lake, ETL/ELT pipeline design, and performance optimization.
• Strong command of CI/CD tools and Infrastructure as Code (Terraform or CloudFormation).
• Understanding of banking, investment, or capital markets data use cases and governance.

Preferred Skills

• Databricks or AWS Solutions Architect/Data certifications.
• Experience with MLflow and advanced Databricks features.
• Multi-cloud exposure (Azure or GCP).

Key Skills

Education

Any Graduate