Description

You will design, deploy, and manage the firm's data architecture, including database systems, ETL processes, and security protocols.

This role is on-site.

Responsibilities

• Design and orchestrate ETL processes using Databricks, Spark, and PySpark.
• Manage end-to-end data architecture and deployment lifecycle.
• Implement data security and management protocols across database systems.
• Strategize and implement end-to-end data solutions.

Required Skills

• 10+ years of relevant client experience in data architecture or similar technology.
• At least 5 years of on-site client experience in a similar technology and domain.
• Proficiency in Databricks, Spark, and PySpark for ETL design and orchestration.
• Strong Python proficiency.
• AWS expertise including S3, EC2, and Lambda.
• Data Engineering skills for ETL pipeline design, scheduling, and orchestration.
• Knowledge of Data Governance: Catalog Management, Metadata, Lineage, and Data Dictionary Automation.
• CI/CD experience with Iaas and Automated Testing.

Preferred Skills

• Master’s degree in technology.

Key Skills

Education

Any Graduate