Description

You will design, create, deploy, and manage the firm's data architecture, including database systems, data management, and data security.

Responsibilities

• Design and orchestrate ETL processes using Databricks, Spark, and PySpark.
• Manage end-to-end data architecture and deployment.
• Implement data security and management protocols across database systems.
• Strategize and implement end-to-end data solutions.

Required Skills

• 10+ years of relevant client experience in similar technology.
• At least 5 years of on-site client experience in a similar technology and domain.
• Databricks, Spark, and PySpark for ETL design and orchestration.
• Python proficiency.
• Cloud expertise.
• Bachelor’s degree in technology (Master’s preferred).
• AWS expertise including S3, EC2, and Lambda.
• Data Engineering skills for ETL pipeline design, scheduling, and orchestration.
• Data Governance knowledge covering Catalog Management, Metadata, Lineage, and Data Dictionary Automation.
• CI/CD experience with Iaas and Automated Testing.

Key Skills

Education

Any Graduate