Description

You will lead the design and delivery of production data integration pipelines.

Responsibilities

• Deliver data pipelines with lead-level ownership, specifically within Retail Wealth domains (custodians, broker dealers, warehouses/family offices).
• Design and implement ELT/ETL patterns for order/trade and position/transaction data.
• Orchestrate batch processes using tools like Airflow or Databricks Jobs.
• Manage data governance requirements, including lineage, Data Quality, PII controls, encryption, and RBAC, adhering to FINRA/SEC regulations.
• Plan and execute Snowflake migrations, focusing on data modeling, performance tuning, and cost management.

Required Skills

• 7+ years of experience in data engineering delivering production pipelines.
• Expertise with Kafka, including topics, partitions, and schema/registry management.
• Proficiency in PySpark/Spark SQL within Databricks environments.
• Hands-on experience with the AWS data stack.
• Strong SQL skills with demonstrated ability in performance tuning.
• Experience with Oracle data sources.
• Familiarity with data governance practices (lineage, DQ, PII).

Key Skills

Education

Any Graduate