You will design and implement enterprise-scale data platforms and AI/ML solutions for financial analytics.
This role is on-site.
Responsibilities
Build and optimize high-volume data ingestion, transformation, and analytics pipelines using Snowflake, Databricks, and PySpark.
Develop and maintain scalable ETL/ELT frameworks using dbt, DataStage, and cloud-native technologies.
Design and implement AI/ML and GenAI solutions, including RAG architectures, vector databases, and LLM integrations.
Implement robust data quality, observability, and governance controls to ensure compliance and reliability.
Lead technical design discussions, mentor junior engineers, and collaborate with business stakeholders to translate requirements into scalable solutions.
Required Skills
8+ years of Data Engineering experience, preferably within Wealth Management or Financial Institutions.
Strong expertise with Snowflake, Databricks, Apache Spark, and PySpark.
Advanced Python development for data pipelines, API integrations, and automation.
Deep SQL expertise including performance tuning, data modeling, and warehousing.
Experience with AWS services (S3, Lambda, SNS, IAM) and cloud data architectures.
Hands-on experience with Kafka, Kinesis, Snowpipe, and real-time data ingestion.
Proficiency with Airflow, CI/CD pipelines, Terraform, Kubernetes, and Docker.
Knowledge of GenAI, RAG, Vector Databases, LangChain, and document intelligence.
Preferred Skills
Experience with legacy SAS/DataStage to Spark/cloud migration and exposure to Redshift, Aurora, or DB2.
Familiarity with enterprise reporting platforms like Power BI, QuickSight, or Tableau.
MBA or advanced degree in Data Science, Engineering, or related field.