Data Engineer

You will lead Snowflake implementations and manage high-volume data pipelines within the banking sector.

Responsibilities

• Lead Snowflake implementations, optimizations, and performance tuning.
• Process real-time data from AWS S3 data lakes and COBOL mainframe sources.
• Convert JCJ code to Python-based ETL processes.
• Build and manage APIs using Python/PySpark integrated with Snowflake and cloud environments.
• Deploy infrastructure as code and manage code through CI/CD pipelines.

Required Skills

• 4+ years of experience with AWS services (S3, Glue, Lambda) or Azure services (Blob Storage, ADLS gen2, ADF).
• Expertise in Snowflake features including Snowpipe, Bulk Copy, Tasks, Streams, Stored Procedures, and UDFs.
• Proficiency in Python and PySpark.
• Experience with AWS Glue ETL or AWS Lake Formation.
• Hands-on experience with Snowpark for data processing.
• Infrastructure as Code (IaC) experience using Terraform or equivalent.
• Version control and CI/CD experience using GitLab or GitHub.
• Experience with API development.
• Background in Finance and Treasury projects.

Preferred Skills

• Experience transforming COBOL data sources.