Description

You will design and build scalable data solutions on Snowflake and Databricks, supporting large-scale Teradata migration to modern cloud platforms. You will own the technical architecture for commercial, marketing, and finance data use cases, ensuring performance, cost efficiency, and regulatory compliance.

Responsibilities

• Design and develop scalable data pipelines and ETL/ELT processes on Snowflake and Databricks.
• Implement medallion architecture (Bronze/Silver/Gold) for batch and streaming data.
• Build CDC and streaming data integrations to support near real-time use cases.
• Support platform migration activities from Teradata, including validation and cutover.
• Optimize workloads for performance and cloud cost, leveraging Azure capabilities.

Required Skills

• 6–8 years of experience in data engineering or data platforms.
• Hands-on production experience with Snowflake and Databricks.
• Strong proficiency in Python and PySpark for data engineering.
• Advanced SQL skills, including complex queries and performance tuning.
• Experience implementing medallion architecture and layered data models.
• Practical experience with CDC and streaming technologies.
• Working experience with Azure as the underlying cloud platform.
• Experience with CI/CD, Git, and automated testing (e.g., PyTest).
• Background in financial services or regulated environments.

Preferred Skills

• Direct experience migrating from Teradata or legacy warehouses to cloud platforms.
• Hands-on use of Unity Catalog and/or Apache Iceberg.

Key Skills

Education

Any Graduate