Description

Job Description

The Senior Data Engineer will design, develop, and optimize data solutions to support business processes and analytics within Investment Management. This role requires deep expertise in modern data engineering practices, cloud-native development, and advanced data transformation techniques. The engineer will work extensively with SQL, DBT, Snowflake, Azure Data Factory (ADF), Python, and job scheduling tools, while leveraging Azure Function Apps and Gen AI tools such as Cortex AI and GitHub Copilot for automation and productivity.

Requirements & Qualifications

• 10-12 years of hands-on experience in data engineering with strong coding skills.
• Proven expertise in: DBT, Python, Azure Data Factory (ADF), SQL, DBT, Snowflake.
• Expert in SQL and Python for developing and debugging scalable data pipelines.
• Experience with job schedulers and Azure Function Apps for automation.
• Familiarity with Gen AI tools (e.g., Cortex AI, GitHub Copilot) for accelerating development.
• Design and optimize API integration in pipelines.
• Advanced understanding of dimensional modeling and data warehousing concepts.
• Strong understanding of Git version control, CI/CD pipelines, DevSecOps, and Agile methodologies.
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Strong communication and stakeholder management skills.

Key Responsibilities

• Architect and implement scalable data pipelines and ETL workflows using ADF, DBT, and Python.
• Design and optimize data models for Snowflake and other cloud-based data platforms.
• Develop and maintain complex data transformation logic using SQL, DBT, Python, Snowpark, Snowsight web interface.
• Integrate job schedulers with Azure Data Factory pipelines and Azure Function Apps for orchestration and automation.
• Apply Gen AI tools (GitHub Copilot Agent Skills, Snowflake Cortex AI) to accelerate development, improve code quality, and enhance productivity.
• Ensure robust data governance, security, and compliance across all solutions.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Mentor junior engineers and provide technical leadership in data engineering best practices.
• Participate in Scrum ceremonies and contribute to continuous improvement initiatives through strong ownership and collaboration

Key Skills

Education

Any Graduate