Description

You will design, implement, and maintain end-to-end ELT pipelines that extract data from various sources and load it into data warehouses or lakes.

Responsibilities

• Design, implement, and maintain end-to-end ELT pipelines extracting data from various sources into data warehouses or lakes.
• Develop and maintain data models, schemas, and storage solutions using tools like dbt to prepare data for analysis.
• Build and manage integrations with internal and external data sources and APIs.
• Implement data validation, quality checks, and security controls to ensure data accuracy and compliance.
• Monitor scheduled jobs, investigate failures, and debug issues arising during the ETL process.

Required Skills

• 10+ years of professional experience in data engineering or related fields.
• 5+ years in an ETL/ELT development role using industry-recognized tools.
• 2+ years developing and supporting a cloud-based data platform, specifically Snowflake.
• Strong SQL programming knowledge, including stored procedures, triggers, functions, and error trapping.
• Experience with AWS Lambda functions and data pipeline development.
• Demonstrated proficiency in developing and supporting ETL and ELT processes.
• Experience building self-service reporting solutions using BI tools like OBIEE, Looker, or Power BI.
• Familiarity with data warehousing concepts, including Snowflake and BigQuery.
• Experience implementing Change Data Capture (CDC).

Key Skills

Education

Any Graduate