Description
You will design and implement scalable ETL/ELT pipelines and business intelligence solutions to support data-driven decision making.
Responsibilities
- Develop ETL/ELT orchestration and transformation pipelines to move data from Oracle, PostgreSQL, and Netezza into Snowflake and Salesforce.
- Build an ETL framework utilizing parallel processing to handle multiple source files simultaneously.
- Create data models and datamarts to support Power BI reports, dashboards, and complex data analysis using DAX.
- Implement data quality processes, error handling via AWS SNS, and automated archiving using Python and AWS Lambda.
- Manage data movement from AWS S3 using SQS and execute code migrations across development, QA, and production environments.
- Document technical processes, including mapping documents and Matillion runbooks, within Confluence.
Required Skills
- 5+ years of experience in ETL/ELT development.
- Proficiency with Snowflake Data Warehouse and Matillion.
- Hands-on experience with Oracle, PostgreSQL, and Netezza databases.
- Experience developing Power BI reports and dashboards.
- Knowledge of AWS services including Lambda, SNS, and SQS.
- Ability to write Python scripts for data processing and archiving.
- Experience working within Agile/Scrum methodologies.
- Bachelor’s degree in Computer Science.