You will manage and optimize data pipelines and ETL processes to ensure data integrity and availability across enterprise systems.
Responsibilities
- Monitor, triage, and support data pipelines and ETL tasks to ensure secure and performant data movement and transformation.
- Develop high-performance SQL scripts and stored procedures for data manipulation, ad-hoc reporting, and ETL batch triage.
- Identify and resolve recurring data quality, availability, and root cause issues through deep data analysis.
- Design, prepare, and execute unit tests while documenting technical requirements and system specifications.
- Profile code, queries, and programming objects to optimize performance within complex data environments.
Required Skills
- 4+ years of experience in SQL, including writing complex logic for ETL and performing data discovery.
- 2+ years of Microsoft SSIS package development experience using Microsoft Visual Studio.
- 2+ years of experience working with enterprise data warehouses.
- Proficiency with CMD shell and PowerShell.
- Experience troubleshooting and resolving ETL issues in large-scale, complex data environments.
- Exposure to Azure and Azure Data Factory.
- Exposure to an Enterprise Data Lake.
- Ability to analyze data patterns to identify and solve technical issues.
- Strong communication skills for expressing complex technical concepts to both business and technical stakeholders.
Preferred Skills