Description
You will design, develop, and implement data warehouse architecture and solutions in collaboration with Data Science teams.
Responsibilities
- Develop, test, and maintain data pipelines, ETL processes, and feature engineering pipelines using AWS services.
- Work with databases including Snowflake, Redshift, and DB2, demonstrating proficiency in dimensional modeling.
- Implement and support feature stores and work with NoSQL databases.
- Utilize CI/CD tools for automated deployment and code management.
- Troubleshoot and resolve complex ETL and SQL issues across Data Lake, Data Warehouse, and Data Mart environments.
Required Skills
- 5+ years of professional experience in data engineering.
- Expertise in developing Data Pipelines and ETL Processes.
- Strong proficiency in SQL.
- Experience with cloud data warehousing technologies like Snowflake.
- Familiarity with database systems such as DB2.
- Knowledge of Python and Unix scripting for data manipulation.
- Experience with CI/CD tools (GitHub, GitHub Actions, CodePipeline, CloudFormation).
- Ability to analyze requirements and propose technical solutions.
- Any Graduate degree required.