Description
You will design, build, and maintain data solutions within a cloud environment.
Responsibilities
- Develop, test, and maintain data pipelines, ETL processes, and feature engineering pipelines using AWS services.
- Work with relational and NoSQL databases, including Snowflake, Redshift, and DB2.
- Troubleshoot and resolve complex ETL and SQL issues across Data Lake, Data Warehouse, and Data Mart environments.
- Analyze business requirements and propose technical solutions for data infrastructure.
- Implement and support feature stores.
Required Skills
- 5+ years of professional experience in a Data Engineering capacity.
- Strong proficiency in Python and SQL.
- Experience with Unix scripting and command-line operations.
- Familiarity with Data Lake and Data Warehouse architectures.
- Experience developing ETL/ELT processes.
- Knowledge of AWS services (Lambda, S3, Glue, Athena, etc.).
- Experience with CI/CD tools (GitHub, CodePipeline, CloudFormation).
- Proficiency in dimensional modeling.