You will own the design, development, and optimization of ETL workflows and data pipelines.
Responsibilities
- Design, develop, and optimize ETL workflows and data pipelines using Snowflake and AWS services.
- Implement data ingestion from APIs, databases, and flat files.
- Ensure data quality, integrity, and consistency across all ETL processes.
- Monitor and troubleshoot ETL jobs and performance issues.
- Automate data workflows and implement CI/CD practices for data pipeline deployment.
Required Skills
- 9+ years of experience in ETL development and data engineering.
- Hands-on experience with Snowflake, including data modeling and SQL scripting.
- Proficiency in AWS services such as S3, Lambda, Glue, Redshift, and CloudWatch.
- Strong programming skills in Python or Scala for data processing.
- Experience with orchestration tools like Apache Airflow or AWS Step Functions.
- Familiarity with version control systems (e.g., Git) and CI/CD pipelines.
- Bachelor's degree in Computer Science or related field.