Description
You will design, develop, and maintain scalable data pipelines and infrastructure.
Responsibilities
- Build and automate data ingestion processes from databases and APIs into Snowflake.
- Design and maintain scalable data pipelines using Python and SQL.
- Implement data quality checks and monitoring processes to ensure integrity.
- Provision and manage cloud resources using Infrastructure as Code (IaC) tools like Terraform.
- Collaborate with data scientists and analysts to translate requirements into technical solutions.
Required Skills
- 5+ years of experience in data engineering.
- Proficiency in Python and SQL.
- Hands-on experience with Snowflake.
- Experience with cloud platforms including AWS, Azure, or GCP.
- Experience working with databases and APIs.
- Knowledge of Infrastructure as Code (IaC) and Terraform.
- Experience with Git and version control workflows.
Preferred Skills