Description

You will build and maintain the infrastructure and pipelines that power our data platform.

Responsibilities

• Design, develop, and maintain ETL pipelines using AWS and Apache Airflow to move data into Snowflake.
• Build and implement reusable Directed Acyclic Graphs (DAGs) in Airflow to orchestrate complex workflows, including dynamic DAG generation and parameterization.
• Optimize data pipelines for performance, scalability, and cost-effectiveness.
• Design and maintain CI/CD pipelines using Terraform, CloudFormation, and Jenkins to automate builds, tests, and deployments.
• Manage and optimize AWS infrastructure to ensure high availability and reliability.

Required Skills

• 6+ years of experience in data engineering or platform roles.
• Proficiency in Python and SQL.
• Hands-on experience with AWS services and infrastructure management.
• Strong experience with Apache Airflow, specifically designing and orchestrating DAGs.
• Deep understanding of Snowflake features including Snowpipes, SnowTasks, Dynamic Data Masking, Row Access Policies, Object Tagging, RBAC, and Streams.
• Experience with DevOps tools including Jenkins, Terraform, and CloudFormation.
• Ability to build frameworks for automated CI/CD deployments on Snowflake.
• Any Graduate degree.

Key Skills

Education

Any Graduate