Description

You will manage and optimize data pipelines and orchestration workflows within an AWS environment.

Responsibilities

• Build and maintain optimized ETL pipelines using Databricks and Snowflake.
• Manage automated workflow scheduling and orchestration via Apache Airflow.
• Deploy and manage CI/CD pipelines using GitHub or Jenkins.
• Implement data acquisition and transformation processes using Fivetran and DBT.

Required Skills

• 4+ years of experience in data operations or engineering.
• Proficiency with AWS, including container and serverless technologies.
• Hands-on experience with Snowflake, DBT, and Redshift.
• Experience with Apache Airflow for workflow orchestration.
• Working knowledge of Python, Ruby, and JavaScript.
• Experience with Linux and MongoDB.
• Background in data acquisition tools like Fivetran.
• Experience with BI platforms such as Looker or Tableau.

Preferred Skills

• Familiarity with data observability platforms like Monte Carlo or Acceldata.
• Experience with API services and Apache.

Key Skills

Education

Any gradudate