Description

You will design and maintain data pipelines using Azure and Snowflake.

This role is on-site.

Responsibilities

• Build ETL/ELT processes using Prefect, Airflow, dbt, Spark, and Kafka.
• Manage Snowflake warehouses including Snowpipe, Tasks, and Streams.
• Develop solutions on Databricks with Delta formats, workflows, and cataloging.
• Onboard datasets to cloud platforms, handling storage, compute, security, and governance.
• Implement Git-based workflows, CI/CD, and containerization with Docker.

Required Skills

• 8+ years of professional data engineering experience.
• Hands-on experience with Snowflake, Databricks, and Spark.
• Proficiency in Airflow or Prefect for orchestration.
• Experience with dbt for data transformation.
• Knowledge of Kafka for streaming data.
• Familiarity with Azure data services (ADLS, ADF) and BigQuery.
• Strong Git-based workflow and Docker containerization skills.

Preferred Skills

• Kubernetes experience.

Key Skills

Education

Any Graduate