Description

You will design and maintain data architectures to support production analytics and machine learning workflows.

Responsibilities

  • Design and implement ETL processes for data transformation and preparation.
  • Manage data pipelines for analytics and operational use.
  • Deploy machine learning models into production environments.
  • Ensure data accuracy and integrity across multiple sources and systems.
  • Collaborate with data scientists to support data algorithms and analytics.

Required Skills

  • 8+ years of experience in data engineering within a production environment.
  • Advanced proficiency in Python and shell scripting.
  • Extensive experience with MSSQL databases and SQL scripting.
  • Hands-on experience with SQL/NoSQL databases including Redshift, Postgres, and MongoDB.
  • Experience using ADF and Power BI within the Azure platform.
  • Familiarity with stream processing systems using Kafka.
  • Knowledge of Snowflake and Databricks.
  • Experience with SQL database administration tasks.
  • Background in Airline Industry functionality.

Preferred Skills

  • Project management experience.
  • Strong problem-solving and technical communication skills.

Education

Any Gradute