Description

You will design and maintain data architectures to support production analytics and machine learning workflows.

Responsibilities

• Design and implement ETL processes for data transformation and preparation.
• Manage data pipelines for analytics and operational use.
• Deploy machine learning models into production environments.
• Ensure data accuracy and integrity across multiple sources and systems.
• Collaborate with data scientists to support data algorithms and analytics.

Required Skills

• 8+ years of experience in data engineering within a production environment.
• Advanced proficiency in Python and shell scripting.
• Extensive experience with MSSQL databases and SQL scripting.
• Hands-on experience with SQL/NoSQL databases including Redshift, Postgres, and MongoDB.
• Experience using ADF and Power BI within the Azure platform.
• Familiarity with stream processing systems using Kafka.
• Knowledge of Snowflake and Databricks.
• Experience with SQL database administration tasks.
• Background in Airline Industry functionality.

Preferred Skills

• Project management experience.
• Strong problem-solving and technical communication skills.

Key Skills

Education

Any Gradute