You will design and maintain data architectures to support production analytics and machine learning workflows.
Responsibilities
- Design and implement ETL processes for data transformation and preparation.
- Manage data pipelines for analytics and operational use.
- Deploy machine learning models into production environments.
- Ensure data accuracy and integrity across multiple sources and systems.
- Collaborate with data scientists to support data algorithms and analytics.
Required Skills
- 8+ years of experience in data engineering within a production environment.
- Advanced proficiency in Python and shell scripting.
- Extensive experience with MSSQL databases and SQL scripting.
- Hands-on experience with SQL/NoSQL databases including Redshift, Postgres, and MongoDB.
- Experience using ADF and Power BI within the Azure platform.
- Familiarity with stream processing systems using Kafka.
- Knowledge of Snowflake and Databricks.
- Experience with SQL database administration tasks.
- Background in Airline Industry functionality.
Preferred Skills
- Project management experience.
- Strong problem-solving and technical communication skills.