Description

You will serve as a technical lead and primary point of contact for product owners and business sponsors within a cloud-based Data/AI environment.

Responsibilities

• Lead technical design meetings, architecture decisions, and technical breakdowns for data projects.
• Design and implement batch and real-time data ingestion pipelines and transformation workflows.
• Manage technical debt and mentor junior data engineers to guide their professional development.
• Optimize data storage, schemas, and processing tasks for speed, cost efficiency, and scalability.
• Collaborate with data scientists, analysts, and platform engineers to deploy machine learning models and ensure data quality.

Required Skills

• 5+ years of experience in a data engineering role within large corporate organizations.
• Engineering Master's degree or PhD.
• Expertise in Databricks and PySpark for big data processing.
• Proficiency with DBT for data transformation.
• Hands-on experience with Azure Data Factory for pipeline management.
• Experience managing Azure Data Lake Storage and Blob Storage.
• Strong ability to design database schemas, partitioning, and indexing strategies.
• Experience implementing role-based access controls and data encryption.
• Proven ability to document complex data pipelines and technical workflows.

Preferred Skills

• Experience working within a cloud ecosystem specifically focused on Data/AI integration.

Key Skills

Education

Engineering Master's degree