Description

You will lead data engineering efforts within the AI & Automation team to enhance automation and deliver data-driven insights.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT processes.
• Architect and optimize data storage solutions for reliability, security, and scalability.
• Leverage generative AI tools and models to automate data engineering workflows.
• Collaborate with data scientists and analysts to deliver on specific data requirements.
• Develop and enforce data quality standards, governance policies, and monitoring systems.

Required Skills

• 5–8 years of experience in data engineering and managing large-scale data systems.
• Proficiency in SQL and Python.
• Experience with NoSQL databases such as MongoDB, Cassandra, or CosmosDB.
• Hands-on experience with one of the following: Snowflake, Redshift, BigQuery, or Microsoft Fabric.
• Experience implementing generative AI tools and models in production workflows.
• Competency with data processing frameworks like Pandas or PySpark.
• Experience with orchestration tools such as Apache Airflow, MS Fabric, Informatica, or Talend.
• Strong understanding of data architecture, data modeling, and data governance.
• Experience with Azure and associated cloud data services.
• Knowledge of version control using Git.

Preferred Skills

• Experience mentoring junior team members and leading technical projects.

Key Skills

Education

Any Graduate