Description

Lead a team of data engineers to design, develop, and maintain scalable data infrastructure and pipelines.

This role is on-site.

Responsibilities

• Lead and mentor data engineers to ensure successful project delivery and professional growth.
• Design and develop scalable ETL/ELT processes and data pipelines for data lakes and warehouses.
• Collaborate with data scientists, analysts, and product managers to translate business requirements into technical solutions.
• Implement data governance and quality frameworks to ensure data accuracy and compliance.
• Optimize data architecture and infrastructure to improve processing performance and reduce latency.

Required Skills

• 5+ years of experience in data engineering, specifically designing ETL processes and data warehousing solutions.
• Hands-on experience with Azure Data Factory, Data Lake, Azure Synapse, and Databricks.
• Proficiency in Python and PySpark for data manipulation using libraries like Pandas, Numpy, Matplotlib, Modin, Dask, and scikit-learn.
• Strong expertise in SQL and working with relational databases including MariaDB.
• Experience with NoSQL databases such as Mongo and Elasticsearch.
• Proven ability to manipulate and extract value from large, disconnected datasets.
• Experience with data extraction using third-party APIs.
• Ability to build data models and data marts for Power BI consumption.

Preferred Skills

• Bachelor's or Master's degree in Computer Science, IT, or a related field.

Key Skills

Education

Any Graduate