Description

Design and maintain scalable big data infrastructures and ETL/ELT pipelines.

Responsibilities

• Design and implement scalable big data solutions and optimize data pipelines.
• Maintain existing big data infrastructures, ensuring data integrity and security.
• Collect, process, and visualize large datasets to derive actionable insights.
• Test and evaluate new big data technologies for system compatibility.
• Document technical solutions and maintain comprehensive records.

Required Skills

• 5+ years of professional experience in data engineering roles.
• Expert proficiency in Microsoft Fabric for data engineering creation.
• 3 years of experience implementing development and production workflows in Azure Data Factory and Databricks.
• 3 years of experience performing exploratory data analysis (EDA) to support ETL/ELT processes.
• 3 years of experience with cloud computing technologies, including IaaS, PaaS, and SaaS.
• 2 years of strong scripting experience in Python and SQL.
• Any Graduate degree.

Preferred Skills

• 2 years of experience with Delta Lake format and protocol.
• 1 year of experience with Data Lakehouse Medallion Architecture.
• 1 year of experience with Excel and Power BI.

Key Skills

Education

Any Graduate