Description

You will design, implement, and maintain scalable big data infrastructure and end-to-end data solutions.

Responsibilities

• Design and implement scalable big data solutions and optimize ETL/ELT data pipelines.
• Maintain and enhance existing big data infrastructures to meet specific requirements.
• Collect, store, process, and analyze large datasets to derive actionable insights.
• Test and evaluate new big data frameworks for compatibility with existing systems.
• Ensure data integrity and security across all platforms while documenting technical solutions.

Required Skills

• 5+ years of experience in big data engineering.
• Proficiency in Python and SQL scripting.
• Experience with Microsoft Azure, including Data Factory and Databricks.
• Strong understanding of cloud computing models including IaaS, PaaS, and SaaS.
• Skilled in exploratory data analysis (EDA) to support data processing.
• Experience with Microsoft Fabric.
• Any Graduate degree.

Preferred Skills

• Proficiency with Power BI, Excel, and data visualization tools.
• Familiarity with Delta Lake and Lakehouse Medallion Architecture.

Key Skills

Education

Any Graduate