Description

You will build, manage, and optimize scalable data pipelines and cloud-based platforms to support business intelligence and analytics.

Responsibilities

• Design, develop, and maintain scalable data pipelines for processing large datasets.
• Build cloud-based data platforms using MS Azure services including Data Lake Storage, Data Factory, Databricks, and Azure Synapse Analytics.
• Manage and optimize data storage solutions to ensure efficient access for analytics and reporting.
• Design and manage ETL processes to ensure efficient extraction, transformation, and loading of data.
• Develop data models and implement data mining techniques to support segmentation and analytics.

Required Skills

• 10+ years of experience in Data Engineering or similar roles focused on data processing and storage.
• Hands-on experience with MS Azure services: Data Lake Storage, Data Factory, Databricks, HDInsight, Azure SQL Database, Azure Synapse Analytics, and Azure Functions.
• Proficiency in SQL for database design and development.
• Strong programming skills in Python, Java, Scala, R, and .NET/C#.
• Deep understanding of ETL processes and data integration techniques.
• Expertise in data modeling, data mining, and analytics.
• Bachelor’s degree in Computer Science, IT, or a related field.

Preferred Skills

• Master’s degree in a related field.
• Experience with Django or similar web frameworks.

Key Skills

Education

Any Graduate