Description

You will design, develop, and deploy data products while improving the underlying technologies. You own the end-to-end delivery of scalable data solutions.

Responsibilities

• Design and develop Azure Data Platforms in collaboration with Product Owners and Architects.
• Implement functional, security, integration, performance, and operational requirements.
• Assess and transform data from various corporate sources, including structured, semi-structured, and unstructured formats.
• Build and maintain effective BI data models aligned with the BUS-Matrix.
• Provide technical guidance to the team on complex engineering issues.

Required Skills

• 3 to 6 years of experience managing, designing, and maintaining large-scale data solutions.
• Proficiency in Python, Spark, and Scala for data engineering tasks.
• Hands-on experience designing and developing ETL/ELT pipelines, including ingestion, transformation, schematization, and orchestration.
• Expertise in both batch and real-time data ingestion processes.
• Strong SQL skills for writing complex queries.
• Experience with the Hadoop ecosystem and cloud or on-premise data engineering.
• Experience with Unix Shell scripting and scripting languages for custom APIs.
• Familiarity with DevOps CI/CD pipeline development and deployment.

Preferred Skills

• Hands-on experience with Azure Databricks pipeline development.
• Experience with Azure Data Factory, Azure SQL DW/Synapse, and PySpark.

Key Skills

Education

Any Graduate