Description

You will design and maintain data pipeline architectures to transform and organize raw information from multiple sources.

Responsibilities

• Build and manage processes for data transformation, metadata, dependency, and workload management.
• Identify and implement process improvements, including automating manual tasks and optimizing data delivery for scalability.
• Perform root cause analysis on internal and external data to resolve technical issues and identify improvements.
• Collaborate with data, design, product, and executive stakeholders to solve data-related technical problems.
• Analyze raw data and write pseudo code to enhance data quality and reliability.

Required Skills

• 5+ years of experience in a Data Engineering role.
• Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or a quantitative field.
• Advanced SQL knowledge with experience in query authoring and relational databases.
• Proficiency in Databricks on Azure.
• Experience with PySpark and SparkSQL.
• Hands-on experience with Azure/ADLS.
• Strong numerical and analytical skills.
• Experience working with cross-functional teams.

Preferred Skills

• Data engineering or Azure certifications.

Key Skills

Education

Any Graduate