Description

You will lead the design and implementation of data processes.

Responsibilities

• Design, develop, and implement ETL processes to move data from disparate sources for analytics consumption.
• Evaluate and resolve data quality, cleansing, integration, and migration issues, driving continuous improvement.
• Ensure project delivery has the necessary expectations, principles, structures, tools, and responsibilities defined.
• Analyze industry trends, such as cloud computing and distributed processing, to infer business impact.
• Provide technical expertise to maximize the efficiency and reliability of current data engineering processes.
• Collaborate with peers across engineering to develop leading data engineering solutions.

Required Skills

• 5+ years of experience in data engineering.
• In-depth knowledge and demonstrated use of ADF, Synapse PySpark, Spark Architecture, and Databricks.
• Experience designing and conducting research with recently developed technologies.
• Strong experience using complex technologies.
• Experience in ETL design and implementation.
• Familiarity with data modelling processes and standards.
• A degree in Engineering, IT, or Mathematics.

Key Skills

Education

Any Gradute