Description

You will lead the design, development, and support of ETL processes and big data architectures.

Responsibilities

• Design, develop, test, and optimize ETL code, stored procedures, and data models for big data environments.
• Translate source-to-target mapping documents into functional ETL processes using Talend and Azure Data Factory.
• Build and integrate APIs and deploy machine learning solutions in the cloud.
• Administer and maintain Azure and MS SQL Server databases and Microsoft Enterprise Data Warehouses.
• Lead, train, and support team members engaged in data engineering functions.

Required Skills

• Bachelor’s Degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in ETL development using Talend or Airflow.
• 5+ years of experience developing SQL queries, stored procedures, and views.
• 3+ years of experience coding in Python.
• 3+ years of experience in database administration.
• 3+ years of experience working with cloud solutions.
• Experience developing Spark jobs in Scala or Java.
• Proficiency in designing and implementing ETL processes within an Agile, CI/CD, and DevOps environment.

Preferred Skills

• 3+ years of experience with Azure Databricks or cloud data warehouses like Snowflake or Redshift.
• Azure Data Factory certifications or advanced Azure certifications (Azure ML).

Key Skills

Education

Not specified