Description

You will lead the design, development, and management of complex ETL processes and big data architectures. You will own the release pipeline, optimize data movement, and guide the engineering team.

Responsibilities

• Design, develop, test, and optimize ETL code and stored procedures for data warehousing.
• Lead, train, and support team members in data engineering functions.
• Translate source-to-target mapping documents into functional ETL processes and APIs.
• Build and integrate Spark jobs using Scala or Java.
• Deploy machine learning solutions in the cloud and orchestrate jobs within Azure Databricks or Snowflake.

Required Skills

• 5+ years of experience in ETL development using Talend or Airflow.
• 5+ years of experience developing SQL queries, stored procedures, and views.
• 3+ years of experience coding in Python.
• 3+ years of experience in database administration.
• 3+ years of experience working with cloud solutions.
• Proficiency with Spark, Scala, and Big Data architectures.
• Experience with Azure, Python, and SQL.

Preferred Skills

• 3+ years of experience with Azure Databricks, Snowflake, or Redshift.
• Azure Data Factory certifications or advanced Azure certifications (Azure ML).

Key Skills

Education

Bachelor's degree in Computer Science