Description

You will manage data engineering workflows and architecture within a cloud environment.

Responsibilities

• Design and implement data integration and ETL processes using Azure Data Factory.
• Apply data warehouse and data lake architectures to support scalable data storage.
• Develop data pipelines using Spark and Databricks.
• Solve complex analytical problems using computer science fundamentals and distributed computing principles.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in SQL and Python.
• Experience with Databricks and Spark.
• Familiarity with Java or Scala.
• Experience with cloud platforms, specifically Azure.
• Strong understanding of algorithms, data structures, and computational complexity.
• Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent work experience.

Preferred Skills

• Experience with big data technologies including Kafka, Hadoop, or Hive.
• Experience with data visualization and reporting tools such as Tableau.

Key Skills

Education

Bachelor’s degree in Computer Science