Description

You will provide technical leadership for a team building a data lake repository and ETL processes using Databricks and related technologies.

Responsibilities

• Define data onboarding procedures and collaborate with business stakeholders to integrate new data sources.
• Develop and maintain data lake systems, focusing on ETL processes, data curation, and quality checks.
• Integrate the Data Lake with third-party application APIs to support downstream queries.
• Utilize AWS Redshift to migrate data and create necessary data marts.
• Participate in database and data lake development using technologies like Databricks and Spark.

Required Skills

• 7+ years in data engineering.
• Experience with database and data lake development and/or management.
• Proficiency in Data ETL, Data Curation, and ETL Processes.
• Understanding of cloud technologies, including IaaS and SaaS.
• Knowledge of data lake security concepts.
• Experience with SQL Server.
• Demonstrated understanding of programming concepts, architecture, and full-stack integration.
• Fluent in English (speaking, reading, writing).

Key Skills

Education

BS Degree in Computer Science, Computer Engineering