Description
You will lead data engineering efforts and oversee complex ETL processes.
Responsibilities
- Design and implement ETL jobs using Python and PySpark.
- Manage data pipelines within Databricks and Azure Data Lake Storage (ADLS).
- Develop and optimize SQL queries and stored procedures in Azure SQL.
- Oversee data integration workflows using SSIS.
- Apply domain knowledge of Life Insurance processes to data modeling and architecture.
Required Skills
- 12+ years of total professional experience.
- 8+ years of experience working with Databricks and ADLS.
- 8+ years of advanced SQL experience.
- 7+ years of experience developing ETL jobs.
- Proficiency in Python and PySpark.
- Experience with AWS and Azure SQL.
- Hands-on expertise with SSIS.
- Domain expertise in Life Insurance processes.
- Bachelor's degree or equivalent experience.