Description
You will build and maintain secure, efficient, and business-critical data pipelines.
Responsibilities
- Develop strong ETL processes for data ingestion and transformation.
- Design and implement data warehousing solutions using bronze, silver, and gold layers.
- Manage data integration across relational and NoSQL stores.
- Utilize Azure services to automate and orchestrate data workflows.
Required Skills
- 5+ years of experience in data engineering.
- Proficiency with PySpark for large-scale data processing.
- Experience with Azure Data Factory (ADF) and Azure Databricks.
- Strong working knowledge of Azure Data Lake (ADLS) and Azure SQL.
- Experience integrating with MongoDB.
- Familiarity with data warehousing concepts (tabular/multi-dimensional cubes).
- Ability to work across cross-functional teams.
Preferred Skills
- Experience in insurance or reinsurance data domains.
- Familiarity with Agile/SCRUM methodology.