Description
You will design, build, and optimize scalable data pipelines and platforms.
Responsibilities
- Design, develop, and maintain ETL/ELT pipelines to ingest, transform, and load large-scale data from multiple sources.
- Develop and optimize data processing workflows in Azure Databricks using Scala or PySpark.
- Build and manage data warehouses and data marts using Snowflake.
- Write and optimize complex SQL queries for data analysis, transformation, and reporting.
- Implement data quality, validation, and monitoring processes to ensure accuracy and reliability.
Required Skills
- 15+ years of professional experience in data engineering.
- Expertise in ETL Development.
- Proficiency with Azure Databricks.
- Strong command of Snowflake.
- Solid skills in Scala and SQL.
- Experience implementing CI/CD for data workflows.
- Familiarity with supporting Data Analysts and Data Scientists.
- Knowledge of Data Analysis principles.