Description
You will lead data engineering efforts focused on building scalable datasets and optimizing data workflows.
Responsibilities
- Write and optimize Databricks notebooks for complex data manipulation.
- Design and build clean, scalable datasets using advanced data modeling.
- Implement data architecture best practices and data normalization.
- Manage data pipelines across relational databases and NoSQL or data lake environments.
Required Skills
- 10+ years of experience in data engineering or software engineering roles.
- Deep expertise in SQL and data modeling.
- Hands-on experience with Apache Spark, Hive, and Airflow.
- Strong understanding of data architecture and normalization.
- Experience with NoSQL and data lake environments.
- Proven ability to work with relational databases.
Preferred Skills
- Familiarity with Delta Lake, Unity Catalog, or similar data governance frameworks.
- Exposure to cloud platforms including Azure, AWS, or GCP.
- Experience working within regulated or compliance environments in the utilities domain.