Description

Design and implement enterprise data solutions for state-level systems using Microsoft Fabric and Azure Databricks.

This role is on-site.

Responsibilities

• Architect end-to-end data solutions using Microsoft Fabric, OneLake, and Synapse Analytics.
• Implement lakehouse architectures and scalable ETL/ELT pipelines with Azure Databricks.
• Design data integration patterns between IES Gateway and analytics platforms using Delta Lake.
• Establish data governance frameworks using Microsoft Purview and Unity Catalog for lineage and security.
• Optimize large-scale data processing through Spark tuning and partitioning strategies.

Required Skills

• 6+ years of experience in data architecture and engineering.
• 2+ years of hands-on experience with Azure Databricks and Apache Spark.
• Recent professional experience with the Microsoft Fabric platform.
• Proficiency in SQL, including complex JOINs, subqueries, and window functions.
• Strong Python and PySpark skills for large-scale data processing.
• Experience implementing Delta Lake for ACID transactions and schema enforcement.
• Knowledge of designing security patterns for sensitive data handling and audit logging.
• Experience with Terraform for infrastructure management.

Preferred Skills

• Bachelor's degree in Computer Science or a related field.

Key Skills

Education

Bachelor's Degree