Description

You will design and deliver secure, scalable data pipelines in Azure to support analytics and transparency initiatives.

This role is on-site.

Responsibilities

• Build ingestion workflows and transformation logic for reporting and analytics.
• Develop modular, reusable pipeline components with robust error handling.
• Manage data quality through automated validation, logging, and reconciliation.
• Apply data masking, PII handling, and encryption for sensitive data.

Required Skills

• 3+ years building ETL/ELT pipelines using Azure-native tools.
• Hands-on expertise with Azure Data Factory, Dataflows, or Synapse Pipelines.
• Proficiency in SQL, Python, or PySpark for data transformation.
• Experience with Delta Lake, Azure Data Lake Storage Gen2, JSON, and Parquet.
• Strong grasp of DevOps/DataOps practices, including CI/CD for data pipelines.
• Knowledge of data masking, PII handling, and encryption techniques.
• Experience with data quality frameworks.

Preferred Skills

• Familiarity with public data sources and government transparency datasets.

Education: Any Graduate degree.

Key Skills

Education

Any Graduate