Description

You will design, develop, and support scalable enterprise data integration solutions within a centralized data repository.

Responsibilities

• Design and implement technical solutions for data acquisition, ingestion, transformation, and storage in a data lakehouse environment.
• Develop, test, and maintain complex ELT/ETL pipelines using Azure Data Factory, Databricks (PySpark, SQL, Delta Live Tables), and dbt.
• Perform database and dimensional modeling to support star and snowflake schemas and optimize query performance.
• Conduct unit testing, data validation, and reconciliation to ensure data accuracy and completeness.
• Implement and report on data quality checks, lineage, metadata management, and governance controls.

Required Skills

• 10+ years designing and developing scalable Medallion Data Lakehouse architectures.
• Extensive hands-on experience with Azure Databricks, Delta Lake, and distributed data processing frameworks.
• Strong expertise in data ingestion, transformation, and curation using ADF, PySpark, SQL, and dbt.
• Advanced knowledge of relational and dimensional data modeling (SQL Server, Synapse, PostgreSQL).
• Proven expertise in SQL optimization, indexing, partitioning, and performance tuning.
• Proficiency in Python (PySpark), SQL, and PowerShell for data engineering automation.
• Experience implementing CI/CD pipelines using Azure DevOps or GitHub Actions.
• Experience working with Parquet, ORC, JSON formats.
• Strong understanding of cloud security, RBAC, data governance, and data lineage.

Key Skills

Education

Any Graduate