Description

You will build and manage scalable data architectures within the Azure ecosystem, owning the full lifecycle from data lake construction to automated pipeline deployment.

Responsibilities

• Build data lakes from scratch, configure existing systems, and provide user support.
• Develop and manage data pipelines using Azure Data Factory (ADF) and Synapse.
• Implement data security at both the database and data movement layers.
• Manage CI/CD for data pipelines to automate deployments using Git, TFS, or SVN.
• Design, develop, and maintain software solutions in collaboration with internal teams.

Required Skills

• 4 to 13 years of experience in data engineering.
• Proficiency in Azure Data Lake, Lakehouse, Synapse Analytics, and Databricks.
• Strong expertise in T-SQL, SQL Server, and Synapse DB.
• Hands-on experience with ETL/ELT processes and large volumes of structured/unstructured data.
• Working knowledge of Python, PySpark, and Spark SQL.
• Experience with file formats including JSON, Parquet, CSV, and Excel.
• Practical knowledge of Data Catalogs, Metadata, DWH, MPP, OLTP, and OLAP systems.
• Experience with Source Control Management such as Git, TFS, or SVN.

Preferred Skills

• Experience with Azure Data Fabric, MS Purview, or MDM tools.

Key Skills

Education

Any Graduate