Description

You will build and manage data architectures within the Azure ecosystem, owning the full lifecycle from data lake construction to pipeline maintenance.

Responsibilities

• Build data lakes from scratch and configure existing systems for optimal performance.
• Design, develop, and maintain software using ADF and Synapse Data pipelines.
• Implement data security at both the database and data movement layers.
• Manage CI/CD for data pipelines and handle ETL/ELT processes for large data volumes.
• Collaborate with internal teams to design and support data storage elements.

Required Skills

• 4 to 13 years of experience in data engineering.
• Expertise in Data lakes, Lakehouse, Synapse Analytics, Databricks, and Synapse DB.
• Proficiency in T-SQL, SQL Server, and Spark SQL.
• Hands-on experience with Python, PySpark, and Spark.
• Strong understanding of DWH, MPP systems, OLTP, and OLAP systems.
• Experience working with structured, unstructured, JSON, Parquet, CSV, and XL formats.
• Knowledge of Data catalogs, Metadata, and Source Control Management (TFS, Git, or SVN).

Preferred Skills

• Experience with Azure Data Fabric, MS Purview, or MDM tools.

Key Skills

Education

Any Gradute