Description

You will design and develop scalable data pipelines on Azure to collect, process, and store large datasets.

This role is on-site.

Responsibilities

• Design and develop scalable, reliable data pipelines for ingestion, transformation, and storage.
• Implement efficient data models and data warehousing solutions based on business requirements.
• Optimize data pipeline performance, reliability, and security across the Azure environment.
• Collaborate with data scientists and analysts to integrate complex data workflows.
• Monitor operational health of data solutions and proactively troubleshoot issues.

Required Skills

• 5+ years of experience in data engineering or data architecture.
• Proficiency in SQL, T-SQL, and Python for data processing and scripting.
• Hands-on experience with Azure Data Factory, Azure Data Lake, Azure Databricks, and Azure Synapse Analytics.
• Experience implementing ETL/ELT processes and data warehousing concepts (Star schema, data marts).
• Familiarity with big data processing frameworks, including Spark, PySpark, or Scala.
• Knowledge of Azure Blob Storage, Cosmos DB, and relational databases like Azure SQL Database.
• Experience with DevOps practices for CI/CD in the cloud.

Key Skills

Education

Bachelor's degree