You will design and build scalable data architectures and pipelines within the Azure ecosystem.
Responsibilities
Design normalized, denormalized, star, and snowflake schemas to meet business requirements.
Develop and maintain ETL/ELT processes using Azure Data Factory, Databricks, and Synapse Analytics.
Implement partitioning, indexing, and clustering strategies to optimize database performance and scalability.
Manage data ingestion, transformation, and storage across Azure Data Lake, SQL Database, and Synapse.
Optimize data flows for both structured and unstructured data to support analytical processing.
Required Skills
7+ years of experience in data engineering with a focus on schema design and data modeling.
Expertise in Azure Data Services including Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, Cosmos DB, Databricks, and Azure Data Factory.
Hands-on experience with OLTP vs. OLAP principles, star/snowflake schemas, indexing, and partitioning.
Proficiency in SQL, Python, or Scala for data processing and transformation.
Experience with Big Data processing using Apache Spark, Delta Lake, and Parquet formats.
Familiarity with CI/CD pipelines for data workflows using Azure DevOps.
Experience in performance tuning, query optimization, and cost management on Azure.
Knowledge of Snowflake Schema, SQL Server, and SQL Database.
Preferred Skills
Knowledge of data governance, security, and compliance best practices.