Description
You will design and maintain scalable data architectures and processing pipelines within the Azure ecosystem.
Responsibilities
- Design normalized, denormalized, star, and snowflake schemas to optimize database performance.
- Develop and maintain ETL/ELT pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
- Implement scalable cloud data solutions using Azure Data Lake, Cosmos DB, Synapse Analytics, and SQL Server.
- Optimize performance through query tuning, indexing, partitioning, and clustering strategies.
Required Skills
- 8+ years of experience in data engineering with expertise in schema design and data modeling.
- Hands-on experience with Azure Data Services including Azure Data Lake, Synapse, SQL, Cosmos DB, Databricks, and ADF.
- Proficiency in SQL, Python, or Scala for data processing.
- Experience with Apache Spark, Delta Lake, and Parquet.
- Familiarity with CI/CD pipelines using Azure DevOps.
- Experience with performance tuning.
Preferred Skills
- Knowledge of data governance, security, and compliance.