Description

Design and maintain ETL pipelines and data warehouses on Azure.

Responsibilities

• Design and implement ETL pipelines to move data from various sources into Azure-based storage solutions.
• Develop and maintain data warehouses and data marts to ensure integrity and performance.
• Write clean, maintainable Python code to automate data processes and transformations.
• Implement data quality checks and governance practices to ensure accuracy and compliance.
• Optimize data processing workflows and resolve performance bottlenecks in pipelines.

Required Skills

• 7+ years of professional data engineering experience.
• Strong proficiency in Python for data manipulation and automation.
• Expertise in Azure Data Factory, Azure Databricks, and Azure SQL Data Warehouse.
• Experience with Azure Synapse Analytics and Azure cloud services.
• Deep understanding of data modeling and SQL databases.
• Solid knowledge of data warehousing concepts and ETL tools.
• Bachelor's degree in Computer Science.

Preferred Skills

• Knowledge of big data technologies including Hadoop, Spark, or Kafka.
• Experience with containerization technologies like Docker or Kubernetes.
• Azure Data Engineering certification.

Key Skills

Education

Bachelor's degree in Computer Science