Description

You will design, develop, and maintain ETL processes within Azure environments to support data warehousing and data lake requirements.

Responsibilities

• Design and implement ETL processes using Azure Data Factory and other Azure services.
• Develop automated data pipelines for ingestion and transformation tasks.
• Optimize ETL workflows for performance, scalability, and query efficiency.
• Monitor ETL jobs, troubleshoot issues, and ensure data quality through validation and cleansing.
• Maintain documentation for data sources, transformations, and ETL processes.

Required Skills

• 5+ years of experience in ETL development.
• Proficiency with Azure Data Factory, Azure Synapse Analytics, and Azure Blob Storage.
• Strong SQL skills for database querying and optimization.
• Experience using Python for custom transformations and data manipulation.
• Hands-on experience with Power BI data flows and data movement pipelines.
• Knowledge of data modeling concepts, including star and snowflake schemas.
• Experience integrating relational databases, NoSQL databases, and APIs.
• Familiarity with Azure Databricks for large-scale dataset processing.
• Competency with Git for version control and Azure DevOps for project management.

Preferred Skills

• Understanding of CI/CD pipelines and data security best practices.

Key Skills

Education

Any Graduate