Description

You will build and manage data pipelines and transformation processes within the Azure ecosystem.

Responsibilities

• Build and schedule data pipelines and manage data movement using Azure Data Factory.
• Execute data ingestion, transformation, and analysis tasks using Azure Databricks.
• Design and implement ETL/ELT processes and data modeling techniques for data integration.
• Perform data cleaning and quality assurance operations to maintain data integrity.
• Monitor and optimize data engineering solutions for improved efficiency.

Required Skills

• 4-5 years of experience working on ETL projects.
• Proficiency in SQL programming and Oracle Database for storage and retrieval.
• Strong programming skills in Python and PySpark.
• Hands-on experience with Azure Data Factory (ADF).
• Experience using Azure Databricks for data engineering tasks.
• Knowledge of Azure DevOps for implementing CI/CD pipelines.
• Bachelor's degree in Computer Science, Computer Engineering, or a related technical discipline.

Preferred Skills

• Knowledge of Apache Hive and Apache Spark components.

Key Skills

Education

Bachelor's degree