Description

You will design, develop, and implement data pipelines and ETL processes within the Azure ecosystem.

Responsibilities

• Build and optimize data workflows using Azure Databricks, Azure Data Factory, and Azure Functions.
• Develop Python applications for containerized deployment on Kubernetes.
• Integrate Azure AI Search to improve data retrieval for analytics and business intelligence.
• Utilize Python SDKs to manage data processing and analysis tasks.
• Manage code and collaboration through GitHub following documentation best practices.

Required Skills

• 3+ years of experience in a data engineering role.
• Proficiency in Python and its relevant libraries.
• Hands-on experience with Azure Databricks and Azure Data Factory (ADF).
• Experience with Spark and data engineering workflows.
• Practical knowledge of Azure AI Search.
• Experience writing and deploying Python applications using containerization and orchestration.
• Familiarity with GitHub and Agile methodologies.
• Experience working with diverse data formats and storage solutions.
• Any Graduate degree.

Key Skills

Education

Any Gradute