Description

You will build, maintain, and optimize data pipelines and cloud-based applications.

This role is on-site.

Responsibilities

• Develop, test, and deploy scalable data pipelines using Apache Spark and Python.
• Design and implement Azure Synapse Analytics solutions for data warehousing and real-time analytics.
• Manage and orchestrate containerized applications using Azure Kubernetes Service (AKS).
• Automate deployment processes through CI/CD pipelines.
• Optimize the data platform for performance, reliability, security, and low latency.

Required Skills

• 8+ years of experience in data engineering or related roles.
• Strong proficiency in Python for scripting and data engineering.
• Extensive experience with Apache Spark for distributed data processing.
• Hands-on experience with Azure Synapse Analytics for ETL and data integration.
• Experience using Azure Kubernetes Service (AKS) for container orchestration.
• Experience with CI/CD pipelines and version control using Azure DevOps, GitHub, or Jenkins.
• Working knowledge of SQL and database performance tuning.
• Understanding of cloud-based architectures and deployment models.
• Bachelor's degree.

Key Skills

Education

Bachelor's degree