Description

You will design and manage scalable data processing integrations within Azure environments.

Responsibilities

• Build, operate, and maintain fault-tolerant data processing integrations.
• Optimize data pipelines to improve performance and efficiency.
• Coordinate technical requirements across different teams through clear written and verbal communication.
• Implement CI/CD pipelines to support DevOps and Agile workflows.

Required Skills

• 5+ years of experience in data engineering roles.
• Expertise with Azure Data Factory or Synapse Analytics.
• Hands-on experience with Databricks and Apache Spark.
• Proficiency in PySpark, Scala, and Spark SQL.
• Experience implementing and managing Delta Lakes.
• Proven capability managing cloud infrastructures across Azure, AWS, or IBM cloud environments.
• Experience working within DevOps and Agile methodologies.
• Degree in any field of study.

Preferred Skills

• Experience using Docker or Kubernetes.

Key Skills

Education

Any Garduate