Description

You will build and maintain data pipelines within an Azure and Cloudera environment.

Responsibilities

• Develop data processing workflows using Python or Scala.
• Manage and optimize big data frameworks including Hadoop, Spark, and Kafka.
• Implement distributed systems to handle large-scale data ingestion.
• Utilize Azure Data Factory to orchestrate data movement and transformation.

Required Skills

• 3-4 years of relevant project experience in big data engineering.
• Proficiency with Python and/or Scala.
• Hands-on experience with Hadoop, Spark, and Kafka.
• Practical experience with Azure or Azure certification.
• Experience with Azure Data Factory.
• Knowledge of distributed systems.
• Bachelor's degree in Computer Science.

Key Skills

Education

Bachelor's degree in Computer Science