Description

You will design and implement DevOps and CI/CD patterns for big data environments.

Responsibilities

• Architect and improve existing solutions using industry-standard DevOps patterns.
• Develop templated, configuration-driven applications to ensure maintainability.
• Build and maintain performance-efficient ETL applications for data lake extraction and transformation.
• Implement Test Driven or Behavioral Driven Development approaches for all applications.
• Secure sensitive data and information within the data pipeline.

Required Skills

• 5+ years of engineering experience in the DevOps space.
• Expertise with Azure DevOps (ADO) or similar DevOps tooling.
• Proficiency in Java and Python.
• Experience with Spring Boot and Maven.
• Hands-on experience with Spark and Helm Charts.
• Background in big data environments.
• Experience working within agile teams.

Preferred Skills

• Experience with Scala and the Hadoop ecosystem (HDFS, HBase, etc.).
• Knowledge of Kafka, Docker, Kubernetes, or orchestration tools like Airflow.
• Familiarity with streaming tools such as NiFi or Streamsets.

Key Skills

Education

Any Graduate