Description

You will architect and implement DevOps and CI/CD patterns for big data environments.

This role is on-site.

Responsibilities

• Design and improve solutions using industry-standard DevOps patterns.
• Develop templated, configuration-driven applications for maintainability.
• Build performance-efficient ETL applications for data lake extraction and transformation.
• Implement Test Driven Development (TDD) or Behavioral Driven Development (BDD) approaches.
• Secure sensitive data within the data pipeline.

Required Skills

• 5+ years of engineering experience in the DevOps space.
• Expertise with Azure DevOps (ADO) or similar DevOps tooling.
• Proficiency in Java and Python.
• Experience with Spring Boot and Maven.
• Hands-on experience with Spark and Helm Charts.
• Background in big data environments.
• Experience working within agile teams.

Preferred Skills

• Experience with Scala and the Hadoop ecosystem (HDFS, HBase).
• Knowledge of Kafka, Docker, Kubernetes, or orchestration tools like Airflow.
• Familiarity with streaming tools such as NiFi or Streamsets.

Key Skills

Education

Any Graduate