Big Data Architect with DevOps Experience

You will act as a hands-on engineer and thought leader focused on DevOps and CI/CD within a big data environment.

Responsibilities

• Develop templated, configuration-driven applications to ensure ease of maintenance.
• Build and maintain performance-efficient ETL applications for data lake extraction, loading, and transformation.
• Architect and improve existing solutions using industry-standard DevOps patterns.
• Implement Test Driven or Behavioral Driven Development approaches for all application development.
• Secure sensitive data and information while working within an agile team.

Required Skills

• 5+ years of professional experience.
• Proficiency with DevOps tools, specifically Azure DevOps (ADO).
• Strong programming skills in Java and Python.
• Experience with Spark and Spring Boot.
• Experience using Helm Charts and Maven (or similar POM-based tools).
• Bachelor's degree.

Preferred Skills

• Experience with Scala and the Hadoop ecosystem (HDFS, HBase, etc.).
• Hands-on with Kafka, Docker, and Kubernetes.
• Knowledge of orchestration tools like Airflow and streaming tools such as NiFi or Streamsets.